2023-02-09 12:02:40,905 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat timeout: 13 mins 2023-02-09 12:02:40,951 INFO [Time-limited test] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=7, OpenFileDescriptor=242, MaxFileDescriptor=60000, SystemLoadAverage=209, ProcessCount=166, AvailableMemoryMB=4916 2023-02-09 12:02:41,239 DEBUG [Time-limited test] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30ca3dca-f74a-9aa7-fe8b-05af2eaef0f9 2023-02-09 12:02:41,248 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-09 12:02:41,249 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30ca3dca-f74a-9aa7-fe8b-05af2eaef0f9/cluster_3582c6ee-f89b-e892-7cd7-cc19fbe4515b, deleteOnExit=true 2023-02-09 12:02:41,249 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-09 12:02:41,250 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30ca3dca-f74a-9aa7-fe8b-05af2eaef0f9/test.cache.data in system properties and HBase conf 2023-02-09 12:02:41,250 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30ca3dca-f74a-9aa7-fe8b-05af2eaef0f9/hadoop.tmp.dir in system properties and HBase conf 2023-02-09 12:02:41,251 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30ca3dca-f74a-9aa7-fe8b-05af2eaef0f9/hadoop.log.dir in system properties and HBase conf 2023-02-09 12:02:41,251 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30ca3dca-f74a-9aa7-fe8b-05af2eaef0f9/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-09 12:02:41,252 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30ca3dca-f74a-9aa7-fe8b-05af2eaef0f9/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-09 12:02:41,252 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-09 12:02:41,355 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-02-09 12:02:41,723 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-09 12:02:41,729 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30ca3dca-f74a-9aa7-fe8b-05af2eaef0f9/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-09 12:02:41,729 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30ca3dca-f74a-9aa7-fe8b-05af2eaef0f9/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-09 12:02:41,730 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30ca3dca-f74a-9aa7-fe8b-05af2eaef0f9/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-09 12:02:41,730 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30ca3dca-f74a-9aa7-fe8b-05af2eaef0f9/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-09 12:02:41,730 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30ca3dca-f74a-9aa7-fe8b-05af2eaef0f9/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-09 12:02:41,731 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30ca3dca-f74a-9aa7-fe8b-05af2eaef0f9/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-09 12:02:41,731 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30ca3dca-f74a-9aa7-fe8b-05af2eaef0f9/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-09 12:02:41,732 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30ca3dca-f74a-9aa7-fe8b-05af2eaef0f9/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-09 12:02:41,732 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30ca3dca-f74a-9aa7-fe8b-05af2eaef0f9/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-09 12:02:41,733 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30ca3dca-f74a-9aa7-fe8b-05af2eaef0f9/nfs.dump.dir in system properties and HBase conf 2023-02-09 12:02:41,733 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30ca3dca-f74a-9aa7-fe8b-05af2eaef0f9/java.io.tmpdir in system properties and HBase conf 2023-02-09 12:02:41,733 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30ca3dca-f74a-9aa7-fe8b-05af2eaef0f9/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-09 12:02:41,733 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30ca3dca-f74a-9aa7-fe8b-05af2eaef0f9/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-09 12:02:41,734 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30ca3dca-f74a-9aa7-fe8b-05af2eaef0f9/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-09 12:02:42,243 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-09 12:02:42,247 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-09 12:02:42,513 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-02-09 12:02:42,661 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-02-09 12:02:42,673 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 12:02:42,712 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 12:02:42,745 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30ca3dca-f74a-9aa7-fe8b-05af2eaef0f9/java.io.tmpdir/Jetty_localhost_42173_hdfs____.maeuvb/webapp 2023-02-09 12:02:42,873 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42173 2023-02-09 12:02:42,887 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-09 12:02:42,888 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-09 12:02:43,406 WARN [Listener at localhost/35113] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 12:02:43,502 WARN [Listener at localhost/35113] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-09 12:02:43,526 WARN [Listener at localhost/35113] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 12:02:43,533 INFO [Listener at localhost/35113] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 12:02:43,540 INFO [Listener at localhost/35113] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30ca3dca-f74a-9aa7-fe8b-05af2eaef0f9/java.io.tmpdir/Jetty_localhost_40389_datanode____.mmfnhd/webapp 2023-02-09 12:02:43,656 INFO [Listener at localhost/35113] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40389 2023-02-09 12:02:44,162 WARN [Listener at localhost/39825] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 12:02:44,254 WARN [Listener at localhost/39825] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-09 12:02:44,258 WARN [Listener at localhost/39825] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 12:02:44,260 INFO [Listener at localhost/39825] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 12:02:44,270 INFO [Listener at localhost/39825] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30ca3dca-f74a-9aa7-fe8b-05af2eaef0f9/java.io.tmpdir/Jetty_localhost_43981_datanode____.1lprba/webapp 2023-02-09 12:02:44,405 INFO [Listener at localhost/39825] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43981 2023-02-09 12:02:44,416 WARN [Listener at localhost/43097] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 12:02:44,708 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xbbd17d751a144f13: Processing first storage report for DS-6403bbd9-0c0f-4f2d-81bb-c54ec159d933 from datanode ca64a16a-0a5f-47a2-85c1-8f00887d03a5 2023-02-09 12:02:44,709 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xbbd17d751a144f13: from storage DS-6403bbd9-0c0f-4f2d-81bb-c54ec159d933 node DatanodeRegistration(127.0.0.1:46507, datanodeUuid=ca64a16a-0a5f-47a2-85c1-8f00887d03a5, infoPort=45983, infoSecurePort=0, ipcPort=43097, storageInfo=lv=-57;cid=testClusterID;nsid=2112685055;c=1675944162316), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-09 12:02:44,709 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x9dae88422780dcd7: Processing first storage report for DS-49df6b6b-a5ab-4581-a51f-6811d03ab4eb from datanode ce50577f-f86e-44ab-952c-63e6ea6e7622 2023-02-09 12:02:44,709 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x9dae88422780dcd7: from storage DS-49df6b6b-a5ab-4581-a51f-6811d03ab4eb node DatanodeRegistration(127.0.0.1:35953, datanodeUuid=ce50577f-f86e-44ab-952c-63e6ea6e7622, infoPort=37023, infoSecurePort=0, ipcPort=39825, storageInfo=lv=-57;cid=testClusterID;nsid=2112685055;c=1675944162316), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 12:02:44,710 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xbbd17d751a144f13: Processing first storage report for DS-c1cc6264-b2b9-4b24-b0da-47c72d715f2f from datanode ca64a16a-0a5f-47a2-85c1-8f00887d03a5 2023-02-09 12:02:44,710 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xbbd17d751a144f13: from storage DS-c1cc6264-b2b9-4b24-b0da-47c72d715f2f node DatanodeRegistration(127.0.0.1:46507, datanodeUuid=ca64a16a-0a5f-47a2-85c1-8f00887d03a5, infoPort=45983, infoSecurePort=0, ipcPort=43097, storageInfo=lv=-57;cid=testClusterID;nsid=2112685055;c=1675944162316), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-09 12:02:44,710 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x9dae88422780dcd7: Processing first storage report for DS-f00179ac-61ba-4255-b84c-d4366370515c from datanode ce50577f-f86e-44ab-952c-63e6ea6e7622 2023-02-09 12:02:44,710 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x9dae88422780dcd7: from storage DS-f00179ac-61ba-4255-b84c-d4366370515c node DatanodeRegistration(127.0.0.1:35953, datanodeUuid=ce50577f-f86e-44ab-952c-63e6ea6e7622, infoPort=37023, infoSecurePort=0, ipcPort=39825, storageInfo=lv=-57;cid=testClusterID;nsid=2112685055;c=1675944162316), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 12:02:44,865 DEBUG [Listener at localhost/43097] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30ca3dca-f74a-9aa7-fe8b-05af2eaef0f9 2023-02-09 12:02:44,950 INFO [Listener at localhost/43097] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30ca3dca-f74a-9aa7-fe8b-05af2eaef0f9/cluster_3582c6ee-f89b-e892-7cd7-cc19fbe4515b/zookeeper_0, clientPort=61812, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30ca3dca-f74a-9aa7-fe8b-05af2eaef0f9/cluster_3582c6ee-f89b-e892-7cd7-cc19fbe4515b/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30ca3dca-f74a-9aa7-fe8b-05af2eaef0f9/cluster_3582c6ee-f89b-e892-7cd7-cc19fbe4515b/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-09 12:02:44,968 INFO [Listener at localhost/43097] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=61812 2023-02-09 12:02:44,977 INFO [Listener at localhost/43097] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 12:02:44,979 INFO [Listener at localhost/43097] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 12:02:45,666 INFO [Listener at localhost/43097] util.FSUtils(479): Created version file at hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef with version=8 2023-02-09 12:02:45,667 INFO [Listener at localhost/43097] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 12:02:45,668 INFO [Listener at localhost/43097] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 12:02:45,671 INFO [Listener at localhost/43097] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:35113/user/jenkins/test-data/2cbb219e-33e2-6152-83c4-a0d89c239a73/hbase-staging 2023-02-09 12:02:45,990 INFO [Listener at localhost/43097] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-02-09 12:02:46,485 INFO [Listener at localhost/43097] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 12:02:46,518 INFO [Listener at localhost/43097] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 12:02:46,519 INFO [Listener at localhost/43097] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 12:02:46,519 INFO [Listener at localhost/43097] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 12:02:46,519 INFO [Listener at localhost/43097] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 12:02:46,519 INFO [Listener at localhost/43097] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 12:02:46,675 INFO [Listener at localhost/43097] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 12:02:46,746 DEBUG [Listener at localhost/43097] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-02-09 12:02:46,840 INFO [Listener at localhost/43097] ipc.NettyRpcServer(120): Bind to /172.31.14.131:32779 2023-02-09 12:02:46,850 INFO [Listener at localhost/43097] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 12:02:46,853 INFO [Listener at localhost/43097] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 12:02:46,874 INFO [Listener at localhost/43097] zookeeper.RecoverableZooKeeper(93): Process identifier=master:32779 connecting to ZooKeeper ensemble=127.0.0.1:61812 2023-02-09 12:02:46,919 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): master:327790x0, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 12:02:46,921 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:32779-0x10038f668060000 connected 2023-02-09 12:02:46,950 DEBUG [Listener at localhost/43097] zookeeper.ZKUtil(164): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 12:02:46,951 DEBUG [Listener at localhost/43097] zookeeper.ZKUtil(164): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 12:02:46,955 DEBUG [Listener at localhost/43097] zookeeper.ZKUtil(164): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 12:02:46,963 DEBUG [Listener at localhost/43097] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=32779 2023-02-09 12:02:46,963 DEBUG [Listener at localhost/43097] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=32779 2023-02-09 12:02:46,964 DEBUG [Listener at localhost/43097] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=32779 2023-02-09 12:02:46,965 DEBUG [Listener at localhost/43097] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=32779 2023-02-09 12:02:46,966 DEBUG [Listener at localhost/43097] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=32779 2023-02-09 12:02:46,972 INFO [Listener at localhost/43097] master.HMaster(439): hbase.rootdir=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef, hbase.cluster.distributed=false 2023-02-09 12:02:47,041 INFO [Listener at localhost/43097] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 12:02:47,041 INFO [Listener at localhost/43097] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 12:02:47,041 INFO [Listener at localhost/43097] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 12:02:47,042 INFO [Listener at localhost/43097] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 12:02:47,042 INFO [Listener at localhost/43097] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 12:02:47,042 INFO [Listener at localhost/43097] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 12:02:47,046 INFO [Listener at localhost/43097] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 12:02:47,049 INFO [Listener at localhost/43097] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43865 2023-02-09 12:02:47,052 INFO [Listener at localhost/43097] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-09 12:02:47,059 DEBUG [Listener at localhost/43097] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 12:02:47,060 INFO [Listener at localhost/43097] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 12:02:47,062 INFO [Listener at localhost/43097] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 12:02:47,063 INFO [Listener at localhost/43097] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43865 connecting to ZooKeeper ensemble=127.0.0.1:61812 2023-02-09 12:02:47,071 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): regionserver:438650x0, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 12:02:47,072 DEBUG [Listener at localhost/43097] zookeeper.ZKUtil(164): regionserver:438650x0, quorum=127.0.0.1:61812, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 12:02:47,072 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:43865-0x10038f668060001 connected 2023-02-09 12:02:47,073 DEBUG [Listener at localhost/43097] zookeeper.ZKUtil(164): regionserver:43865-0x10038f668060001, quorum=127.0.0.1:61812, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 12:02:47,074 DEBUG [Listener at localhost/43097] zookeeper.ZKUtil(164): regionserver:43865-0x10038f668060001, quorum=127.0.0.1:61812, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 12:02:47,075 DEBUG [Listener at localhost/43097] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43865 2023-02-09 12:02:47,075 DEBUG [Listener at localhost/43097] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43865 2023-02-09 12:02:47,076 DEBUG [Listener at localhost/43097] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43865 2023-02-09 12:02:47,076 DEBUG [Listener at localhost/43097] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43865 2023-02-09 12:02:47,077 DEBUG [Listener at localhost/43097] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43865 2023-02-09 12:02:47,089 INFO [Listener at localhost/43097] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 12:02:47,089 INFO [Listener at localhost/43097] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 12:02:47,089 INFO [Listener at localhost/43097] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 12:02:47,090 INFO [Listener at localhost/43097] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 12:02:47,090 INFO [Listener at localhost/43097] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 12:02:47,090 INFO [Listener at localhost/43097] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 12:02:47,090 INFO [Listener at localhost/43097] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 12:02:47,092 INFO [Listener at localhost/43097] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40063 2023-02-09 12:02:47,093 INFO [Listener at localhost/43097] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-09 12:02:47,095 DEBUG [Listener at localhost/43097] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 12:02:47,096 INFO [Listener at localhost/43097] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 12:02:47,099 INFO [Listener at localhost/43097] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 12:02:47,102 INFO [Listener at localhost/43097] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40063 connecting to ZooKeeper ensemble=127.0.0.1:61812 2023-02-09 12:02:47,107 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): regionserver:400630x0, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 12:02:47,108 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:40063-0x10038f668060002 connected 2023-02-09 12:02:47,108 DEBUG [Listener at localhost/43097] zookeeper.ZKUtil(164): regionserver:40063-0x10038f668060002, quorum=127.0.0.1:61812, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 12:02:47,109 DEBUG [Listener at localhost/43097] zookeeper.ZKUtil(164): regionserver:40063-0x10038f668060002, quorum=127.0.0.1:61812, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 12:02:47,110 DEBUG [Listener at localhost/43097] zookeeper.ZKUtil(164): regionserver:40063-0x10038f668060002, quorum=127.0.0.1:61812, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 12:02:47,112 DEBUG [Listener at localhost/43097] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40063 2023-02-09 12:02:47,112 DEBUG [Listener at localhost/43097] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40063 2023-02-09 12:02:47,116 DEBUG [Listener at localhost/43097] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40063 2023-02-09 12:02:47,116 DEBUG [Listener at localhost/43097] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40063 2023-02-09 12:02:47,117 DEBUG [Listener at localhost/43097] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40063 2023-02-09 12:02:47,118 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,32779,1675944165832 2023-02-09 12:02:47,131 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-09 12:02:47,133 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,32779,1675944165832 2023-02-09 12:02:47,150 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 12:02:47,150 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): regionserver:43865-0x10038f668060001, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 12:02:47,150 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): regionserver:40063-0x10038f668060002, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 12:02:47,150 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 12:02:47,152 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-09 12:02:47,153 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,32779,1675944165832 from backup master directory 2023-02-09 12:02:47,153 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-09 12:02:47,156 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,32779,1675944165832 2023-02-09 12:02:47,157 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-09 12:02:47,157 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 12:02:47,157 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,32779,1675944165832 2023-02-09 12:02:47,160 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-02-09 12:02:47,162 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-02-09 12:02:47,243 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/hbase.id with ID: 5e2ea543-9505-455f-a0e6-a22448910d1a 2023-02-09 12:02:47,283 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 12:02:47,302 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 12:02:47,352 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x42965873 to 127.0.0.1:61812 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 12:02:47,387 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6fe1a04, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 12:02:47,414 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-09 12:02:47,417 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-09 12:02:47,438 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-02-09 12:02:47,438 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-02-09 12:02:47,441 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:849) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2178) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:523) at java.lang.Thread.run(Thread.java:750) 2023-02-09 12:02:47,445 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:849) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2178) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:523) at java.lang.Thread.run(Thread.java:750) 2023-02-09 12:02:47,446 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 12:02:47,487 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/MasterData/data/master/store-tmp 2023-02-09 12:02:47,519 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:02:47,520 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-09 12:02:47,520 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 12:02:47,520 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 12:02:47,520 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-09 12:02:47,520 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 12:02:47,520 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 12:02:47,520 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675944167519Disabling compacts and flushes for region at 1675944167519Disabling writes for close at 1675944167520 (+1 ms)Writing region close event to WAL at 1675944167520Closed at 1675944167520 2023-02-09 12:02:47,522 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/MasterData/WALs/jenkins-hbase4.apache.org,32779,1675944165832 2023-02-09 12:02:47,544 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C32779%2C1675944165832, suffix=, logDir=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/MasterData/WALs/jenkins-hbase4.apache.org,32779,1675944165832, archiveDir=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/MasterData/oldWALs, maxLogs=10 2023-02-09 12:02:47,603 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35953,DS-49df6b6b-a5ab-4581-a51f-6811d03ab4eb,DISK] 2023-02-09 12:02:47,603 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46507,DS-6403bbd9-0c0f-4f2d-81bb-c54ec159d933,DISK] 2023-02-09 12:02:47,612 DEBUG [RS-EventLoopGroup-4-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-02-09 12:02:47,684 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/MasterData/WALs/jenkins-hbase4.apache.org,32779,1675944165832/jenkins-hbase4.apache.org%2C32779%2C1675944165832.1675944167554 2023-02-09 12:02:47,685 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46507,DS-6403bbd9-0c0f-4f2d-81bb-c54ec159d933,DISK], DatanodeInfoWithStorage[127.0.0.1:35953,DS-49df6b6b-a5ab-4581-a51f-6811d03ab4eb,DISK]] 2023-02-09 12:02:47,685 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-09 12:02:47,686 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:02:47,689 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 12:02:47,690 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 12:02:47,754 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-09 12:02:47,760 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-09 12:02:47,788 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-09 12:02:47,800 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:02:47,806 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-09 12:02:47,808 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-09 12:02:47,821 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 12:02:47,826 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 12:02:47,827 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66561518, jitterRate=-0.00815609097480774}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 12:02:47,827 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1675944167720Initializing all the Stores at 1675944167722 (+2 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944167723 (+1 ms)Cleaning up temporary data from old regions at 1675944167813 (+90 ms)Cleaning up detritus from prior splits at 1675944167814 (+1 ms)Region opened successfully at 1675944167827 (+13 ms) 2023-02-09 12:02:47,829 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-09 12:02:47,851 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-09 12:02:47,851 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-09 12:02:47,854 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-09 12:02:47,856 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-02-09 12:02:47,893 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 37 msec 2023-02-09 12:02:47,893 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-09 12:02:47,924 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-09 12:02:47,930 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-09 12:02:47,954 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-09 12:02:47,959 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-09 12:02:47,960 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-09 12:02:47,966 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-09 12:02:47,971 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-09 12:02:47,974 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 12:02:47,975 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-09 12:02:47,976 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-09 12:02:47,993 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-09 12:02:47,997 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 12:02:47,997 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): regionserver:43865-0x10038f668060001, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 12:02:47,998 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 12:02:47,998 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): regionserver:40063-0x10038f668060002, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 12:02:47,998 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,32779,1675944165832, sessionid=0x10038f668060000, setting cluster-up flag (Was=false) 2023-02-09 12:02:48,020 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 12:02:48,026 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-09 12:02:48,028 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,32779,1675944165832 2023-02-09 12:02:48,036 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 12:02:48,043 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-09 12:02:48,044 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,32779,1675944165832 2023-02-09 12:02:48,048 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.hbase-snapshot/.tmp 2023-02-09 12:02:48,123 INFO [RS:0;jenkins-hbase4:43865] regionserver.HRegionServer(952): ClusterId : 5e2ea543-9505-455f-a0e6-a22448910d1a 2023-02-09 12:02:48,124 INFO [RS:1;jenkins-hbase4:40063] regionserver.HRegionServer(952): ClusterId : 5e2ea543-9505-455f-a0e6-a22448910d1a 2023-02-09 12:02:48,131 DEBUG [RS:1;jenkins-hbase4:40063] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-09 12:02:48,131 DEBUG [RS:0;jenkins-hbase4:43865] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-09 12:02:48,143 DEBUG [RS:0;jenkins-hbase4:43865] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-09 12:02:48,144 DEBUG [RS:0;jenkins-hbase4:43865] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-09 12:02:48,145 DEBUG [RS:1;jenkins-hbase4:40063] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-09 12:02:48,145 DEBUG [RS:1;jenkins-hbase4:40063] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-09 12:02:48,151 DEBUG [RS:1;jenkins-hbase4:40063] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-09 12:02:48,151 DEBUG [RS:0;jenkins-hbase4:43865] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-09 12:02:48,153 DEBUG [RS:1;jenkins-hbase4:40063] zookeeper.ReadOnlyZKClient(139): Connect 0x369ea0d5 to 127.0.0.1:61812 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 12:02:48,153 DEBUG [RS:0;jenkins-hbase4:43865] zookeeper.ReadOnlyZKClient(139): Connect 0x39af17e7 to 127.0.0.1:61812 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 12:02:48,172 DEBUG [RS:1;jenkins-hbase4:40063] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@29678d8b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 12:02:48,173 DEBUG [RS:1;jenkins-hbase4:40063] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4ea6a414, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 12:02:48,173 DEBUG [RS:0;jenkins-hbase4:43865] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@628f0c46, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 12:02:48,174 DEBUG [RS:0;jenkins-hbase4:43865] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@458618e6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 12:02:48,202 DEBUG [RS:0;jenkins-hbase4:43865] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:43865 2023-02-09 12:02:48,202 DEBUG [RS:1;jenkins-hbase4:40063] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:40063 2023-02-09 12:02:48,208 INFO [RS:0;jenkins-hbase4:43865] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-09 12:02:48,208 INFO [RS:0;jenkins-hbase4:43865] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-09 12:02:48,209 DEBUG [RS:0;jenkins-hbase4:43865] regionserver.HRegionServer(1023): About to register with Master. 2023-02-09 12:02:48,208 INFO [RS:1;jenkins-hbase4:40063] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-09 12:02:48,209 INFO [RS:1;jenkins-hbase4:40063] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-09 12:02:48,209 DEBUG [RS:1;jenkins-hbase4:40063] regionserver.HRegionServer(1023): About to register with Master. 2023-02-09 12:02:48,212 INFO [RS:0;jenkins-hbase4:43865] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,32779,1675944165832 with isa=jenkins-hbase4.apache.org/172.31.14.131:43865, startcode=1675944167040 2023-02-09 12:02:48,212 INFO [RS:1;jenkins-hbase4:40063] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,32779,1675944165832 with isa=jenkins-hbase4.apache.org/172.31.14.131:40063, startcode=1675944167089 2023-02-09 12:02:48,214 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-09 12:02:48,227 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 12:02:48,227 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 12:02:48,227 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 12:02:48,227 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 12:02:48,227 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-09 12:02:48,228 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:02:48,228 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 12:02:48,228 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:02:48,232 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1675944198231 2023-02-09 12:02:48,232 DEBUG [RS:1;jenkins-hbase4:40063] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-09 12:02:48,232 DEBUG [RS:0;jenkins-hbase4:43865] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-09 12:02:48,234 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-09 12:02:48,237 DEBUG [PEWorker-2] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-09 12:02:48,238 INFO [PEWorker-2] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-09 12:02:48,243 INFO [PEWorker-2] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-09 12:02:48,246 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-09 12:02:48,254 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-09 12:02:48,255 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-09 12:02:48,255 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-09 12:02:48,255 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-09 12:02:48,256 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-09 12:02:48,267 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-09 12:02:48,269 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-09 12:02:48,270 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-09 12:02:48,276 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-09 12:02:48,277 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-09 12:02:48,283 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675944168280,5,FailOnTimeoutGroup] 2023-02-09 12:02:48,284 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675944168283,5,FailOnTimeoutGroup] 2023-02-09 12:02:48,284 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-09 12:02:48,288 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-09 12:02:48,291 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-09 12:02:48,291 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-09 12:02:48,315 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53839, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-02-09 12:02:48,315 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38439, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-02-09 12:02:48,315 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-09 12:02:48,317 INFO [PEWorker-2] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-09 12:02:48,317 INFO [PEWorker-2] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef 2023-02-09 12:02:48,332 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32779] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,40063,1675944167089 2023-02-09 12:02:48,333 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32779] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,43865,1675944167040 2023-02-09 12:02:48,354 DEBUG [PEWorker-2] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:02:48,359 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-09 12:02:48,361 DEBUG [RS:1;jenkins-hbase4:40063] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef 2023-02-09 12:02:48,361 DEBUG [RS:0;jenkins-hbase4:43865] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef 2023-02-09 12:02:48,362 DEBUG [RS:1;jenkins-hbase4:40063] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:35113 2023-02-09 12:02:48,362 DEBUG [RS:0;jenkins-hbase4:43865] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:35113 2023-02-09 12:02:48,362 DEBUG [RS:1;jenkins-hbase4:40063] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-09 12:02:48,362 DEBUG [RS:0;jenkins-hbase4:43865] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-09 12:02:48,364 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/hbase/meta/1588230740/info 2023-02-09 12:02:48,367 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-09 12:02:48,368 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 12:02:48,369 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:02:48,369 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-09 12:02:48,374 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/hbase/meta/1588230740/rep_barrier 2023-02-09 12:02:48,375 DEBUG [RS:1;jenkins-hbase4:40063] zookeeper.ZKUtil(162): regionserver:40063-0x10038f668060002, quorum=127.0.0.1:61812, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40063,1675944167089 2023-02-09 12:02:48,375 WARN [RS:1;jenkins-hbase4:40063] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 12:02:48,376 INFO [RS:1;jenkins-hbase4:40063] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 12:02:48,376 DEBUG [RS:0;jenkins-hbase4:43865] zookeeper.ZKUtil(162): regionserver:43865-0x10038f668060001, quorum=127.0.0.1:61812, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43865,1675944167040 2023-02-09 12:02:48,376 DEBUG [RS:1;jenkins-hbase4:40063] regionserver.HRegionServer(1947): logDir=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/WALs/jenkins-hbase4.apache.org,40063,1675944167089 2023-02-09 12:02:48,376 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40063,1675944167089] 2023-02-09 12:02:48,376 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-09 12:02:48,376 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,43865,1675944167040] 2023-02-09 12:02:48,376 WARN [RS:0;jenkins-hbase4:43865] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 12:02:48,378 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:02:48,378 INFO [RS:0;jenkins-hbase4:43865] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 12:02:48,379 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-09 12:02:48,379 DEBUG [RS:0;jenkins-hbase4:43865] regionserver.HRegionServer(1947): logDir=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/WALs/jenkins-hbase4.apache.org,43865,1675944167040 2023-02-09 12:02:48,392 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/hbase/meta/1588230740/table 2023-02-09 12:02:48,393 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-09 12:02:48,394 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:02:48,396 DEBUG [PEWorker-2] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/hbase/meta/1588230740 2023-02-09 12:02:48,397 DEBUG [PEWorker-2] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/hbase/meta/1588230740 2023-02-09 12:02:48,398 DEBUG [RS:0;jenkins-hbase4:43865] zookeeper.ZKUtil(162): regionserver:43865-0x10038f668060001, quorum=127.0.0.1:61812, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43865,1675944167040 2023-02-09 12:02:48,398 DEBUG [RS:1;jenkins-hbase4:40063] zookeeper.ZKUtil(162): regionserver:40063-0x10038f668060002, quorum=127.0.0.1:61812, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43865,1675944167040 2023-02-09 12:02:48,399 DEBUG [RS:0;jenkins-hbase4:43865] zookeeper.ZKUtil(162): regionserver:43865-0x10038f668060001, quorum=127.0.0.1:61812, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40063,1675944167089 2023-02-09 12:02:48,399 DEBUG [RS:1;jenkins-hbase4:40063] zookeeper.ZKUtil(162): regionserver:40063-0x10038f668060002, quorum=127.0.0.1:61812, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40063,1675944167089 2023-02-09 12:02:48,407 DEBUG [PEWorker-2] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-09 12:02:48,409 DEBUG [PEWorker-2] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-09 12:02:48,412 DEBUG [RS:1;jenkins-hbase4:40063] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-09 12:02:48,412 DEBUG [RS:0;jenkins-hbase4:43865] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-09 12:02:48,414 DEBUG [PEWorker-2] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 12:02:48,415 INFO [PEWorker-2] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62562720, jitterRate=-0.06774282455444336}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-09 12:02:48,415 DEBUG [PEWorker-2] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1675944168355Initializing all the Stores at 1675944168357 (+2 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675944168358 (+1 ms)Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944168358Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675944168358Cleaning up temporary data from old regions at 1675944168404 (+46 ms)Cleaning up detritus from prior splits at 1675944168405 (+1 ms)Region opened successfully at 1675944168415 (+10 ms) 2023-02-09 12:02:48,415 DEBUG [PEWorker-2] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-09 12:02:48,415 INFO [PEWorker-2] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-09 12:02:48,416 DEBUG [PEWorker-2] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-09 12:02:48,416 DEBUG [PEWorker-2] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-09 12:02:48,416 DEBUG [PEWorker-2] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-09 12:02:48,417 INFO [PEWorker-2] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-09 12:02:48,417 DEBUG [PEWorker-2] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675944168415Disabling compacts and flushes for region at 1675944168415Disabling writes for close at 1675944168416 (+1 ms)Writing region close event to WAL at 1675944168417 (+1 ms)Closed at 1675944168417 2023-02-09 12:02:48,423 DEBUG [PEWorker-2] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-09 12:02:48,424 INFO [PEWorker-2] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-09 12:02:48,424 INFO [RS:1;jenkins-hbase4:40063] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-09 12:02:48,424 INFO [RS:0;jenkins-hbase4:43865] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-09 12:02:48,435 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-09 12:02:48,448 INFO [RS:1;jenkins-hbase4:40063] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-09 12:02:48,448 INFO [RS:0;jenkins-hbase4:43865] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-09 12:02:48,453 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-09 12:02:48,455 INFO [RS:0;jenkins-hbase4:43865] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 12:02:48,455 INFO [RS:1;jenkins-hbase4:40063] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 12:02:48,455 INFO [RS:0;jenkins-hbase4:43865] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 12:02:48,455 INFO [RS:1;jenkins-hbase4:40063] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 12:02:48,456 INFO [RS:0;jenkins-hbase4:43865] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-09 12:02:48,456 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-09 12:02:48,460 INFO [RS:1;jenkins-hbase4:40063] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-09 12:02:48,469 INFO [RS:0;jenkins-hbase4:43865] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-09 12:02:48,469 INFO [RS:1;jenkins-hbase4:40063] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-09 12:02:48,469 DEBUG [RS:1;jenkins-hbase4:40063] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:02:48,469 DEBUG [RS:0;jenkins-hbase4:43865] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:02:48,470 DEBUG [RS:1;jenkins-hbase4:40063] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:02:48,470 DEBUG [RS:0;jenkins-hbase4:43865] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:02:48,470 DEBUG [RS:1;jenkins-hbase4:40063] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:02:48,470 DEBUG [RS:0;jenkins-hbase4:43865] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:02:48,470 DEBUG [RS:1;jenkins-hbase4:40063] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:02:48,470 DEBUG [RS:0;jenkins-hbase4:43865] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:02:48,471 DEBUG [RS:1;jenkins-hbase4:40063] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:02:48,471 DEBUG [RS:0;jenkins-hbase4:43865] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:02:48,471 DEBUG [RS:1;jenkins-hbase4:40063] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 12:02:48,471 DEBUG [RS:0;jenkins-hbase4:43865] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 12:02:48,471 DEBUG [RS:1;jenkins-hbase4:40063] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:02:48,471 DEBUG [RS:0;jenkins-hbase4:43865] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:02:48,471 DEBUG [RS:1;jenkins-hbase4:40063] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:02:48,471 DEBUG [RS:0;jenkins-hbase4:43865] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:02:48,471 DEBUG [RS:1;jenkins-hbase4:40063] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:02:48,471 DEBUG [RS:0;jenkins-hbase4:43865] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:02:48,471 DEBUG [RS:1;jenkins-hbase4:40063] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:02:48,471 DEBUG [RS:0;jenkins-hbase4:43865] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:02:48,476 INFO [RS:0;jenkins-hbase4:43865] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 12:02:48,476 INFO [RS:1;jenkins-hbase4:40063] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 12:02:48,476 INFO [RS:0;jenkins-hbase4:43865] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 12:02:48,476 INFO [RS:1;jenkins-hbase4:40063] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 12:02:48,476 INFO [RS:0;jenkins-hbase4:43865] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-09 12:02:48,476 INFO [RS:1;jenkins-hbase4:40063] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-09 12:02:48,497 INFO [RS:0;jenkins-hbase4:43865] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-09 12:02:48,497 INFO [RS:1;jenkins-hbase4:40063] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-09 12:02:48,501 INFO [RS:1;jenkins-hbase4:40063] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40063,1675944167089-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 12:02:48,501 INFO [RS:0;jenkins-hbase4:43865] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43865,1675944167040-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 12:02:48,525 INFO [RS:0;jenkins-hbase4:43865] regionserver.Replication(203): jenkins-hbase4.apache.org,43865,1675944167040 started 2023-02-09 12:02:48,525 INFO [RS:1;jenkins-hbase4:40063] regionserver.Replication(203): jenkins-hbase4.apache.org,40063,1675944167089 started 2023-02-09 12:02:48,525 INFO [RS:0;jenkins-hbase4:43865] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,43865,1675944167040, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:43865, sessionid=0x10038f668060001 2023-02-09 12:02:48,525 INFO [RS:1;jenkins-hbase4:40063] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,40063,1675944167089, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40063, sessionid=0x10038f668060002 2023-02-09 12:02:48,526 DEBUG [RS:1;jenkins-hbase4:40063] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-09 12:02:48,526 DEBUG [RS:0;jenkins-hbase4:43865] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-09 12:02:48,526 DEBUG [RS:1;jenkins-hbase4:40063] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40063,1675944167089 2023-02-09 12:02:48,526 DEBUG [RS:0;jenkins-hbase4:43865] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,43865,1675944167040 2023-02-09 12:02:48,526 DEBUG [RS:1;jenkins-hbase4:40063] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40063,1675944167089' 2023-02-09 12:02:48,526 DEBUG [RS:0;jenkins-hbase4:43865] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43865,1675944167040' 2023-02-09 12:02:48,527 DEBUG [RS:0;jenkins-hbase4:43865] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 12:02:48,527 DEBUG [RS:1;jenkins-hbase4:40063] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 12:02:48,528 DEBUG [RS:1;jenkins-hbase4:40063] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 12:02:48,528 DEBUG [RS:0;jenkins-hbase4:43865] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 12:02:48,528 DEBUG [RS:1;jenkins-hbase4:40063] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-09 12:02:48,528 DEBUG [RS:0;jenkins-hbase4:43865] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-09 12:02:48,529 DEBUG [RS:1;jenkins-hbase4:40063] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-09 12:02:48,529 DEBUG [RS:0;jenkins-hbase4:43865] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-09 12:02:48,529 DEBUG [RS:1;jenkins-hbase4:40063] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40063,1675944167089 2023-02-09 12:02:48,529 DEBUG [RS:0;jenkins-hbase4:43865] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,43865,1675944167040 2023-02-09 12:02:48,529 DEBUG [RS:1;jenkins-hbase4:40063] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40063,1675944167089' 2023-02-09 12:02:48,529 DEBUG [RS:1;jenkins-hbase4:40063] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 12:02:48,529 DEBUG [RS:0;jenkins-hbase4:43865] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43865,1675944167040' 2023-02-09 12:02:48,530 DEBUG [RS:0;jenkins-hbase4:43865] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 12:02:48,530 DEBUG [RS:1;jenkins-hbase4:40063] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 12:02:48,530 DEBUG [RS:0;jenkins-hbase4:43865] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 12:02:48,531 DEBUG [RS:0;jenkins-hbase4:43865] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-09 12:02:48,531 DEBUG [RS:1;jenkins-hbase4:40063] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-09 12:02:48,531 INFO [RS:0;jenkins-hbase4:43865] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-09 12:02:48,531 INFO [RS:1;jenkins-hbase4:40063] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-09 12:02:48,531 INFO [RS:0;jenkins-hbase4:43865] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-09 12:02:48,531 INFO [RS:1;jenkins-hbase4:40063] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-09 12:02:48,612 DEBUG [jenkins-hbase4:32779] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-09 12:02:48,616 DEBUG [jenkins-hbase4:32779] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 12:02:48,622 DEBUG [jenkins-hbase4:32779] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 12:02:48,623 DEBUG [jenkins-hbase4:32779] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 12:02:48,623 DEBUG [jenkins-hbase4:32779] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 12:02:48,626 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,43865,1675944167040, state=OPENING 2023-02-09 12:02:48,633 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-09 12:02:48,635 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 12:02:48,636 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-09 12:02:48,639 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,43865,1675944167040}] 2023-02-09 12:02:48,826 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,43865,1675944167040 2023-02-09 12:02:48,828 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-09 12:02:48,832 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52082, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-09 12:02:48,845 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-09 12:02:48,845 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 12:02:48,848 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43865%2C1675944167040.meta, suffix=.meta, logDir=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/WALs/jenkins-hbase4.apache.org,43865,1675944167040, archiveDir=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/oldWALs, maxLogs=32 2023-02-09 12:02:48,872 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46507,DS-6403bbd9-0c0f-4f2d-81bb-c54ec159d933,DISK] 2023-02-09 12:02:48,872 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35953,DS-49df6b6b-a5ab-4581-a51f-6811d03ab4eb,DISK] 2023-02-09 12:02:48,876 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/WALs/jenkins-hbase4.apache.org,43865,1675944167040/jenkins-hbase4.apache.org%2C43865%2C1675944167040.meta.1675944168853.meta 2023-02-09 12:02:48,876 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35953,DS-49df6b6b-a5ab-4581-a51f-6811d03ab4eb,DISK], DatanodeInfoWithStorage[127.0.0.1:46507,DS-6403bbd9-0c0f-4f2d-81bb-c54ec159d933,DISK]] 2023-02-09 12:02:48,876 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-09 12:02:48,878 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-09 12:02:48,895 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-09 12:02:48,900 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-09 12:02:48,906 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-09 12:02:48,906 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:02:48,906 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-09 12:02:48,906 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-09 12:02:48,909 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-09 12:02:48,911 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/hbase/meta/1588230740/info 2023-02-09 12:02:48,911 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/hbase/meta/1588230740/info 2023-02-09 12:02:48,912 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-09 12:02:48,913 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:02:48,913 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-09 12:02:48,915 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/hbase/meta/1588230740/rep_barrier 2023-02-09 12:02:48,915 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/hbase/meta/1588230740/rep_barrier 2023-02-09 12:02:48,915 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-09 12:02:48,916 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:02:48,916 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-09 12:02:48,918 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/hbase/meta/1588230740/table 2023-02-09 12:02:48,918 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/hbase/meta/1588230740/table 2023-02-09 12:02:48,919 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-09 12:02:48,920 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:02:48,922 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/hbase/meta/1588230740 2023-02-09 12:02:48,926 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/hbase/meta/1588230740 2023-02-09 12:02:48,930 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-09 12:02:48,934 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-09 12:02:48,936 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70343665, jitterRate=0.04820229113101959}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-09 12:02:48,936 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1675944168907Writing region info on filesystem at 1675944168907Initializing all the Stores at 1675944168909 (+2 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675944168909Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944168909Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675944168909Cleaning up temporary data from old regions at 1675944168928 (+19 ms)Cleaning up detritus from prior splits at 1675944168929 (+1 ms)Running coprocessor post-open hooks at 1675944168936 (+7 ms)Region opened successfully at 1675944168936 2023-02-09 12:02:48,949 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1675944168818 2023-02-09 12:02:48,968 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-09 12:02:48,969 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-09 12:02:48,969 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,43865,1675944167040, state=OPEN 2023-02-09 12:02:48,972 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-09 12:02:48,972 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-09 12:02:48,977 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-09 12:02:48,977 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,43865,1675944167040 in 333 msec 2023-02-09 12:02:48,982 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-09 12:02:48,982 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 543 msec 2023-02-09 12:02:48,987 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 877 msec 2023-02-09 12:02:48,987 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1675944167147, completionTime=-1 2023-02-09 12:02:48,987 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-09 12:02:48,988 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-09 12:02:49,068 DEBUG [hconnection-0x240aa20b-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 12:02:49,071 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52092, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 12:02:49,089 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-09 12:02:49,089 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1675944229089 2023-02-09 12:02:49,089 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1675944289089 2023-02-09 12:02:49,090 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 102 msec 2023-02-09 12:02:49,119 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,32779,1675944165832-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 12:02:49,119 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,32779,1675944165832-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 12:02:49,119 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,32779,1675944165832-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 12:02:49,121 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:32779, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 12:02:49,122 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-09 12:02:49,128 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-09 12:02:49,137 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-09 12:02:49,138 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-09 12:02:49,148 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-09 12:02:49,151 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 12:02:49,154 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 12:02:49,176 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/hbase/namespace/e958df22f036975dc576dac705f19f5e 2023-02-09 12:02:49,179 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/hbase/namespace/e958df22f036975dc576dac705f19f5e empty. 2023-02-09 12:02:49,179 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/hbase/namespace/e958df22f036975dc576dac705f19f5e 2023-02-09 12:02:49,180 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-09 12:02:49,208 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-09 12:02:49,211 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => e958df22f036975dc576dac705f19f5e, NAME => 'hbase:namespace,,1675944169138.e958df22f036975dc576dac705f19f5e.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp 2023-02-09 12:02:49,230 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675944169138.e958df22f036975dc576dac705f19f5e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:02:49,230 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing e958df22f036975dc576dac705f19f5e, disabling compactions & flushes 2023-02-09 12:02:49,230 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675944169138.e958df22f036975dc576dac705f19f5e. 2023-02-09 12:02:49,230 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675944169138.e958df22f036975dc576dac705f19f5e. 2023-02-09 12:02:49,230 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675944169138.e958df22f036975dc576dac705f19f5e. after waiting 0 ms 2023-02-09 12:02:49,230 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675944169138.e958df22f036975dc576dac705f19f5e. 2023-02-09 12:02:49,230 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675944169138.e958df22f036975dc576dac705f19f5e. 2023-02-09 12:02:49,230 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for e958df22f036975dc576dac705f19f5e: Waiting for close lock at 1675944169230Disabling compacts and flushes for region at 1675944169230Disabling writes for close at 1675944169230Writing region close event to WAL at 1675944169230Closed at 1675944169230 2023-02-09 12:02:49,235 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 12:02:49,251 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1675944169138.e958df22f036975dc576dac705f19f5e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675944169239"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675944169239"}]},"ts":"1675944169239"} 2023-02-09 12:02:49,283 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-09 12:02:49,285 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 12:02:49,290 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675944169285"}]},"ts":"1675944169285"} 2023-02-09 12:02:49,295 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-09 12:02:49,300 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 12:02:49,301 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 12:02:49,301 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 12:02:49,301 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 12:02:49,305 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=e958df22f036975dc576dac705f19f5e, ASSIGN}] 2023-02-09 12:02:49,310 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=e958df22f036975dc576dac705f19f5e, ASSIGN 2023-02-09 12:02:49,314 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=e958df22f036975dc576dac705f19f5e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40063,1675944167089; forceNewPlan=false, retain=false 2023-02-09 12:02:49,466 INFO [jenkins-hbase4:32779] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-09 12:02:49,467 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=e958df22f036975dc576dac705f19f5e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40063,1675944167089 2023-02-09 12:02:49,467 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1675944169138.e958df22f036975dc576dac705f19f5e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675944169467"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675944169467"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675944169467"}]},"ts":"1675944169467"} 2023-02-09 12:02:49,473 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure e958df22f036975dc576dac705f19f5e, server=jenkins-hbase4.apache.org,40063,1675944167089}] 2023-02-09 12:02:49,543 INFO [RS:1;jenkins-hbase4:40063] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40063%2C1675944167089, suffix=, logDir=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/WALs/jenkins-hbase4.apache.org,40063,1675944167089, archiveDir=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/oldWALs, maxLogs=32 2023-02-09 12:02:49,543 INFO [RS:0;jenkins-hbase4:43865] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43865%2C1675944167040, suffix=, logDir=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/WALs/jenkins-hbase4.apache.org,43865,1675944167040, archiveDir=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/oldWALs, maxLogs=32 2023-02-09 12:02:49,572 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35953,DS-49df6b6b-a5ab-4581-a51f-6811d03ab4eb,DISK] 2023-02-09 12:02:49,573 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46507,DS-6403bbd9-0c0f-4f2d-81bb-c54ec159d933,DISK] 2023-02-09 12:02:49,573 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46507,DS-6403bbd9-0c0f-4f2d-81bb-c54ec159d933,DISK] 2023-02-09 12:02:49,574 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35953,DS-49df6b6b-a5ab-4581-a51f-6811d03ab4eb,DISK] 2023-02-09 12:02:49,591 INFO [RS:1;jenkins-hbase4:40063] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/WALs/jenkins-hbase4.apache.org,40063,1675944167089/jenkins-hbase4.apache.org%2C40063%2C1675944167089.1675944169545 2023-02-09 12:02:49,591 DEBUG [RS:1;jenkins-hbase4:40063] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46507,DS-6403bbd9-0c0f-4f2d-81bb-c54ec159d933,DISK], DatanodeInfoWithStorage[127.0.0.1:35953,DS-49df6b6b-a5ab-4581-a51f-6811d03ab4eb,DISK]] 2023-02-09 12:02:49,592 INFO [RS:0;jenkins-hbase4:43865] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/WALs/jenkins-hbase4.apache.org,43865,1675944167040/jenkins-hbase4.apache.org%2C43865%2C1675944167040.1675944169546 2023-02-09 12:02:49,593 DEBUG [RS:0;jenkins-hbase4:43865] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35953,DS-49df6b6b-a5ab-4581-a51f-6811d03ab4eb,DISK], DatanodeInfoWithStorage[127.0.0.1:46507,DS-6403bbd9-0c0f-4f2d-81bb-c54ec159d933,DISK]] 2023-02-09 12:02:49,630 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,40063,1675944167089 2023-02-09 12:02:49,631 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-09 12:02:49,633 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49054, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-09 12:02:49,640 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1675944169138.e958df22f036975dc576dac705f19f5e. 2023-02-09 12:02:49,641 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e958df22f036975dc576dac705f19f5e, NAME => 'hbase:namespace,,1675944169138.e958df22f036975dc576dac705f19f5e.', STARTKEY => '', ENDKEY => ''} 2023-02-09 12:02:49,642 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace e958df22f036975dc576dac705f19f5e 2023-02-09 12:02:49,642 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675944169138.e958df22f036975dc576dac705f19f5e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:02:49,642 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for e958df22f036975dc576dac705f19f5e 2023-02-09 12:02:49,642 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for e958df22f036975dc576dac705f19f5e 2023-02-09 12:02:49,644 INFO [StoreOpener-e958df22f036975dc576dac705f19f5e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region e958df22f036975dc576dac705f19f5e 2023-02-09 12:02:49,647 DEBUG [StoreOpener-e958df22f036975dc576dac705f19f5e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/hbase/namespace/e958df22f036975dc576dac705f19f5e/info 2023-02-09 12:02:49,647 DEBUG [StoreOpener-e958df22f036975dc576dac705f19f5e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/hbase/namespace/e958df22f036975dc576dac705f19f5e/info 2023-02-09 12:02:49,648 INFO [StoreOpener-e958df22f036975dc576dac705f19f5e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e958df22f036975dc576dac705f19f5e columnFamilyName info 2023-02-09 12:02:49,649 INFO [StoreOpener-e958df22f036975dc576dac705f19f5e-1] regionserver.HStore(310): Store=e958df22f036975dc576dac705f19f5e/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:02:49,651 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/hbase/namespace/e958df22f036975dc576dac705f19f5e 2023-02-09 12:02:49,652 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/hbase/namespace/e958df22f036975dc576dac705f19f5e 2023-02-09 12:02:49,657 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for e958df22f036975dc576dac705f19f5e 2023-02-09 12:02:49,661 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/hbase/namespace/e958df22f036975dc576dac705f19f5e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 12:02:49,662 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened e958df22f036975dc576dac705f19f5e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60578444, jitterRate=-0.09731084108352661}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 12:02:49,662 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for e958df22f036975dc576dac705f19f5e: Running coprocessor pre-open hook at 1675944169642Writing region info on filesystem at 1675944169642Initializing all the Stores at 1675944169644 (+2 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675944169644Cleaning up temporary data from old regions at 1675944169652 (+8 ms)Cleaning up detritus from prior splits at 1675944169653 (+1 ms)Running coprocessor post-open hooks at 1675944169662 (+9 ms)Region opened successfully at 1675944169662 2023-02-09 12:02:49,667 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1675944169138.e958df22f036975dc576dac705f19f5e., pid=6, masterSystemTime=1675944169630 2023-02-09 12:02:49,673 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1675944169138.e958df22f036975dc576dac705f19f5e. 2023-02-09 12:02:49,673 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1675944169138.e958df22f036975dc576dac705f19f5e. 2023-02-09 12:02:49,675 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=e958df22f036975dc576dac705f19f5e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40063,1675944167089 2023-02-09 12:02:49,675 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1675944169138.e958df22f036975dc576dac705f19f5e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675944169674"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675944169674"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675944169674"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675944169674"}]},"ts":"1675944169674"} 2023-02-09 12:02:49,685 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-09 12:02:49,685 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure e958df22f036975dc576dac705f19f5e, server=jenkins-hbase4.apache.org,40063,1675944167089 in 209 msec 2023-02-09 12:02:49,689 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-09 12:02:49,690 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=e958df22f036975dc576dac705f19f5e, ASSIGN in 380 msec 2023-02-09 12:02:49,691 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 12:02:49,692 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675944169691"}]},"ts":"1675944169691"} 2023-02-09 12:02:49,696 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-09 12:02:49,700 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 12:02:49,703 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 561 msec 2023-02-09 12:02:49,752 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-09 12:02:49,753 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-09 12:02:49,753 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 12:02:49,782 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 12:02:49,784 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49064, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 12:02:49,802 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-09 12:02:49,826 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-09 12:02:49,832 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 40 msec 2023-02-09 12:02:49,836 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-09 12:02:49,849 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-09 12:02:49,855 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 18 msec 2023-02-09 12:02:49,863 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-09 12:02:49,867 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-09 12:02:49,867 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 2.710sec 2023-02-09 12:02:49,870 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-09 12:02:49,871 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-09 12:02:49,872 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-09 12:02:49,873 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,32779,1675944165832-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-09 12:02:49,874 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,32779,1675944165832-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-09 12:02:49,885 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-09 12:02:49,927 DEBUG [Listener at localhost/43097] zookeeper.ReadOnlyZKClient(139): Connect 0x0ac00ad9 to 127.0.0.1:61812 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 12:02:49,932 DEBUG [Listener at localhost/43097] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@35291aba, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 12:02:49,976 DEBUG [hconnection-0x3128be3e-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 12:02:49,988 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52102, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 12:02:49,999 INFO [Listener at localhost/43097] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,32779,1675944165832 2023-02-09 12:02:49,999 DEBUG [Listener at localhost/43097] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-09 12:02:50,001 INFO [Listener at localhost/43097] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:02:50,001 INFO [Listener at localhost/43097] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:02:50,009 DEBUG [Listener at localhost/43097] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-09 12:02:50,012 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60498, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-09 12:02:50,017 INFO [Listener at localhost/43097] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-09 12:02:50,022 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32779] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-09 12:02:50,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32779] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-09 12:02:50,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32779] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 77 connection: 172.31.14.131:60498 deadline: 1675944230021, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-09 12:02:50,040 INFO [Listener at localhost/43097] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-09 12:02:50,042 INFO [Listener at localhost/43097] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:02:50,042 INFO [Listener at localhost/43097] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:02:50,055 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32779] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-09 12:02:50,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32779] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-09 12:02:50,061 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 12:02:50,063 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 12:02:50,066 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32779] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-09 12:02:50,075 INFO [Listener at localhost/43097] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:02:50,075 INFO [Listener at localhost/43097] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:02:50,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32779] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 12:02:50,088 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/e512e42931aafc627ee7181cbf9052ca 2023-02-09 12:02:50,088 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/f19add4d5d04210e250b8c75220e32c6 2023-02-09 12:02:50,088 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/4a3fbf78e913c39c9306810357f4e73f 2023-02-09 12:02:50,088 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/05dd22401f19bc665866ffe134bc07ee 2023-02-09 12:02:50,088 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/6a2f68f435ddf37944e60450e130d0c8 2023-02-09 12:02:50,088 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/02975433f68555b44244543d329054e2 2023-02-09 12:02:50,088 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/f1f03c1ee1ed10fc02a07432990a8ea4 2023-02-09 12:02:50,089 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/75beec9f46c90b3722fafa385b8aee48 2023-02-09 12:02:50,090 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/e512e42931aafc627ee7181cbf9052ca empty. 2023-02-09 12:02:50,090 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/f19add4d5d04210e250b8c75220e32c6 empty. 2023-02-09 12:02:50,090 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/4a3fbf78e913c39c9306810357f4e73f empty. 2023-02-09 12:02:50,090 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/75beec9f46c90b3722fafa385b8aee48 empty. 2023-02-09 12:02:50,090 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/6a2f68f435ddf37944e60450e130d0c8 empty. 2023-02-09 12:02:50,090 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/05dd22401f19bc665866ffe134bc07ee empty. 2023-02-09 12:02:50,090 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/f1f03c1ee1ed10fc02a07432990a8ea4 empty. 2023-02-09 12:02:50,090 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/02975433f68555b44244543d329054e2 empty. 2023-02-09 12:02:50,092 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/e512e42931aafc627ee7181cbf9052ca 2023-02-09 12:02:50,093 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/4a3fbf78e913c39c9306810357f4e73f 2023-02-09 12:02:50,093 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/05dd22401f19bc665866ffe134bc07ee 2023-02-09 12:02:50,093 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/65a3da3364c26109bbe03b4e408b5d95 2023-02-09 12:02:50,093 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/f1f03c1ee1ed10fc02a07432990a8ea4 2023-02-09 12:02:50,093 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/6a2f68f435ddf37944e60450e130d0c8 2023-02-09 12:02:50,093 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/adba5c7dd8af5a32d17e2e2d2835e54e 2023-02-09 12:02:50,093 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/75beec9f46c90b3722fafa385b8aee48 2023-02-09 12:02:50,093 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/f19add4d5d04210e250b8c75220e32c6 2023-02-09 12:02:50,093 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/02975433f68555b44244543d329054e2 2023-02-09 12:02:50,094 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/65a3da3364c26109bbe03b4e408b5d95 empty. 2023-02-09 12:02:50,094 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/adba5c7dd8af5a32d17e2e2d2835e54e empty. 2023-02-09 12:02:50,094 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/65a3da3364c26109bbe03b4e408b5d95 2023-02-09 12:02:50,095 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/adba5c7dd8af5a32d17e2e2d2835e54e 2023-02-09 12:02:50,095 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-09 12:02:50,115 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-09 12:02:50,117 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => e512e42931aafc627ee7181cbf9052ca, NAME => 'testWithMapReduce,,1675944170049.e512e42931aafc627ee7181cbf9052ca.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp 2023-02-09 12:02:50,118 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 4a3fbf78e913c39c9306810357f4e73f, NAME => 'testWithMapReduce,d\x84\x84,1675944170049.4a3fbf78e913c39c9306810357f4e73f.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp 2023-02-09 12:02:50,118 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => f19add4d5d04210e250b8c75220e32c6, NAME => 'testWithMapReduce,aaa,1675944170049.f19add4d5d04210e250b8c75220e32c6.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp 2023-02-09 12:02:50,165 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1675944170049.f19add4d5d04210e250b8c75220e32c6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:02:50,165 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing f19add4d5d04210e250b8c75220e32c6, disabling compactions & flushes 2023-02-09 12:02:50,165 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1675944170049.f19add4d5d04210e250b8c75220e32c6. 2023-02-09 12:02:50,166 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1675944170049.f19add4d5d04210e250b8c75220e32c6. 2023-02-09 12:02:50,166 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1675944170049.f19add4d5d04210e250b8c75220e32c6. after waiting 0 ms 2023-02-09 12:02:50,166 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1675944170049.f19add4d5d04210e250b8c75220e32c6. 2023-02-09 12:02:50,166 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1675944170049.f19add4d5d04210e250b8c75220e32c6. 2023-02-09 12:02:50,166 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for f19add4d5d04210e250b8c75220e32c6: Waiting for close lock at 1675944170165Disabling compacts and flushes for region at 1675944170165Disabling writes for close at 1675944170166 (+1 ms)Writing region close event to WAL at 1675944170166Closed at 1675944170166 2023-02-09 12:02:50,166 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 6a2f68f435ddf37944e60450e130d0c8, NAME => 'testWithMapReduce,g\xA7\xA7,1675944170049.6a2f68f435ddf37944e60450e130d0c8.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp 2023-02-09 12:02:50,168 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1675944170049.4a3fbf78e913c39c9306810357f4e73f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:02:50,168 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 4a3fbf78e913c39c9306810357f4e73f, disabling compactions & flushes 2023-02-09 12:02:50,168 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1675944170049.4a3fbf78e913c39c9306810357f4e73f. 2023-02-09 12:02:50,168 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1675944170049.4a3fbf78e913c39c9306810357f4e73f. 2023-02-09 12:02:50,168 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1675944170049.4a3fbf78e913c39c9306810357f4e73f. after waiting 0 ms 2023-02-09 12:02:50,168 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1675944170049.4a3fbf78e913c39c9306810357f4e73f. 2023-02-09 12:02:50,168 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1675944170049.4a3fbf78e913c39c9306810357f4e73f. 2023-02-09 12:02:50,168 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 4a3fbf78e913c39c9306810357f4e73f: Waiting for close lock at 1675944170168Disabling compacts and flushes for region at 1675944170168Disabling writes for close at 1675944170168Writing region close event to WAL at 1675944170168Closed at 1675944170168 2023-02-09 12:02:50,169 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 05dd22401f19bc665866ffe134bc07ee, NAME => 'testWithMapReduce,j\xCA\xCA,1675944170049.05dd22401f19bc665866ffe134bc07ee.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp 2023-02-09 12:02:50,187 INFO [Listener at localhost/43097] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:02:50,191 INFO [Listener at localhost/43097] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:02:50,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32779] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 12:02:50,199 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1675944170049.6a2f68f435ddf37944e60450e130d0c8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:02:50,200 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 6a2f68f435ddf37944e60450e130d0c8, disabling compactions & flushes 2023-02-09 12:02:50,200 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1675944170049.6a2f68f435ddf37944e60450e130d0c8. 2023-02-09 12:02:50,200 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1675944170049.6a2f68f435ddf37944e60450e130d0c8. 2023-02-09 12:02:50,200 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1675944170049.6a2f68f435ddf37944e60450e130d0c8. after waiting 0 ms 2023-02-09 12:02:50,200 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1675944170049.6a2f68f435ddf37944e60450e130d0c8. 2023-02-09 12:02:50,200 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1675944170049.6a2f68f435ddf37944e60450e130d0c8. 2023-02-09 12:02:50,200 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 6a2f68f435ddf37944e60450e130d0c8: Waiting for close lock at 1675944170200Disabling compacts and flushes for region at 1675944170200Disabling writes for close at 1675944170200Writing region close event to WAL at 1675944170200Closed at 1675944170200 2023-02-09 12:02:50,201 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 02975433f68555b44244543d329054e2, NAME => 'testWithMapReduce,m\xED\xED,1675944170049.02975433f68555b44244543d329054e2.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp 2023-02-09 12:02:50,201 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1675944170049.05dd22401f19bc665866ffe134bc07ee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:02:50,202 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 05dd22401f19bc665866ffe134bc07ee, disabling compactions & flushes 2023-02-09 12:02:50,202 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1675944170049.05dd22401f19bc665866ffe134bc07ee. 2023-02-09 12:02:50,202 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1675944170049.05dd22401f19bc665866ffe134bc07ee. 2023-02-09 12:02:50,202 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1675944170049.05dd22401f19bc665866ffe134bc07ee. after waiting 0 ms 2023-02-09 12:02:50,202 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1675944170049.05dd22401f19bc665866ffe134bc07ee. 2023-02-09 12:02:50,202 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1675944170049.05dd22401f19bc665866ffe134bc07ee. 2023-02-09 12:02:50,202 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 05dd22401f19bc665866ffe134bc07ee: Waiting for close lock at 1675944170202Disabling compacts and flushes for region at 1675944170202Disabling writes for close at 1675944170202Writing region close event to WAL at 1675944170202Closed at 1675944170202 2023-02-09 12:02:50,203 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 75beec9f46c90b3722fafa385b8aee48, NAME => 'testWithMapReduce,q\x11\x10,1675944170049.75beec9f46c90b3722fafa385b8aee48.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp 2023-02-09 12:02:50,226 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1675944170049.02975433f68555b44244543d329054e2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:02:50,227 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 02975433f68555b44244543d329054e2, disabling compactions & flushes 2023-02-09 12:02:50,227 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1675944170049.02975433f68555b44244543d329054e2. 2023-02-09 12:02:50,227 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1675944170049.02975433f68555b44244543d329054e2. 2023-02-09 12:02:50,227 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1675944170049.02975433f68555b44244543d329054e2. after waiting 0 ms 2023-02-09 12:02:50,227 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1675944170049.02975433f68555b44244543d329054e2. 2023-02-09 12:02:50,227 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1675944170049.02975433f68555b44244543d329054e2. 2023-02-09 12:02:50,227 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 02975433f68555b44244543d329054e2: Waiting for close lock at 1675944170227Disabling compacts and flushes for region at 1675944170227Disabling writes for close at 1675944170227Writing region close event to WAL at 1675944170227Closed at 1675944170227 2023-02-09 12:02:50,228 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => f1f03c1ee1ed10fc02a07432990a8ea4, NAME => 'testWithMapReduce,t43,1675944170049.f1f03c1ee1ed10fc02a07432990a8ea4.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp 2023-02-09 12:02:50,228 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1675944170049.75beec9f46c90b3722fafa385b8aee48.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:02:50,229 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 75beec9f46c90b3722fafa385b8aee48, disabling compactions & flushes 2023-02-09 12:02:50,229 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1675944170049.75beec9f46c90b3722fafa385b8aee48. 2023-02-09 12:02:50,229 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1675944170049.75beec9f46c90b3722fafa385b8aee48. 2023-02-09 12:02:50,229 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1675944170049.75beec9f46c90b3722fafa385b8aee48. after waiting 0 ms 2023-02-09 12:02:50,229 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1675944170049.75beec9f46c90b3722fafa385b8aee48. 2023-02-09 12:02:50,229 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1675944170049.75beec9f46c90b3722fafa385b8aee48. 2023-02-09 12:02:50,229 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 75beec9f46c90b3722fafa385b8aee48: Waiting for close lock at 1675944170229Disabling compacts and flushes for region at 1675944170229Disabling writes for close at 1675944170229Writing region close event to WAL at 1675944170229Closed at 1675944170229 2023-02-09 12:02:50,230 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => adba5c7dd8af5a32d17e2e2d2835e54e, NAME => 'testWithMapReduce,wWV,1675944170049.adba5c7dd8af5a32d17e2e2d2835e54e.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp 2023-02-09 12:02:50,251 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1675944170049.f1f03c1ee1ed10fc02a07432990a8ea4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:02:50,251 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing f1f03c1ee1ed10fc02a07432990a8ea4, disabling compactions & flushes 2023-02-09 12:02:50,251 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1675944170049.adba5c7dd8af5a32d17e2e2d2835e54e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:02:50,251 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1675944170049.f1f03c1ee1ed10fc02a07432990a8ea4. 2023-02-09 12:02:50,252 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1675944170049.f1f03c1ee1ed10fc02a07432990a8ea4. 2023-02-09 12:02:50,252 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1675944170049.f1f03c1ee1ed10fc02a07432990a8ea4. after waiting 0 ms 2023-02-09 12:02:50,252 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1675944170049.f1f03c1ee1ed10fc02a07432990a8ea4. 2023-02-09 12:02:50,252 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1675944170049.f1f03c1ee1ed10fc02a07432990a8ea4. 2023-02-09 12:02:50,252 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for f1f03c1ee1ed10fc02a07432990a8ea4: Waiting for close lock at 1675944170251Disabling compacts and flushes for region at 1675944170251Disabling writes for close at 1675944170252 (+1 ms)Writing region close event to WAL at 1675944170252Closed at 1675944170252 2023-02-09 12:02:50,252 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing adba5c7dd8af5a32d17e2e2d2835e54e, disabling compactions & flushes 2023-02-09 12:02:50,252 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1675944170049.adba5c7dd8af5a32d17e2e2d2835e54e. 2023-02-09 12:02:50,252 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1675944170049.adba5c7dd8af5a32d17e2e2d2835e54e. 2023-02-09 12:02:50,252 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 65a3da3364c26109bbe03b4e408b5d95, NAME => 'testWithMapReduce,zz{,1675944170049.65a3da3364c26109bbe03b4e408b5d95.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp 2023-02-09 12:02:50,252 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1675944170049.adba5c7dd8af5a32d17e2e2d2835e54e. after waiting 0 ms 2023-02-09 12:02:50,252 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1675944170049.adba5c7dd8af5a32d17e2e2d2835e54e. 2023-02-09 12:02:50,252 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1675944170049.adba5c7dd8af5a32d17e2e2d2835e54e. 2023-02-09 12:02:50,253 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for adba5c7dd8af5a32d17e2e2d2835e54e: Waiting for close lock at 1675944170252Disabling compacts and flushes for region at 1675944170252Disabling writes for close at 1675944170252Writing region close event to WAL at 1675944170252Closed at 1675944170252 2023-02-09 12:02:50,265 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1675944170049.65a3da3364c26109bbe03b4e408b5d95.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:02:50,265 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 65a3da3364c26109bbe03b4e408b5d95, disabling compactions & flushes 2023-02-09 12:02:50,265 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1675944170049.65a3da3364c26109bbe03b4e408b5d95. 2023-02-09 12:02:50,265 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1675944170049.65a3da3364c26109bbe03b4e408b5d95. 2023-02-09 12:02:50,265 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1675944170049.65a3da3364c26109bbe03b4e408b5d95. after waiting 0 ms 2023-02-09 12:02:50,265 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1675944170049.65a3da3364c26109bbe03b4e408b5d95. 2023-02-09 12:02:50,265 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1675944170049.65a3da3364c26109bbe03b4e408b5d95. 2023-02-09 12:02:50,266 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 65a3da3364c26109bbe03b4e408b5d95: Waiting for close lock at 1675944170265Disabling compacts and flushes for region at 1675944170265Disabling writes for close at 1675944170265Writing region close event to WAL at 1675944170265Closed at 1675944170265 2023-02-09 12:02:50,399 INFO [Listener at localhost/43097] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:02:50,400 INFO [Listener at localhost/43097] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:02:50,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32779] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 12:02:50,569 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675944170049.e512e42931aafc627ee7181cbf9052ca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:02:50,570 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing e512e42931aafc627ee7181cbf9052ca, disabling compactions & flushes 2023-02-09 12:02:50,570 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675944170049.e512e42931aafc627ee7181cbf9052ca. 2023-02-09 12:02:50,570 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675944170049.e512e42931aafc627ee7181cbf9052ca. 2023-02-09 12:02:50,570 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675944170049.e512e42931aafc627ee7181cbf9052ca. after waiting 0 ms 2023-02-09 12:02:50,570 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675944170049.e512e42931aafc627ee7181cbf9052ca. 2023-02-09 12:02:50,570 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675944170049.e512e42931aafc627ee7181cbf9052ca. 2023-02-09 12:02:50,570 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for e512e42931aafc627ee7181cbf9052ca: Waiting for close lock at 1675944170569Disabling compacts and flushes for region at 1675944170569Disabling writes for close at 1675944170570 (+1 ms)Writing region close event to WAL at 1675944170570Closed at 1675944170570 2023-02-09 12:02:50,576 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 12:02:50,577 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1675944170049.f19add4d5d04210e250b8c75220e32c6.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675944170577"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675944170577"}]},"ts":"1675944170577"} 2023-02-09 12:02:50,578 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1675944170049.4a3fbf78e913c39c9306810357f4e73f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675944170577"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675944170577"}]},"ts":"1675944170577"} 2023-02-09 12:02:50,578 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1675944170049.6a2f68f435ddf37944e60450e130d0c8.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675944170577"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675944170577"}]},"ts":"1675944170577"} 2023-02-09 12:02:50,578 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1675944170049.05dd22401f19bc665866ffe134bc07ee.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675944170577"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675944170577"}]},"ts":"1675944170577"} 2023-02-09 12:02:50,578 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1675944170049.02975433f68555b44244543d329054e2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675944170577"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675944170577"}]},"ts":"1675944170577"} 2023-02-09 12:02:50,578 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1675944170049.75beec9f46c90b3722fafa385b8aee48.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675944170577"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675944170577"}]},"ts":"1675944170577"} 2023-02-09 12:02:50,578 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1675944170049.f1f03c1ee1ed10fc02a07432990a8ea4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675944170577"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675944170577"}]},"ts":"1675944170577"} 2023-02-09 12:02:50,578 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1675944170049.adba5c7dd8af5a32d17e2e2d2835e54e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675944170577"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675944170577"}]},"ts":"1675944170577"} 2023-02-09 12:02:50,579 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1675944170049.65a3da3364c26109bbe03b4e408b5d95.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675944170577"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675944170577"}]},"ts":"1675944170577"} 2023-02-09 12:02:50,579 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1675944170049.e512e42931aafc627ee7181cbf9052ca.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675944170577"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675944170577"}]},"ts":"1675944170577"} 2023-02-09 12:02:50,627 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-09 12:02:50,629 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 12:02:50,629 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675944170629"}]},"ts":"1675944170629"} 2023-02-09 12:02:50,632 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-09 12:02:50,636 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 12:02:50,651 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 12:02:50,651 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 12:02:50,651 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 12:02:50,652 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e512e42931aafc627ee7181cbf9052ca, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=f19add4d5d04210e250b8c75220e32c6, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=4a3fbf78e913c39c9306810357f4e73f, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=6a2f68f435ddf37944e60450e130d0c8, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=05dd22401f19bc665866ffe134bc07ee, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=02975433f68555b44244543d329054e2, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=75beec9f46c90b3722fafa385b8aee48, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=f1f03c1ee1ed10fc02a07432990a8ea4, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=adba5c7dd8af5a32d17e2e2d2835e54e, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=65a3da3364c26109bbe03b4e408b5d95, ASSIGN}] 2023-02-09 12:02:50,656 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=f19add4d5d04210e250b8c75220e32c6, ASSIGN 2023-02-09 12:02:50,656 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e512e42931aafc627ee7181cbf9052ca, ASSIGN 2023-02-09 12:02:50,657 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=4a3fbf78e913c39c9306810357f4e73f, ASSIGN 2023-02-09 12:02:50,657 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=6a2f68f435ddf37944e60450e130d0c8, ASSIGN 2023-02-09 12:02:50,662 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=4a3fbf78e913c39c9306810357f4e73f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43865,1675944167040; forceNewPlan=false, retain=false 2023-02-09 12:02:50,662 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=e512e42931aafc627ee7181cbf9052ca, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43865,1675944167040; forceNewPlan=false, retain=false 2023-02-09 12:02:50,662 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=f19add4d5d04210e250b8c75220e32c6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40063,1675944167089; forceNewPlan=false, retain=false 2023-02-09 12:02:50,663 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=65a3da3364c26109bbe03b4e408b5d95, ASSIGN 2023-02-09 12:02:50,663 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=6a2f68f435ddf37944e60450e130d0c8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40063,1675944167089; forceNewPlan=false, retain=false 2023-02-09 12:02:50,664 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=adba5c7dd8af5a32d17e2e2d2835e54e, ASSIGN 2023-02-09 12:02:50,664 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=f1f03c1ee1ed10fc02a07432990a8ea4, ASSIGN 2023-02-09 12:02:50,665 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=75beec9f46c90b3722fafa385b8aee48, ASSIGN 2023-02-09 12:02:50,665 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=65a3da3364c26109bbe03b4e408b5d95, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40063,1675944167089; forceNewPlan=false, retain=false 2023-02-09 12:02:50,665 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=02975433f68555b44244543d329054e2, ASSIGN 2023-02-09 12:02:50,666 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=adba5c7dd8af5a32d17e2e2d2835e54e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43865,1675944167040; forceNewPlan=false, retain=false 2023-02-09 12:02:50,666 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=f1f03c1ee1ed10fc02a07432990a8ea4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40063,1675944167089; forceNewPlan=false, retain=false 2023-02-09 12:02:50,666 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=75beec9f46c90b3722fafa385b8aee48, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43865,1675944167040; forceNewPlan=false, retain=false 2023-02-09 12:02:50,667 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=05dd22401f19bc665866ffe134bc07ee, ASSIGN 2023-02-09 12:02:50,667 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=02975433f68555b44244543d329054e2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40063,1675944167089; forceNewPlan=false, retain=false 2023-02-09 12:02:50,669 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=05dd22401f19bc665866ffe134bc07ee, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43865,1675944167040; forceNewPlan=false, retain=false 2023-02-09 12:02:50,704 INFO [Listener at localhost/43097] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:02:50,704 INFO [Listener at localhost/43097] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:02:50,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32779] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 12:02:50,813 INFO [jenkins-hbase4:32779] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-09 12:02:50,816 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=e512e42931aafc627ee7181cbf9052ca, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43865,1675944167040 2023-02-09 12:02:50,816 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=4a3fbf78e913c39c9306810357f4e73f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43865,1675944167040 2023-02-09 12:02:50,816 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=75beec9f46c90b3722fafa385b8aee48, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43865,1675944167040 2023-02-09 12:02:50,816 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1675944170049.e512e42931aafc627ee7181cbf9052ca.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675944170816"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675944170816"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675944170816"}]},"ts":"1675944170816"} 2023-02-09 12:02:50,816 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=05dd22401f19bc665866ffe134bc07ee, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43865,1675944167040 2023-02-09 12:02:50,816 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1675944170049.75beec9f46c90b3722fafa385b8aee48.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675944170816"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675944170816"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675944170816"}]},"ts":"1675944170816"} 2023-02-09 12:02:50,816 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=adba5c7dd8af5a32d17e2e2d2835e54e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43865,1675944167040 2023-02-09 12:02:50,816 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1675944170049.4a3fbf78e913c39c9306810357f4e73f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675944170816"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675944170816"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675944170816"}]},"ts":"1675944170816"} 2023-02-09 12:02:50,816 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1675944170049.05dd22401f19bc665866ffe134bc07ee.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675944170816"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675944170816"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675944170816"}]},"ts":"1675944170816"} 2023-02-09 12:02:50,817 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1675944170049.adba5c7dd8af5a32d17e2e2d2835e54e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675944170816"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675944170816"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675944170816"}]},"ts":"1675944170816"} 2023-02-09 12:02:50,819 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=11, state=RUNNABLE; OpenRegionProcedure e512e42931aafc627ee7181cbf9052ca, server=jenkins-hbase4.apache.org,43865,1675944167040}] 2023-02-09 12:02:50,821 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=17, state=RUNNABLE; OpenRegionProcedure 75beec9f46c90b3722fafa385b8aee48, server=jenkins-hbase4.apache.org,43865,1675944167040}] 2023-02-09 12:02:50,823 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=13, state=RUNNABLE; OpenRegionProcedure 4a3fbf78e913c39c9306810357f4e73f, server=jenkins-hbase4.apache.org,43865,1675944167040}] 2023-02-09 12:02:50,826 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=02975433f68555b44244543d329054e2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40063,1675944167089 2023-02-09 12:02:50,826 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1675944170049.02975433f68555b44244543d329054e2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675944170826"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675944170826"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675944170826"}]},"ts":"1675944170826"} 2023-02-09 12:02:50,828 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=65a3da3364c26109bbe03b4e408b5d95, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40063,1675944167089 2023-02-09 12:02:50,829 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1675944170049.65a3da3364c26109bbe03b4e408b5d95.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675944170828"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675944170828"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675944170828"}]},"ts":"1675944170828"} 2023-02-09 12:02:50,829 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=f19add4d5d04210e250b8c75220e32c6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40063,1675944167089 2023-02-09 12:02:50,829 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=15, state=RUNNABLE; OpenRegionProcedure 05dd22401f19bc665866ffe134bc07ee, server=jenkins-hbase4.apache.org,43865,1675944167040}] 2023-02-09 12:02:50,830 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1675944170049.f19add4d5d04210e250b8c75220e32c6.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675944170829"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675944170829"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675944170829"}]},"ts":"1675944170829"} 2023-02-09 12:02:50,831 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=19, state=RUNNABLE; OpenRegionProcedure adba5c7dd8af5a32d17e2e2d2835e54e, server=jenkins-hbase4.apache.org,43865,1675944167040}] 2023-02-09 12:02:50,832 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=16, state=RUNNABLE; OpenRegionProcedure 02975433f68555b44244543d329054e2, server=jenkins-hbase4.apache.org,40063,1675944167089}] 2023-02-09 12:02:50,835 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=6a2f68f435ddf37944e60450e130d0c8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40063,1675944167089 2023-02-09 12:02:50,835 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1675944170049.6a2f68f435ddf37944e60450e130d0c8.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675944170835"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675944170835"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675944170835"}]},"ts":"1675944170835"} 2023-02-09 12:02:50,836 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=20, state=RUNNABLE; OpenRegionProcedure 65a3da3364c26109bbe03b4e408b5d95, server=jenkins-hbase4.apache.org,40063,1675944167089}] 2023-02-09 12:02:50,838 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=12, state=RUNNABLE; OpenRegionProcedure f19add4d5d04210e250b8c75220e32c6, server=jenkins-hbase4.apache.org,40063,1675944167089}] 2023-02-09 12:02:50,838 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=f1f03c1ee1ed10fc02a07432990a8ea4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40063,1675944167089 2023-02-09 12:02:50,839 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1675944170049.f1f03c1ee1ed10fc02a07432990a8ea4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675944170838"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675944170838"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675944170838"}]},"ts":"1675944170838"} 2023-02-09 12:02:50,840 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=14, state=RUNNABLE; OpenRegionProcedure 6a2f68f435ddf37944e60450e130d0c8, server=jenkins-hbase4.apache.org,40063,1675944167089}] 2023-02-09 12:02:50,841 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=18, state=RUNNABLE; OpenRegionProcedure f1f03c1ee1ed10fc02a07432990a8ea4, server=jenkins-hbase4.apache.org,40063,1675944167089}] 2023-02-09 12:02:50,980 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1675944170049.75beec9f46c90b3722fafa385b8aee48. 2023-02-09 12:02:50,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 75beec9f46c90b3722fafa385b8aee48, NAME => 'testWithMapReduce,q\x11\x10,1675944170049.75beec9f46c90b3722fafa385b8aee48.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-09 12:02:50,981 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 75beec9f46c90b3722fafa385b8aee48 2023-02-09 12:02:50,981 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1675944170049.75beec9f46c90b3722fafa385b8aee48.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:02:50,981 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 75beec9f46c90b3722fafa385b8aee48 2023-02-09 12:02:50,981 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 75beec9f46c90b3722fafa385b8aee48 2023-02-09 12:02:50,983 INFO [StoreOpener-75beec9f46c90b3722fafa385b8aee48-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 75beec9f46c90b3722fafa385b8aee48 2023-02-09 12:02:50,985 DEBUG [StoreOpener-75beec9f46c90b3722fafa385b8aee48-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/75beec9f46c90b3722fafa385b8aee48/f1 2023-02-09 12:02:50,985 DEBUG [StoreOpener-75beec9f46c90b3722fafa385b8aee48-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/75beec9f46c90b3722fafa385b8aee48/f1 2023-02-09 12:02:50,986 INFO [StoreOpener-75beec9f46c90b3722fafa385b8aee48-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 75beec9f46c90b3722fafa385b8aee48 columnFamilyName f1 2023-02-09 12:02:50,986 INFO [StoreOpener-75beec9f46c90b3722fafa385b8aee48-1] regionserver.HStore(310): Store=75beec9f46c90b3722fafa385b8aee48/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:02:50,987 INFO [StoreOpener-75beec9f46c90b3722fafa385b8aee48-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 75beec9f46c90b3722fafa385b8aee48 2023-02-09 12:02:50,989 DEBUG [StoreOpener-75beec9f46c90b3722fafa385b8aee48-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/75beec9f46c90b3722fafa385b8aee48/f2 2023-02-09 12:02:50,989 DEBUG [StoreOpener-75beec9f46c90b3722fafa385b8aee48-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/75beec9f46c90b3722fafa385b8aee48/f2 2023-02-09 12:02:50,989 INFO [StoreOpener-75beec9f46c90b3722fafa385b8aee48-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 75beec9f46c90b3722fafa385b8aee48 columnFamilyName f2 2023-02-09 12:02:50,990 INFO [StoreOpener-75beec9f46c90b3722fafa385b8aee48-1] regionserver.HStore(310): Store=75beec9f46c90b3722fafa385b8aee48/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:02:50,993 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/75beec9f46c90b3722fafa385b8aee48 2023-02-09 12:02:50,994 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/75beec9f46c90b3722fafa385b8aee48 2023-02-09 12:02:50,997 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1675944170049.65a3da3364c26109bbe03b4e408b5d95. 2023-02-09 12:02:50,997 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 65a3da3364c26109bbe03b4e408b5d95, NAME => 'testWithMapReduce,zz{,1675944170049.65a3da3364c26109bbe03b4e408b5d95.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-09 12:02:50,997 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 65a3da3364c26109bbe03b4e408b5d95 2023-02-09 12:02:50,997 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1675944170049.65a3da3364c26109bbe03b4e408b5d95.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:02:50,997 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 65a3da3364c26109bbe03b4e408b5d95 2023-02-09 12:02:50,997 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 65a3da3364c26109bbe03b4e408b5d95 2023-02-09 12:02:50,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 12:02:50,999 INFO [StoreOpener-65a3da3364c26109bbe03b4e408b5d95-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 65a3da3364c26109bbe03b4e408b5d95 2023-02-09 12:02:51,000 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 75beec9f46c90b3722fafa385b8aee48 2023-02-09 12:02:51,001 DEBUG [StoreOpener-65a3da3364c26109bbe03b4e408b5d95-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/65a3da3364c26109bbe03b4e408b5d95/f1 2023-02-09 12:02:51,001 DEBUG [StoreOpener-65a3da3364c26109bbe03b4e408b5d95-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/65a3da3364c26109bbe03b4e408b5d95/f1 2023-02-09 12:02:51,002 INFO [StoreOpener-65a3da3364c26109bbe03b4e408b5d95-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 65a3da3364c26109bbe03b4e408b5d95 columnFamilyName f1 2023-02-09 12:02:51,003 INFO [StoreOpener-65a3da3364c26109bbe03b4e408b5d95-1] regionserver.HStore(310): Store=65a3da3364c26109bbe03b4e408b5d95/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:02:51,003 INFO [StoreOpener-65a3da3364c26109bbe03b4e408b5d95-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 65a3da3364c26109bbe03b4e408b5d95 2023-02-09 12:02:51,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/75beec9f46c90b3722fafa385b8aee48/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 12:02:51,005 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 75beec9f46c90b3722fafa385b8aee48; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62704357, jitterRate=-0.06563226878643036}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 12:02:51,005 DEBUG [StoreOpener-65a3da3364c26109bbe03b4e408b5d95-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/65a3da3364c26109bbe03b4e408b5d95/f2 2023-02-09 12:02:51,005 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 75beec9f46c90b3722fafa385b8aee48: Running coprocessor pre-open hook at 1675944170981Writing region info on filesystem at 1675944170981Initializing all the Stores at 1675944170983 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944170983Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944170983Cleaning up temporary data from old regions at 1675944170996 (+13 ms)Cleaning up detritus from prior splits at 1675944170997 (+1 ms)Running coprocessor post-open hooks at 1675944171005 (+8 ms)Region opened successfully at 1675944171005 2023-02-09 12:02:51,005 DEBUG [StoreOpener-65a3da3364c26109bbe03b4e408b5d95-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/65a3da3364c26109bbe03b4e408b5d95/f2 2023-02-09 12:02:51,006 INFO [StoreOpener-65a3da3364c26109bbe03b4e408b5d95-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 65a3da3364c26109bbe03b4e408b5d95 columnFamilyName f2 2023-02-09 12:02:51,007 INFO [StoreOpener-65a3da3364c26109bbe03b4e408b5d95-1] regionserver.HStore(310): Store=65a3da3364c26109bbe03b4e408b5d95/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:02:51,007 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1675944170049.75beec9f46c90b3722fafa385b8aee48., pid=22, masterSystemTime=1675944170973 2023-02-09 12:02:51,009 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/65a3da3364c26109bbe03b4e408b5d95 2023-02-09 12:02:51,010 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/65a3da3364c26109bbe03b4e408b5d95 2023-02-09 12:02:51,011 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1675944170049.75beec9f46c90b3722fafa385b8aee48. 2023-02-09 12:02:51,011 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1675944170049.75beec9f46c90b3722fafa385b8aee48. 2023-02-09 12:02:51,011 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1675944170049.e512e42931aafc627ee7181cbf9052ca. 2023-02-09 12:02:51,011 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e512e42931aafc627ee7181cbf9052ca, NAME => 'testWithMapReduce,,1675944170049.e512e42931aafc627ee7181cbf9052ca.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-09 12:02:51,012 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce e512e42931aafc627ee7181cbf9052ca 2023-02-09 12:02:51,012 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675944170049.e512e42931aafc627ee7181cbf9052ca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:02:51,012 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=75beec9f46c90b3722fafa385b8aee48, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43865,1675944167040 2023-02-09 12:02:51,012 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for e512e42931aafc627ee7181cbf9052ca 2023-02-09 12:02:51,012 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for e512e42931aafc627ee7181cbf9052ca 2023-02-09 12:02:51,012 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1675944170049.75beec9f46c90b3722fafa385b8aee48.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675944171012"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675944171012"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675944171012"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675944171012"}]},"ts":"1675944171012"} 2023-02-09 12:02:51,014 INFO [StoreOpener-e512e42931aafc627ee7181cbf9052ca-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e512e42931aafc627ee7181cbf9052ca 2023-02-09 12:02:51,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 12:02:51,017 DEBUG [StoreOpener-e512e42931aafc627ee7181cbf9052ca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/e512e42931aafc627ee7181cbf9052ca/f1 2023-02-09 12:02:51,017 DEBUG [StoreOpener-e512e42931aafc627ee7181cbf9052ca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/e512e42931aafc627ee7181cbf9052ca/f1 2023-02-09 12:02:51,018 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 65a3da3364c26109bbe03b4e408b5d95 2023-02-09 12:02:51,018 INFO [StoreOpener-e512e42931aafc627ee7181cbf9052ca-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e512e42931aafc627ee7181cbf9052ca columnFamilyName f1 2023-02-09 12:02:51,019 INFO [StoreOpener-e512e42931aafc627ee7181cbf9052ca-1] regionserver.HStore(310): Store=e512e42931aafc627ee7181cbf9052ca/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:02:51,019 INFO [StoreOpener-e512e42931aafc627ee7181cbf9052ca-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e512e42931aafc627ee7181cbf9052ca 2023-02-09 12:02:51,056 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=17 2023-02-09 12:02:51,056 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=17, state=SUCCESS; OpenRegionProcedure 75beec9f46c90b3722fafa385b8aee48, server=jenkins-hbase4.apache.org,43865,1675944167040 in 195 msec 2023-02-09 12:02:51,057 DEBUG [StoreOpener-e512e42931aafc627ee7181cbf9052ca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/e512e42931aafc627ee7181cbf9052ca/f2 2023-02-09 12:02:51,057 DEBUG [StoreOpener-e512e42931aafc627ee7181cbf9052ca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/e512e42931aafc627ee7181cbf9052ca/f2 2023-02-09 12:02:51,058 INFO [StoreOpener-e512e42931aafc627ee7181cbf9052ca-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e512e42931aafc627ee7181cbf9052ca columnFamilyName f2 2023-02-09 12:02:51,058 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/65a3da3364c26109bbe03b4e408b5d95/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 12:02:51,059 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 65a3da3364c26109bbe03b4e408b5d95; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65944488, jitterRate=-0.01735055446624756}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 12:02:51,059 INFO [StoreOpener-e512e42931aafc627ee7181cbf9052ca-1] regionserver.HStore(310): Store=e512e42931aafc627ee7181cbf9052ca/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:02:51,059 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 65a3da3364c26109bbe03b4e408b5d95: Running coprocessor pre-open hook at 1675944170997Writing region info on filesystem at 1675944170997Initializing all the Stores at 1675944170999 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944170999Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944170999Cleaning up temporary data from old regions at 1675944171012 (+13 ms)Cleaning up detritus from prior splits at 1675944171013 (+1 ms)Running coprocessor post-open hooks at 1675944171059 (+46 ms)Region opened successfully at 1675944171059 2023-02-09 12:02:51,060 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=75beec9f46c90b3722fafa385b8aee48, ASSIGN in 405 msec 2023-02-09 12:02:51,060 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1675944170049.65a3da3364c26109bbe03b4e408b5d95., pid=27, masterSystemTime=1675944170986 2023-02-09 12:02:51,062 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/e512e42931aafc627ee7181cbf9052ca 2023-02-09 12:02:51,062 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/e512e42931aafc627ee7181cbf9052ca 2023-02-09 12:02:51,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1675944170049.65a3da3364c26109bbe03b4e408b5d95. 2023-02-09 12:02:51,063 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1675944170049.65a3da3364c26109bbe03b4e408b5d95. 2023-02-09 12:02:51,063 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1675944170049.02975433f68555b44244543d329054e2. 2023-02-09 12:02:51,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 02975433f68555b44244543d329054e2, NAME => 'testWithMapReduce,m\xED\xED,1675944170049.02975433f68555b44244543d329054e2.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-09 12:02:51,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 02975433f68555b44244543d329054e2 2023-02-09 12:02:51,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1675944170049.02975433f68555b44244543d329054e2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:02:51,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 02975433f68555b44244543d329054e2 2023-02-09 12:02:51,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 02975433f68555b44244543d329054e2 2023-02-09 12:02:51,064 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=65a3da3364c26109bbe03b4e408b5d95, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40063,1675944167089 2023-02-09 12:02:51,065 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1675944170049.65a3da3364c26109bbe03b4e408b5d95.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675944171064"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675944171064"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675944171064"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675944171064"}]},"ts":"1675944171064"} 2023-02-09 12:02:51,067 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 12:02:51,067 INFO [StoreOpener-02975433f68555b44244543d329054e2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 02975433f68555b44244543d329054e2 2023-02-09 12:02:51,074 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=65a3da3364c26109bbe03b4e408b5d95, ASSIGN in 421 msec 2023-02-09 12:02:51,072 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=20 2023-02-09 12:02:51,069 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for e512e42931aafc627ee7181cbf9052ca 2023-02-09 12:02:51,078 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=20, state=SUCCESS; OpenRegionProcedure 65a3da3364c26109bbe03b4e408b5d95, server=jenkins-hbase4.apache.org,40063,1675944167089 in 232 msec 2023-02-09 12:02:51,080 DEBUG [StoreOpener-02975433f68555b44244543d329054e2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/02975433f68555b44244543d329054e2/f1 2023-02-09 12:02:51,080 DEBUG [StoreOpener-02975433f68555b44244543d329054e2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/02975433f68555b44244543d329054e2/f1 2023-02-09 12:02:51,081 INFO [StoreOpener-02975433f68555b44244543d329054e2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 02975433f68555b44244543d329054e2 columnFamilyName f1 2023-02-09 12:02:51,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/e512e42931aafc627ee7181cbf9052ca/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 12:02:51,082 INFO [StoreOpener-02975433f68555b44244543d329054e2-1] regionserver.HStore(310): Store=02975433f68555b44244543d329054e2/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:02:51,083 INFO [StoreOpener-02975433f68555b44244543d329054e2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 02975433f68555b44244543d329054e2 2023-02-09 12:02:51,083 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened e512e42931aafc627ee7181cbf9052ca; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69785878, jitterRate=0.03989061713218689}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 12:02:51,083 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for e512e42931aafc627ee7181cbf9052ca: Running coprocessor pre-open hook at 1675944171012Writing region info on filesystem at 1675944171012Initializing all the Stores at 1675944171014 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944171014Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944171014Cleaning up temporary data from old regions at 1675944171064 (+50 ms)Cleaning up detritus from prior splits at 1675944171065 (+1 ms)Running coprocessor post-open hooks at 1675944171083 (+18 ms)Region opened successfully at 1675944171083 2023-02-09 12:02:51,084 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1675944170049.e512e42931aafc627ee7181cbf9052ca., pid=21, masterSystemTime=1675944170973 2023-02-09 12:02:51,085 DEBUG [StoreOpener-02975433f68555b44244543d329054e2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/02975433f68555b44244543d329054e2/f2 2023-02-09 12:02:51,086 DEBUG [StoreOpener-02975433f68555b44244543d329054e2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/02975433f68555b44244543d329054e2/f2 2023-02-09 12:02:51,087 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1675944170049.e512e42931aafc627ee7181cbf9052ca. 2023-02-09 12:02:51,087 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1675944170049.e512e42931aafc627ee7181cbf9052ca. 2023-02-09 12:02:51,087 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1675944170049.05dd22401f19bc665866ffe134bc07ee. 2023-02-09 12:02:51,087 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 05dd22401f19bc665866ffe134bc07ee, NAME => 'testWithMapReduce,j\xCA\xCA,1675944170049.05dd22401f19bc665866ffe134bc07ee.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-09 12:02:51,087 INFO [StoreOpener-02975433f68555b44244543d329054e2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 02975433f68555b44244543d329054e2 columnFamilyName f2 2023-02-09 12:02:51,088 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 05dd22401f19bc665866ffe134bc07ee 2023-02-09 12:02:51,088 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1675944170049.05dd22401f19bc665866ffe134bc07ee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:02:51,088 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=e512e42931aafc627ee7181cbf9052ca, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43865,1675944167040 2023-02-09 12:02:51,088 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 05dd22401f19bc665866ffe134bc07ee 2023-02-09 12:02:51,088 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 05dd22401f19bc665866ffe134bc07ee 2023-02-09 12:02:51,089 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1675944170049.e512e42931aafc627ee7181cbf9052ca.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675944171088"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675944171088"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675944171088"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675944171088"}]},"ts":"1675944171088"} 2023-02-09 12:02:51,089 INFO [StoreOpener-02975433f68555b44244543d329054e2-1] regionserver.HStore(310): Store=02975433f68555b44244543d329054e2/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:02:51,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/02975433f68555b44244543d329054e2 2023-02-09 12:02:51,092 INFO [StoreOpener-05dd22401f19bc665866ffe134bc07ee-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 05dd22401f19bc665866ffe134bc07ee 2023-02-09 12:02:51,092 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/02975433f68555b44244543d329054e2 2023-02-09 12:02:51,096 DEBUG [StoreOpener-05dd22401f19bc665866ffe134bc07ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/05dd22401f19bc665866ffe134bc07ee/f1 2023-02-09 12:02:51,096 DEBUG [StoreOpener-05dd22401f19bc665866ffe134bc07ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/05dd22401f19bc665866ffe134bc07ee/f1 2023-02-09 12:02:51,097 INFO [StoreOpener-05dd22401f19bc665866ffe134bc07ee-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 05dd22401f19bc665866ffe134bc07ee columnFamilyName f1 2023-02-09 12:02:51,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 12:02:51,098 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=11 2023-02-09 12:02:51,100 INFO [StoreOpener-05dd22401f19bc665866ffe134bc07ee-1] regionserver.HStore(310): Store=05dd22401f19bc665866ffe134bc07ee/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:02:51,100 INFO [StoreOpener-05dd22401f19bc665866ffe134bc07ee-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 05dd22401f19bc665866ffe134bc07ee 2023-02-09 12:02:51,100 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=11, state=SUCCESS; OpenRegionProcedure e512e42931aafc627ee7181cbf9052ca, server=jenkins-hbase4.apache.org,43865,1675944167040 in 274 msec 2023-02-09 12:02:51,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 02975433f68555b44244543d329054e2 2023-02-09 12:02:51,103 DEBUG [StoreOpener-05dd22401f19bc665866ffe134bc07ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/05dd22401f19bc665866ffe134bc07ee/f2 2023-02-09 12:02:51,103 DEBUG [StoreOpener-05dd22401f19bc665866ffe134bc07ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/05dd22401f19bc665866ffe134bc07ee/f2 2023-02-09 12:02:51,103 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=e512e42931aafc627ee7181cbf9052ca, ASSIGN in 447 msec 2023-02-09 12:02:51,103 INFO [StoreOpener-05dd22401f19bc665866ffe134bc07ee-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 05dd22401f19bc665866ffe134bc07ee columnFamilyName f2 2023-02-09 12:02:51,104 INFO [StoreOpener-05dd22401f19bc665866ffe134bc07ee-1] regionserver.HStore(310): Store=05dd22401f19bc665866ffe134bc07ee/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:02:51,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/02975433f68555b44244543d329054e2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 12:02:51,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/05dd22401f19bc665866ffe134bc07ee 2023-02-09 12:02:51,107 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/05dd22401f19bc665866ffe134bc07ee 2023-02-09 12:02:51,107 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 02975433f68555b44244543d329054e2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63842435, jitterRate=-0.048673585057258606}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 12:02:51,107 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 02975433f68555b44244543d329054e2: Running coprocessor pre-open hook at 1675944171064Writing region info on filesystem at 1675944171064Initializing all the Stores at 1675944171066 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944171066Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944171066Cleaning up temporary data from old regions at 1675944171094 (+28 ms)Cleaning up detritus from prior splits at 1675944171096 (+2 ms)Running coprocessor post-open hooks at 1675944171107 (+11 ms)Region opened successfully at 1675944171107 2023-02-09 12:02:51,108 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1675944170049.02975433f68555b44244543d329054e2., pid=26, masterSystemTime=1675944170986 2023-02-09 12:02:51,113 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=02975433f68555b44244543d329054e2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40063,1675944167089 2023-02-09 12:02:51,113 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1675944170049.02975433f68555b44244543d329054e2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675944171112"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675944171112"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675944171112"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675944171112"}]},"ts":"1675944171112"} 2023-02-09 12:02:51,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1675944170049.02975433f68555b44244543d329054e2. 2023-02-09 12:02:51,113 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1675944170049.02975433f68555b44244543d329054e2. 2023-02-09 12:02:51,114 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1675944170049.6a2f68f435ddf37944e60450e130d0c8. 2023-02-09 12:02:51,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 6a2f68f435ddf37944e60450e130d0c8, NAME => 'testWithMapReduce,g\xA7\xA7,1675944170049.6a2f68f435ddf37944e60450e130d0c8.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-09 12:02:51,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 6a2f68f435ddf37944e60450e130d0c8 2023-02-09 12:02:51,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1675944170049.6a2f68f435ddf37944e60450e130d0c8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:02:51,115 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 6a2f68f435ddf37944e60450e130d0c8 2023-02-09 12:02:51,115 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 6a2f68f435ddf37944e60450e130d0c8 2023-02-09 12:02:51,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 12:02:51,119 INFO [StoreOpener-6a2f68f435ddf37944e60450e130d0c8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 6a2f68f435ddf37944e60450e130d0c8 2023-02-09 12:02:51,120 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=16 2023-02-09 12:02:51,120 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=16, state=SUCCESS; OpenRegionProcedure 02975433f68555b44244543d329054e2, server=jenkins-hbase4.apache.org,40063,1675944167089 in 284 msec 2023-02-09 12:02:51,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 05dd22401f19bc665866ffe134bc07ee 2023-02-09 12:02:51,123 DEBUG [StoreOpener-6a2f68f435ddf37944e60450e130d0c8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/6a2f68f435ddf37944e60450e130d0c8/f1 2023-02-09 12:02:51,123 DEBUG [StoreOpener-6a2f68f435ddf37944e60450e130d0c8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/6a2f68f435ddf37944e60450e130d0c8/f1 2023-02-09 12:02:51,123 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=02975433f68555b44244543d329054e2, ASSIGN in 469 msec 2023-02-09 12:02:51,123 INFO [StoreOpener-6a2f68f435ddf37944e60450e130d0c8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6a2f68f435ddf37944e60450e130d0c8 columnFamilyName f1 2023-02-09 12:02:51,125 INFO [StoreOpener-6a2f68f435ddf37944e60450e130d0c8-1] regionserver.HStore(310): Store=6a2f68f435ddf37944e60450e130d0c8/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:02:51,125 INFO [StoreOpener-6a2f68f435ddf37944e60450e130d0c8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 6a2f68f435ddf37944e60450e130d0c8 2023-02-09 12:02:51,129 DEBUG [StoreOpener-6a2f68f435ddf37944e60450e130d0c8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/6a2f68f435ddf37944e60450e130d0c8/f2 2023-02-09 12:02:51,129 DEBUG [StoreOpener-6a2f68f435ddf37944e60450e130d0c8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/6a2f68f435ddf37944e60450e130d0c8/f2 2023-02-09 12:02:51,130 INFO [StoreOpener-6a2f68f435ddf37944e60450e130d0c8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6a2f68f435ddf37944e60450e130d0c8 columnFamilyName f2 2023-02-09 12:02:51,131 INFO [StoreOpener-6a2f68f435ddf37944e60450e130d0c8-1] regionserver.HStore(310): Store=6a2f68f435ddf37944e60450e130d0c8/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:02:51,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/6a2f68f435ddf37944e60450e130d0c8 2023-02-09 12:02:51,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/05dd22401f19bc665866ffe134bc07ee/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 12:02:51,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/6a2f68f435ddf37944e60450e130d0c8 2023-02-09 12:02:51,137 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 05dd22401f19bc665866ffe134bc07ee; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69610905, jitterRate=0.037283316254615784}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 12:02:51,137 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 05dd22401f19bc665866ffe134bc07ee: Running coprocessor pre-open hook at 1675944171088Writing region info on filesystem at 1675944171088Initializing all the Stores at 1675944171090 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944171091 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944171091Cleaning up temporary data from old regions at 1675944171108 (+17 ms)Cleaning up detritus from prior splits at 1675944171109 (+1 ms)Running coprocessor post-open hooks at 1675944171137 (+28 ms)Region opened successfully at 1675944171137 2023-02-09 12:02:51,138 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1675944170049.05dd22401f19bc665866ffe134bc07ee., pid=24, masterSystemTime=1675944170973 2023-02-09 12:02:51,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 12:02:51,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1675944170049.05dd22401f19bc665866ffe134bc07ee. 2023-02-09 12:02:51,140 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1675944170049.05dd22401f19bc665866ffe134bc07ee. 2023-02-09 12:02:51,141 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1675944170049.4a3fbf78e913c39c9306810357f4e73f. 2023-02-09 12:02:51,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4a3fbf78e913c39c9306810357f4e73f, NAME => 'testWithMapReduce,d\x84\x84,1675944170049.4a3fbf78e913c39c9306810357f4e73f.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-09 12:02:51,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 4a3fbf78e913c39c9306810357f4e73f 2023-02-09 12:02:51,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1675944170049.4a3fbf78e913c39c9306810357f4e73f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:02:51,141 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=05dd22401f19bc665866ffe134bc07ee, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43865,1675944167040 2023-02-09 12:02:51,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 4a3fbf78e913c39c9306810357f4e73f 2023-02-09 12:02:51,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 4a3fbf78e913c39c9306810357f4e73f 2023-02-09 12:02:51,142 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1675944170049.05dd22401f19bc665866ffe134bc07ee.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675944171141"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675944171141"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675944171141"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675944171141"}]},"ts":"1675944171141"} 2023-02-09 12:02:51,142 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 6a2f68f435ddf37944e60450e130d0c8 2023-02-09 12:02:51,143 INFO [StoreOpener-4a3fbf78e913c39c9306810357f4e73f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4a3fbf78e913c39c9306810357f4e73f 2023-02-09 12:02:51,146 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/6a2f68f435ddf37944e60450e130d0c8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 12:02:51,146 DEBUG [StoreOpener-4a3fbf78e913c39c9306810357f4e73f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/4a3fbf78e913c39c9306810357f4e73f/f1 2023-02-09 12:02:51,147 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 6a2f68f435ddf37944e60450e130d0c8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63878746, jitterRate=-0.048132508993148804}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 12:02:51,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 6a2f68f435ddf37944e60450e130d0c8: Running coprocessor pre-open hook at 1675944171115Writing region info on filesystem at 1675944171115Initializing all the Stores at 1675944171117 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944171118 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944171118Cleaning up temporary data from old regions at 1675944171137 (+19 ms)Cleaning up detritus from prior splits at 1675944171138 (+1 ms)Running coprocessor post-open hooks at 1675944171147 (+9 ms)Region opened successfully at 1675944171147 2023-02-09 12:02:51,147 DEBUG [StoreOpener-4a3fbf78e913c39c9306810357f4e73f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/4a3fbf78e913c39c9306810357f4e73f/f1 2023-02-09 12:02:51,148 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1675944170049.6a2f68f435ddf37944e60450e130d0c8., pid=29, masterSystemTime=1675944170986 2023-02-09 12:02:51,148 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=15 2023-02-09 12:02:51,148 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=15, state=SUCCESS; OpenRegionProcedure 05dd22401f19bc665866ffe134bc07ee, server=jenkins-hbase4.apache.org,43865,1675944167040 in 315 msec 2023-02-09 12:02:51,149 INFO [StoreOpener-4a3fbf78e913c39c9306810357f4e73f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4a3fbf78e913c39c9306810357f4e73f columnFamilyName f1 2023-02-09 12:02:51,150 INFO [StoreOpener-4a3fbf78e913c39c9306810357f4e73f-1] regionserver.HStore(310): Store=4a3fbf78e913c39c9306810357f4e73f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:02:51,150 INFO [StoreOpener-4a3fbf78e913c39c9306810357f4e73f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4a3fbf78e913c39c9306810357f4e73f 2023-02-09 12:02:51,151 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1675944170049.6a2f68f435ddf37944e60450e130d0c8. 2023-02-09 12:02:51,151 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1675944170049.6a2f68f435ddf37944e60450e130d0c8. 2023-02-09 12:02:51,151 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1675944170049.f1f03c1ee1ed10fc02a07432990a8ea4. 2023-02-09 12:02:51,151 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => f1f03c1ee1ed10fc02a07432990a8ea4, NAME => 'testWithMapReduce,t43,1675944170049.f1f03c1ee1ed10fc02a07432990a8ea4.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-09 12:02:51,151 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=05dd22401f19bc665866ffe134bc07ee, ASSIGN in 497 msec 2023-02-09 12:02:51,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce f1f03c1ee1ed10fc02a07432990a8ea4 2023-02-09 12:02:51,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1675944170049.f1f03c1ee1ed10fc02a07432990a8ea4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:02:51,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for f1f03c1ee1ed10fc02a07432990a8ea4 2023-02-09 12:02:51,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for f1f03c1ee1ed10fc02a07432990a8ea4 2023-02-09 12:02:51,152 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=6a2f68f435ddf37944e60450e130d0c8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40063,1675944167089 2023-02-09 12:02:51,153 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1675944170049.6a2f68f435ddf37944e60450e130d0c8.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675944171152"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675944171152"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675944171152"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675944171152"}]},"ts":"1675944171152"} 2023-02-09 12:02:51,153 DEBUG [StoreOpener-4a3fbf78e913c39c9306810357f4e73f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/4a3fbf78e913c39c9306810357f4e73f/f2 2023-02-09 12:02:51,153 DEBUG [StoreOpener-4a3fbf78e913c39c9306810357f4e73f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/4a3fbf78e913c39c9306810357f4e73f/f2 2023-02-09 12:02:51,154 INFO [StoreOpener-4a3fbf78e913c39c9306810357f4e73f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4a3fbf78e913c39c9306810357f4e73f columnFamilyName f2 2023-02-09 12:02:51,154 INFO [StoreOpener-f1f03c1ee1ed10fc02a07432990a8ea4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f1f03c1ee1ed10fc02a07432990a8ea4 2023-02-09 12:02:51,155 INFO [StoreOpener-4a3fbf78e913c39c9306810357f4e73f-1] regionserver.HStore(310): Store=4a3fbf78e913c39c9306810357f4e73f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:02:51,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/4a3fbf78e913c39c9306810357f4e73f 2023-02-09 12:02:51,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/4a3fbf78e913c39c9306810357f4e73f 2023-02-09 12:02:51,159 DEBUG [StoreOpener-f1f03c1ee1ed10fc02a07432990a8ea4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/f1f03c1ee1ed10fc02a07432990a8ea4/f1 2023-02-09 12:02:51,159 DEBUG [StoreOpener-f1f03c1ee1ed10fc02a07432990a8ea4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/f1f03c1ee1ed10fc02a07432990a8ea4/f1 2023-02-09 12:02:51,159 INFO [StoreOpener-f1f03c1ee1ed10fc02a07432990a8ea4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f1f03c1ee1ed10fc02a07432990a8ea4 columnFamilyName f1 2023-02-09 12:02:51,160 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=14 2023-02-09 12:02:51,160 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=14, state=SUCCESS; OpenRegionProcedure 6a2f68f435ddf37944e60450e130d0c8, server=jenkins-hbase4.apache.org,40063,1675944167089 in 317 msec 2023-02-09 12:02:51,161 INFO [StoreOpener-f1f03c1ee1ed10fc02a07432990a8ea4-1] regionserver.HStore(310): Store=f1f03c1ee1ed10fc02a07432990a8ea4/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:02:51,161 INFO [StoreOpener-f1f03c1ee1ed10fc02a07432990a8ea4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f1f03c1ee1ed10fc02a07432990a8ea4 2023-02-09 12:02:51,162 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 12:02:51,162 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=6a2f68f435ddf37944e60450e130d0c8, ASSIGN in 509 msec 2023-02-09 12:02:51,164 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 4a3fbf78e913c39c9306810357f4e73f 2023-02-09 12:02:51,164 DEBUG [StoreOpener-f1f03c1ee1ed10fc02a07432990a8ea4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/f1f03c1ee1ed10fc02a07432990a8ea4/f2 2023-02-09 12:02:51,164 DEBUG [StoreOpener-f1f03c1ee1ed10fc02a07432990a8ea4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/f1f03c1ee1ed10fc02a07432990a8ea4/f2 2023-02-09 12:02:51,165 INFO [StoreOpener-f1f03c1ee1ed10fc02a07432990a8ea4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f1f03c1ee1ed10fc02a07432990a8ea4 columnFamilyName f2 2023-02-09 12:02:51,166 INFO [StoreOpener-f1f03c1ee1ed10fc02a07432990a8ea4-1] regionserver.HStore(310): Store=f1f03c1ee1ed10fc02a07432990a8ea4/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:02:51,169 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/4a3fbf78e913c39c9306810357f4e73f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 12:02:51,170 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/f1f03c1ee1ed10fc02a07432990a8ea4 2023-02-09 12:02:51,170 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/f1f03c1ee1ed10fc02a07432990a8ea4 2023-02-09 12:02:51,170 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 4a3fbf78e913c39c9306810357f4e73f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72597356, jitterRate=0.08178490400314331}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 12:02:51,170 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 4a3fbf78e913c39c9306810357f4e73f: Running coprocessor pre-open hook at 1675944171142Writing region info on filesystem at 1675944171142Initializing all the Stores at 1675944171143 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944171143Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944171143Cleaning up temporary data from old regions at 1675944171159 (+16 ms)Cleaning up detritus from prior splits at 1675944171160 (+1 ms)Running coprocessor post-open hooks at 1675944171170 (+10 ms)Region opened successfully at 1675944171170 2023-02-09 12:02:51,172 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1675944170049.4a3fbf78e913c39c9306810357f4e73f., pid=23, masterSystemTime=1675944170973 2023-02-09 12:02:51,174 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1675944170049.4a3fbf78e913c39c9306810357f4e73f. 2023-02-09 12:02:51,174 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1675944170049.4a3fbf78e913c39c9306810357f4e73f. 2023-02-09 12:02:51,175 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1675944170049.adba5c7dd8af5a32d17e2e2d2835e54e. 2023-02-09 12:02:51,175 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 12:02:51,175 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => adba5c7dd8af5a32d17e2e2d2835e54e, NAME => 'testWithMapReduce,wWV,1675944170049.adba5c7dd8af5a32d17e2e2d2835e54e.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-09 12:02:51,175 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce adba5c7dd8af5a32d17e2e2d2835e54e 2023-02-09 12:02:51,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1675944170049.adba5c7dd8af5a32d17e2e2d2835e54e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:02:51,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for adba5c7dd8af5a32d17e2e2d2835e54e 2023-02-09 12:02:51,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for adba5c7dd8af5a32d17e2e2d2835e54e 2023-02-09 12:02:51,176 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=4a3fbf78e913c39c9306810357f4e73f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43865,1675944167040 2023-02-09 12:02:51,176 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1675944170049.4a3fbf78e913c39c9306810357f4e73f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675944171176"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675944171176"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675944171176"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675944171176"}]},"ts":"1675944171176"} 2023-02-09 12:02:51,178 INFO [StoreOpener-adba5c7dd8af5a32d17e2e2d2835e54e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region adba5c7dd8af5a32d17e2e2d2835e54e 2023-02-09 12:02:51,178 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for f1f03c1ee1ed10fc02a07432990a8ea4 2023-02-09 12:02:51,182 DEBUG [StoreOpener-adba5c7dd8af5a32d17e2e2d2835e54e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/adba5c7dd8af5a32d17e2e2d2835e54e/f1 2023-02-09 12:02:51,182 DEBUG [StoreOpener-adba5c7dd8af5a32d17e2e2d2835e54e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/adba5c7dd8af5a32d17e2e2d2835e54e/f1 2023-02-09 12:02:51,182 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=13 2023-02-09 12:02:51,182 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=13, state=SUCCESS; OpenRegionProcedure 4a3fbf78e913c39c9306810357f4e73f, server=jenkins-hbase4.apache.org,43865,1675944167040 in 356 msec 2023-02-09 12:02:51,183 INFO [StoreOpener-adba5c7dd8af5a32d17e2e2d2835e54e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region adba5c7dd8af5a32d17e2e2d2835e54e columnFamilyName f1 2023-02-09 12:02:51,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/f1f03c1ee1ed10fc02a07432990a8ea4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 12:02:51,184 INFO [StoreOpener-adba5c7dd8af5a32d17e2e2d2835e54e-1] regionserver.HStore(310): Store=adba5c7dd8af5a32d17e2e2d2835e54e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:02:51,184 INFO [StoreOpener-adba5c7dd8af5a32d17e2e2d2835e54e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region adba5c7dd8af5a32d17e2e2d2835e54e 2023-02-09 12:02:51,184 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened f1f03c1ee1ed10fc02a07432990a8ea4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62944854, jitterRate=-0.06204858422279358}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 12:02:51,184 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for f1f03c1ee1ed10fc02a07432990a8ea4: Running coprocessor pre-open hook at 1675944171152Writing region info on filesystem at 1675944171152Initializing all the Stores at 1675944171154 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944171154Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944171154Cleaning up temporary data from old regions at 1675944171172 (+18 ms)Cleaning up detritus from prior splits at 1675944171173 (+1 ms)Running coprocessor post-open hooks at 1675944171184 (+11 ms)Region opened successfully at 1675944171184 2023-02-09 12:02:51,184 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=4a3fbf78e913c39c9306810357f4e73f, ASSIGN in 531 msec 2023-02-09 12:02:51,185 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1675944170049.f1f03c1ee1ed10fc02a07432990a8ea4., pid=30, masterSystemTime=1675944170986 2023-02-09 12:02:51,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1675944170049.f1f03c1ee1ed10fc02a07432990a8ea4. 2023-02-09 12:02:51,188 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1675944170049.f1f03c1ee1ed10fc02a07432990a8ea4. 2023-02-09 12:02:51,188 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1675944170049.f19add4d5d04210e250b8c75220e32c6. 2023-02-09 12:02:51,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => f19add4d5d04210e250b8c75220e32c6, NAME => 'testWithMapReduce,aaa,1675944170049.f19add4d5d04210e250b8c75220e32c6.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-09 12:02:51,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce f19add4d5d04210e250b8c75220e32c6 2023-02-09 12:02:51,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1675944170049.f19add4d5d04210e250b8c75220e32c6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:02:51,188 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=f1f03c1ee1ed10fc02a07432990a8ea4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40063,1675944167089 2023-02-09 12:02:51,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for f19add4d5d04210e250b8c75220e32c6 2023-02-09 12:02:51,188 DEBUG [StoreOpener-adba5c7dd8af5a32d17e2e2d2835e54e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/adba5c7dd8af5a32d17e2e2d2835e54e/f2 2023-02-09 12:02:51,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for f19add4d5d04210e250b8c75220e32c6 2023-02-09 12:02:51,189 DEBUG [StoreOpener-adba5c7dd8af5a32d17e2e2d2835e54e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/adba5c7dd8af5a32d17e2e2d2835e54e/f2 2023-02-09 12:02:51,189 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1675944170049.f1f03c1ee1ed10fc02a07432990a8ea4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675944171188"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675944171188"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675944171188"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675944171188"}]},"ts":"1675944171188"} 2023-02-09 12:02:51,189 INFO [StoreOpener-adba5c7dd8af5a32d17e2e2d2835e54e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region adba5c7dd8af5a32d17e2e2d2835e54e columnFamilyName f2 2023-02-09 12:02:51,190 INFO [StoreOpener-adba5c7dd8af5a32d17e2e2d2835e54e-1] regionserver.HStore(310): Store=adba5c7dd8af5a32d17e2e2d2835e54e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:02:51,192 INFO [StoreOpener-f19add4d5d04210e250b8c75220e32c6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f19add4d5d04210e250b8c75220e32c6 2023-02-09 12:02:51,192 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/adba5c7dd8af5a32d17e2e2d2835e54e 2023-02-09 12:02:51,192 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/adba5c7dd8af5a32d17e2e2d2835e54e 2023-02-09 12:02:51,193 DEBUG [StoreOpener-f19add4d5d04210e250b8c75220e32c6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/f19add4d5d04210e250b8c75220e32c6/f1 2023-02-09 12:02:51,194 DEBUG [StoreOpener-f19add4d5d04210e250b8c75220e32c6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/f19add4d5d04210e250b8c75220e32c6/f1 2023-02-09 12:02:51,194 INFO [StoreOpener-f19add4d5d04210e250b8c75220e32c6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f19add4d5d04210e250b8c75220e32c6 columnFamilyName f1 2023-02-09 12:02:51,195 INFO [StoreOpener-f19add4d5d04210e250b8c75220e32c6-1] regionserver.HStore(310): Store=f19add4d5d04210e250b8c75220e32c6/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:02:51,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 12:02:51,195 INFO [StoreOpener-f19add4d5d04210e250b8c75220e32c6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f19add4d5d04210e250b8c75220e32c6 2023-02-09 12:02:51,197 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for adba5c7dd8af5a32d17e2e2d2835e54e 2023-02-09 12:02:51,200 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=18 2023-02-09 12:02:51,200 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=18, state=SUCCESS; OpenRegionProcedure f1f03c1ee1ed10fc02a07432990a8ea4, server=jenkins-hbase4.apache.org,40063,1675944167089 in 354 msec 2023-02-09 12:02:51,201 DEBUG [StoreOpener-f19add4d5d04210e250b8c75220e32c6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/f19add4d5d04210e250b8c75220e32c6/f2 2023-02-09 12:02:51,201 DEBUG [StoreOpener-f19add4d5d04210e250b8c75220e32c6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/f19add4d5d04210e250b8c75220e32c6/f2 2023-02-09 12:02:51,201 INFO [StoreOpener-f19add4d5d04210e250b8c75220e32c6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f19add4d5d04210e250b8c75220e32c6 columnFamilyName f2 2023-02-09 12:02:51,202 INFO [StoreOpener-f19add4d5d04210e250b8c75220e32c6-1] regionserver.HStore(310): Store=f19add4d5d04210e250b8c75220e32c6/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:02:51,202 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=f1f03c1ee1ed10fc02a07432990a8ea4, ASSIGN in 549 msec 2023-02-09 12:02:51,206 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/f19add4d5d04210e250b8c75220e32c6 2023-02-09 12:02:51,206 INFO [Listener at localhost/43097] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:02:51,206 INFO [Listener at localhost/43097] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:02:51,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/f19add4d5d04210e250b8c75220e32c6 2023-02-09 12:02:51,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32779] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 12:02:51,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/adba5c7dd8af5a32d17e2e2d2835e54e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 12:02:51,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 12:02:51,210 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened adba5c7dd8af5a32d17e2e2d2835e54e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67095528, jitterRate=-1.9872188568115234E-4}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 12:02:51,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for adba5c7dd8af5a32d17e2e2d2835e54e: Running coprocessor pre-open hook at 1675944171176Writing region info on filesystem at 1675944171176Initializing all the Stores at 1675944171178 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944171178Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944171178Cleaning up temporary data from old regions at 1675944171193 (+15 ms)Cleaning up detritus from prior splits at 1675944171194 (+1 ms)Running coprocessor post-open hooks at 1675944171210 (+16 ms)Region opened successfully at 1675944171210 2023-02-09 12:02:51,211 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1675944170049.adba5c7dd8af5a32d17e2e2d2835e54e., pid=25, masterSystemTime=1675944170973 2023-02-09 12:02:51,212 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for f19add4d5d04210e250b8c75220e32c6 2023-02-09 12:02:51,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1675944170049.adba5c7dd8af5a32d17e2e2d2835e54e. 2023-02-09 12:02:51,213 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1675944170049.adba5c7dd8af5a32d17e2e2d2835e54e. 2023-02-09 12:02:51,215 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=adba5c7dd8af5a32d17e2e2d2835e54e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43865,1675944167040 2023-02-09 12:02:51,215 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1675944170049.adba5c7dd8af5a32d17e2e2d2835e54e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675944171215"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675944171215"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675944171215"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675944171215"}]},"ts":"1675944171215"} 2023-02-09 12:02:51,216 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/f19add4d5d04210e250b8c75220e32c6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 12:02:51,217 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened f19add4d5d04210e250b8c75220e32c6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64934378, jitterRate=-0.032402366399765015}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 12:02:51,217 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for f19add4d5d04210e250b8c75220e32c6: Running coprocessor pre-open hook at 1675944171189Writing region info on filesystem at 1675944171189Initializing all the Stores at 1675944171191 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944171191Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944171191Cleaning up temporary data from old regions at 1675944171208 (+17 ms)Cleaning up detritus from prior splits at 1675944171208Running coprocessor post-open hooks at 1675944171217 (+9 ms)Region opened successfully at 1675944171217 2023-02-09 12:02:51,218 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1675944170049.f19add4d5d04210e250b8c75220e32c6., pid=28, masterSystemTime=1675944170986 2023-02-09 12:02:51,221 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=19 2023-02-09 12:02:51,221 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=19, state=SUCCESS; OpenRegionProcedure adba5c7dd8af5a32d17e2e2d2835e54e, server=jenkins-hbase4.apache.org,43865,1675944167040 in 386 msec 2023-02-09 12:02:51,221 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1675944170049.f19add4d5d04210e250b8c75220e32c6. 2023-02-09 12:02:51,221 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1675944170049.f19add4d5d04210e250b8c75220e32c6. 2023-02-09 12:02:51,222 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=f19add4d5d04210e250b8c75220e32c6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40063,1675944167089 2023-02-09 12:02:51,222 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1675944170049.f19add4d5d04210e250b8c75220e32c6.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675944171222"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675944171222"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675944171222"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675944171222"}]},"ts":"1675944171222"} 2023-02-09 12:02:51,223 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=adba5c7dd8af5a32d17e2e2d2835e54e, ASSIGN in 570 msec 2023-02-09 12:02:51,227 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=12 2023-02-09 12:02:51,227 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=12, state=SUCCESS; OpenRegionProcedure f19add4d5d04210e250b8c75220e32c6, server=jenkins-hbase4.apache.org,40063,1675944167089 in 387 msec 2023-02-09 12:02:51,230 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=10 2023-02-09 12:02:51,230 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=f19add4d5d04210e250b8c75220e32c6, ASSIGN in 576 msec 2023-02-09 12:02:51,233 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 12:02:51,233 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675944171233"}]},"ts":"1675944171233"} 2023-02-09 12:02:51,235 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-09 12:02:51,238 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 12:02:51,241 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 1.1820 sec 2023-02-09 12:02:52,208 INFO [Listener at localhost/43097] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:02:52,209 INFO [Listener at localhost/43097] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:02:52,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32779] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 12:02:52,211 INFO [Listener at localhost/43097] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-09 12:02:52,211 DEBUG [Listener at localhost/43097] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-09 12:02:52,213 INFO [Listener at localhost/43097] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-09 12:02:52,230 INFO [Listener at localhost/43097] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-09 12:02:52,231 INFO [Listener at localhost/43097] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-09 12:02:52,231 INFO [Listener at localhost/43097] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-09 12:02:52,231 INFO [Listener at localhost/43097] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-09 12:02:52,391 DEBUG [hconnection-0x3128be3e-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 12:02:52,446 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49068, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 12:02:52,466 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43865] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,d\x84\x84,1675944170049.4a3fbf78e913c39c9306810357f4e73f. 2023-02-09 12:02:52,467 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40063] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1675944170049.f19add4d5d04210e250b8c75220e32c6. 2023-02-09 12:02:52,879 INFO [Listener at localhost/43097] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-09 12:02:52,883 INFO [Listener at localhost/43097] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-09 12:02:52,894 INFO [Listener at localhost/43097] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:02:52,894 INFO [Listener at localhost/43097] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:02:52,897 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32779] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-09 12:02:52,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32779] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1675944172897 (current time:1675944172897). 2023-02-09 12:02:52,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32779] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-09 12:02:52,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32779] zookeeper.ReadOnlyZKClient(139): Connect 0x04967516 to 127.0.0.1:61812 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 12:02:52,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32779] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@42810ab8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 12:02:52,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32779] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 12:02:52,918 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52110, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 12:02:52,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32779] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x04967516 to 127.0.0.1:61812 2023-02-09 12:02:52,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32779] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 12:02:52,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32779] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-09 12:02:52,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32779] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-09 12:02:52,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32779] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-09 12:02:52,946 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-09 12:02:52,947 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1675944772947 2023-02-09 12:02:52,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32779] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-09 12:02:52,949 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-09 12:02:52,952 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-09 12:02:52,954 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-09 12:02:52,955 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 16 msec 2023-02-09 12:02:52,955 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-09 12:02:52,955 DEBUG [Listener at localhost/43097] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-09 12:02:52,955 DEBUG [Listener at localhost/43097] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-09 12:02:52,956 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1675944772956 2023-02-09 12:02:52,989 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceMultiRegion 2023-02-09 12:02:52,989 INFO [(jenkins-hbase4.apache.org,32779,1675944165832)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceMultiRegion' 2023-02-09 12:02:52,989 DEBUG [(jenkins-hbase4.apache.org,32779,1675944165832)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 12:02:52,990 DEBUG [(jenkins-hbase4.apache.org,32779,1675944165832)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceMultiRegion' starting 'acquire' 2023-02-09 12:02:52,990 DEBUG [(jenkins-hbase4.apache.org,32779,1675944165832)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-09 12:02:52,990 DEBUG [(jenkins-hbase4.apache.org,32779,1675944165832)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-09 12:02:52,990 DEBUG [(jenkins-hbase4.apache.org,32779,1675944165832)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-09 12:02:52,992 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): regionserver:43865-0x10038f668060001, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 12:02:52,992 DEBUG [(jenkins-hbase4.apache.org,32779,1675944165832)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,40063,1675944167089 2023-02-09 12:02:52,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 12:02:52,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 12:02:52,992 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): regionserver:40063-0x10038f668060002, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 12:02:52,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 12:02:52,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 12:02:52,993 DEBUG [(jenkins-hbase4.apache.org,32779,1675944165832)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,40063,1675944167089 2023-02-09 12:02:52,993 DEBUG [(jenkins-hbase4.apache.org,32779,1675944165832)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43865,1675944167040 2023-02-09 12:02:52,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-09 12:02:52,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-09 12:02:52,994 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43865-0x10038f668060001, quorum=127.0.0.1:61812, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-09 12:02:52,994 DEBUG [(jenkins-hbase4.apache.org,32779,1675944165832)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43865,1675944167040 2023-02-09 12:02:52,994 DEBUG [(jenkins-hbase4.apache.org,32779,1675944165832)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 12:02:52,994 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40063-0x10038f668060002, quorum=127.0.0.1:61812, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-09 12:02:52,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-09 12:02:52,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-09 12:02:52,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-09 12:02:52,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-09 12:02:52,995 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-09 12:02:52,995 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-09 12:02:52,998 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-09 12:02:53,000 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-09 12:02:53,000 DEBUG [member: 'jenkins-hbase4.apache.org,40063,1675944167089' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-09 12:02:53,000 DEBUG [member: 'jenkins-hbase4.apache.org,40063,1675944167089' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 12:02:53,001 DEBUG [member: 'jenkins-hbase4.apache.org,40063,1675944167089' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-09 12:02:53,001 DEBUG [member: 'jenkins-hbase4.apache.org,40063,1675944167089' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-09 12:02:53,001 DEBUG [member: 'jenkins-hbase4.apache.org,43865,1675944167040' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-09 12:02:53,001 DEBUG [member: 'jenkins-hbase4.apache.org,43865,1675944167040' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 12:02:53,001 DEBUG [member: 'jenkins-hbase4.apache.org,40063,1675944167089' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40063,1675944167089' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-09 12:02:53,002 DEBUG [member: 'jenkins-hbase4.apache.org,43865,1675944167040' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-09 12:02:53,002 DEBUG [member: 'jenkins-hbase4.apache.org,43865,1675944167040' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-09 12:02:53,002 DEBUG [member: 'jenkins-hbase4.apache.org,43865,1675944167040' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43865,1675944167040' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-09 12:02:53,004 DEBUG [member: 'jenkins-hbase4.apache.org,40063,1675944167089' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-09 12:02:53,004 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,40063,1675944167089 2023-02-09 12:02:53,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,40063,1675944167089 2023-02-09 12:02:53,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 12:02:53,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 12:02:53,005 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43865,1675944167040 2023-02-09 12:02:53,006 DEBUG [member: 'jenkins-hbase4.apache.org,40063,1675944167089' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40063-0x10038f668060002, quorum=127.0.0.1:61812, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-09 12:02:53,006 DEBUG [member: 'jenkins-hbase4.apache.org,43865,1675944167040' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-09 12:02:53,006 DEBUG [member: 'jenkins-hbase4.apache.org,40063,1675944167089' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 12:02:53,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 12:02:53,006 DEBUG [member: 'jenkins-hbase4.apache.org,43865,1675944167040' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43865-0x10038f668060001, quorum=127.0.0.1:61812, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-09 12:02:53,006 DEBUG [member: 'jenkins-hbase4.apache.org,43865,1675944167040' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 12:02:53,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 12:02:53,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-09 12:02:53,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43865,1675944167040 2023-02-09 12:02:53,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40063,1675944167089 2023-02-09 12:02:53,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 12:02:53,008 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40063,1675944167089' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-09 12:02:53,008 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@78321788[Count = 1] remaining members to acquire global barrier 2023-02-09 12:02:53,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43865,1675944167040 2023-02-09 12:02:53,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 12:02:53,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 12:02:53,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 12:02:53,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 12:02:53,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-09 12:02:53,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43865,1675944167040 2023-02-09 12:02:53,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40063,1675944167089 2023-02-09 12:02:53,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 12:02:53,011 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43865,1675944167040' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-09 12:02:53,012 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@78321788[Count = 0] remaining members to acquire global barrier 2023-02-09 12:02:53,012 DEBUG [(jenkins-hbase4.apache.org,32779,1675944165832)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-09 12:02:53,012 DEBUG [(jenkins-hbase4.apache.org,32779,1675944165832)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-09 12:02:53,013 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): regionserver:43865-0x10038f668060001, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-09 12:02:53,013 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): regionserver:40063-0x10038f668060002, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-09 12:02:53,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-09 12:02:53,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-09 12:02:53,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-09 12:02:53,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-09 12:02:53,014 DEBUG [member: 'jenkins-hbase4.apache.org,43865,1675944167040' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-09 12:02:53,014 DEBUG [member: 'jenkins-hbase4.apache.org,40063,1675944167089' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-09 12:02:53,014 DEBUG [(jenkins-hbase4.apache.org,32779,1675944165832)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,40063,1675944167089 2023-02-09 12:02:53,014 DEBUG [(jenkins-hbase4.apache.org,32779,1675944165832)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43865,1675944167040 2023-02-09 12:02:53,014 DEBUG [(jenkins-hbase4.apache.org,32779,1675944165832)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 12:02:53,016 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1675944170049.05dd22401f19bc665866ffe134bc07ee. 2023-02-09 12:02:53,016 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1675944170049.05dd22401f19bc665866ffe134bc07ee. started... 2023-02-09 12:02:53,018 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1675944170049.f19add4d5d04210e250b8c75220e32c6. 2023-02-09 12:02:53,018 INFO [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 05dd22401f19bc665866ffe134bc07ee 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-09 12:02:53,018 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1675944170049.02975433f68555b44244543d329054e2. 2023-02-09 12:02:53,018 DEBUG [member: 'jenkins-hbase4.apache.org,43865,1675944167040' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-09 12:02:53,018 DEBUG [member: 'jenkins-hbase4.apache.org,43865,1675944167040' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-09 12:02:53,018 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1675944170049.75beec9f46c90b3722fafa385b8aee48. 2023-02-09 12:02:53,018 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1675944170049.adba5c7dd8af5a32d17e2e2d2835e54e. 2023-02-09 12:02:53,018 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1675944170049.adba5c7dd8af5a32d17e2e2d2835e54e. started... 2023-02-09 12:02:53,018 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1675944170049.02975433f68555b44244543d329054e2. started... 2023-02-09 12:02:53,018 DEBUG [member: 'jenkins-hbase4.apache.org,40063,1675944167089' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-09 12:02:53,019 DEBUG [member: 'jenkins-hbase4.apache.org,40063,1675944167089' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-09 12:02:53,018 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1675944170049.f19add4d5d04210e250b8c75220e32c6. started... 2023-02-09 12:02:53,019 INFO [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-2] regionserver.HRegion(2744): Flushing adba5c7dd8af5a32d17e2e2d2835e54e 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-09 12:02:53,018 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1675944170049.75beec9f46c90b3722fafa385b8aee48. started... 2023-02-09 12:02:53,018 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1675944170049.f1f03c1ee1ed10fc02a07432990a8ea4. 2023-02-09 12:02:53,020 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1675944170049.f1f03c1ee1ed10fc02a07432990a8ea4. started... 2023-02-09 12:02:53,022 INFO [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 02975433f68555b44244543d329054e2 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-09 12:02:53,022 INFO [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-0] regionserver.HRegion(2744): Flushing f19add4d5d04210e250b8c75220e32c6 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-09 12:02:53,022 INFO [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 75beec9f46c90b3722fafa385b8aee48 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-09 12:02:53,022 INFO [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-2] regionserver.HRegion(2744): Flushing f1f03c1ee1ed10fc02a07432990a8ea4 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-09 12:02:53,056 DEBUG [Listener at localhost/43097] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 12:02:53,056 INFO [Listener at localhost/43097] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:02:53,056 INFO [Listener at localhost/43097] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:02:53,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32779] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-09 12:02:53,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32779] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-09 12:02:53,064 DEBUG [Listener at localhost/43097] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-09 12:02:53,209 INFO [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/adba5c7dd8af5a32d17e2e2d2835e54e/.tmp/f1/a084e8fd09f445e59bfc1b89e81d0b11 2023-02-09 12:02:53,236 INFO [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/75beec9f46c90b3722fafa385b8aee48/.tmp/f1/6a1feb2b02ae4a1fb7e2b035b748873d 2023-02-09 12:02:53,240 INFO [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/f19add4d5d04210e250b8c75220e32c6/.tmp/f1/65a3e5c9e0254e4bbeca68e2805638e4 2023-02-09 12:02:53,245 INFO [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/05dd22401f19bc665866ffe134bc07ee/.tmp/f1/7fdf9ea615c249c3a8844b1812d071e3 2023-02-09 12:02:53,258 INFO [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/02975433f68555b44244543d329054e2/.tmp/f1/551319def28a4552a6d0c710acefebfe 2023-02-09 12:02:53,261 INFO [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/f1f03c1ee1ed10fc02a07432990a8ea4/.tmp/f1/5c6372329cd54a32ac08ca9a1a624522 2023-02-09 12:02:53,265 DEBUG [Listener at localhost/43097] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 12:02:53,265 INFO [Listener at localhost/43097] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:02:53,265 INFO [Listener at localhost/43097] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:02:53,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32779] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-09 12:02:53,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32779] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-09 12:02:53,268 DEBUG [Listener at localhost/43097] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-09 12:02:53,437 INFO [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/f19add4d5d04210e250b8c75220e32c6/.tmp/f2/f72e68df43834ffebeb550b8fe94765b 2023-02-09 12:02:53,444 INFO [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/75beec9f46c90b3722fafa385b8aee48/.tmp/f2/97a521d6225d4655994ba1bf8590c07e 2023-02-09 12:02:53,447 INFO [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/f1f03c1ee1ed10fc02a07432990a8ea4/.tmp/f2/5c120a6693bd48058f8f2173425c5955 2023-02-09 12:02:53,447 INFO [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/adba5c7dd8af5a32d17e2e2d2835e54e/.tmp/f2/50653eed597a464a85814d050a6a5c7f 2023-02-09 12:02:53,456 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/f19add4d5d04210e250b8c75220e32c6/.tmp/f1/65a3e5c9e0254e4bbeca68e2805638e4 as hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/f19add4d5d04210e250b8c75220e32c6/f1/65a3e5c9e0254e4bbeca68e2805638e4 2023-02-09 12:02:53,459 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/75beec9f46c90b3722fafa385b8aee48/.tmp/f1/6a1feb2b02ae4a1fb7e2b035b748873d as hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/75beec9f46c90b3722fafa385b8aee48/f1/6a1feb2b02ae4a1fb7e2b035b748873d 2023-02-09 12:02:53,462 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/adba5c7dd8af5a32d17e2e2d2835e54e/.tmp/f1/a084e8fd09f445e59bfc1b89e81d0b11 as hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/adba5c7dd8af5a32d17e2e2d2835e54e/f1/a084e8fd09f445e59bfc1b89e81d0b11 2023-02-09 12:02:53,464 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/f1f03c1ee1ed10fc02a07432990a8ea4/.tmp/f1/5c6372329cd54a32ac08ca9a1a624522 as hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/f1f03c1ee1ed10fc02a07432990a8ea4/f1/5c6372329cd54a32ac08ca9a1a624522 2023-02-09 12:02:53,469 INFO [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/f19add4d5d04210e250b8c75220e32c6/f1/65a3e5c9e0254e4bbeca68e2805638e4, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-09 12:02:53,472 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/f19add4d5d04210e250b8c75220e32c6/.tmp/f2/f72e68df43834ffebeb550b8fe94765b as hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/f19add4d5d04210e250b8c75220e32c6/f2/f72e68df43834ffebeb550b8fe94765b 2023-02-09 12:02:53,473 INFO [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/75beec9f46c90b3722fafa385b8aee48/f1/6a1feb2b02ae4a1fb7e2b035b748873d, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 12:02:53,475 INFO [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/f1f03c1ee1ed10fc02a07432990a8ea4/f1/5c6372329cd54a32ac08ca9a1a624522, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 12:02:53,475 INFO [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/adba5c7dd8af5a32d17e2e2d2835e54e/f1/a084e8fd09f445e59bfc1b89e81d0b11, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-09 12:02:53,477 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/f1f03c1ee1ed10fc02a07432990a8ea4/.tmp/f2/5c120a6693bd48058f8f2173425c5955 as hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/f1f03c1ee1ed10fc02a07432990a8ea4/f2/5c120a6693bd48058f8f2173425c5955 2023-02-09 12:02:53,477 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/adba5c7dd8af5a32d17e2e2d2835e54e/.tmp/f2/50653eed597a464a85814d050a6a5c7f as hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/adba5c7dd8af5a32d17e2e2d2835e54e/f2/50653eed597a464a85814d050a6a5c7f 2023-02-09 12:02:53,478 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/75beec9f46c90b3722fafa385b8aee48/.tmp/f2/97a521d6225d4655994ba1bf8590c07e as hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/75beec9f46c90b3722fafa385b8aee48/f2/97a521d6225d4655994ba1bf8590c07e 2023-02-09 12:02:53,483 INFO [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/f19add4d5d04210e250b8c75220e32c6/f2/f72e68df43834ffebeb550b8fe94765b, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-09 12:02:53,485 INFO [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for f19add4d5d04210e250b8c75220e32c6 in 462ms, sequenceid=5, compaction requested=false 2023-02-09 12:02:53,486 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-09 12:02:53,488 INFO [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/75beec9f46c90b3722fafa385b8aee48/f2/97a521d6225d4655994ba1bf8590c07e, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 12:02:53,488 INFO [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/adba5c7dd8af5a32d17e2e2d2835e54e/f2/50653eed597a464a85814d050a6a5c7f, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-09 12:02:53,489 INFO [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 75beec9f46c90b3722fafa385b8aee48 in 467ms, sequenceid=5, compaction requested=false 2023-02-09 12:02:53,490 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 75beec9f46c90b3722fafa385b8aee48: 2023-02-09 12:02:53,490 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for f19add4d5d04210e250b8c75220e32c6: 2023-02-09 12:02:53,490 INFO [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for adba5c7dd8af5a32d17e2e2d2835e54e in 471ms, sequenceid=5, compaction requested=false 2023-02-09 12:02:53,491 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for adba5c7dd8af5a32d17e2e2d2835e54e: 2023-02-09 12:02:53,491 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1675944170049.f19add4d5d04210e250b8c75220e32c6.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-09 12:02:53,491 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1675944170049.adba5c7dd8af5a32d17e2e2d2835e54e.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-09 12:02:53,491 INFO [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/f1f03c1ee1ed10fc02a07432990a8ea4/f2/5c120a6693bd48058f8f2173425c5955, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 12:02:53,492 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1675944170049.75beec9f46c90b3722fafa385b8aee48.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-09 12:02:53,492 INFO [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for f1f03c1ee1ed10fc02a07432990a8ea4 in 470ms, sequenceid=5, compaction requested=false 2023-02-09 12:02:53,493 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for f1f03c1ee1ed10fc02a07432990a8ea4: 2023-02-09 12:02:53,493 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1675944170049.f1f03c1ee1ed10fc02a07432990a8ea4.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-09 12:02:53,498 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 12:02:53,498 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 12:02:53,498 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 12:02:53,498 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 12:02:53,503 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/adba5c7dd8af5a32d17e2e2d2835e54e/f1/a084e8fd09f445e59bfc1b89e81d0b11] hfiles 2023-02-09 12:02:53,503 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/f1f03c1ee1ed10fc02a07432990a8ea4/f1/5c6372329cd54a32ac08ca9a1a624522] hfiles 2023-02-09 12:02:53,503 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/75beec9f46c90b3722fafa385b8aee48/f1/6a1feb2b02ae4a1fb7e2b035b748873d] hfiles 2023-02-09 12:02:53,503 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/f19add4d5d04210e250b8c75220e32c6/f1/65a3e5c9e0254e4bbeca68e2805638e4] hfiles 2023-02-09 12:02:53,503 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/75beec9f46c90b3722fafa385b8aee48/f1/6a1feb2b02ae4a1fb7e2b035b748873d for snapshot=testWithMapReduceMultiRegion 2023-02-09 12:02:53,503 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/f1f03c1ee1ed10fc02a07432990a8ea4/f1/5c6372329cd54a32ac08ca9a1a624522 for snapshot=testWithMapReduceMultiRegion 2023-02-09 12:02:53,503 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/adba5c7dd8af5a32d17e2e2d2835e54e/f1/a084e8fd09f445e59bfc1b89e81d0b11 for snapshot=testWithMapReduceMultiRegion 2023-02-09 12:02:53,503 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/f19add4d5d04210e250b8c75220e32c6/f1/65a3e5c9e0254e4bbeca68e2805638e4 for snapshot=testWithMapReduceMultiRegion 2023-02-09 12:02:53,507 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/f1f03c1ee1ed10fc02a07432990a8ea4/f2/5c120a6693bd48058f8f2173425c5955] hfiles 2023-02-09 12:02:53,507 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/f19add4d5d04210e250b8c75220e32c6/f2/f72e68df43834ffebeb550b8fe94765b] hfiles 2023-02-09 12:02:53,507 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/f1f03c1ee1ed10fc02a07432990a8ea4/f2/5c120a6693bd48058f8f2173425c5955 for snapshot=testWithMapReduceMultiRegion 2023-02-09 12:02:53,507 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/adba5c7dd8af5a32d17e2e2d2835e54e/f2/50653eed597a464a85814d050a6a5c7f] hfiles 2023-02-09 12:02:53,507 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/75beec9f46c90b3722fafa385b8aee48/f2/97a521d6225d4655994ba1bf8590c07e] hfiles 2023-02-09 12:02:53,507 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/adba5c7dd8af5a32d17e2e2d2835e54e/f2/50653eed597a464a85814d050a6a5c7f for snapshot=testWithMapReduceMultiRegion 2023-02-09 12:02:53,507 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/f19add4d5d04210e250b8c75220e32c6/f2/f72e68df43834ffebeb550b8fe94765b for snapshot=testWithMapReduceMultiRegion 2023-02-09 12:02:53,507 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/75beec9f46c90b3722fafa385b8aee48/f2/97a521d6225d4655994ba1bf8590c07e for snapshot=testWithMapReduceMultiRegion 2023-02-09 12:02:53,537 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1675944170049.f19add4d5d04210e250b8c75220e32c6. completed. 2023-02-09 12:02:53,537 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1675944170049.f19add4d5d04210e250b8c75220e32c6. 2023-02-09 12:02:53,538 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1675944170049.65a3da3364c26109bbe03b4e408b5d95. 2023-02-09 12:02:53,538 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1675944170049.65a3da3364c26109bbe03b4e408b5d95. started... 2023-02-09 12:02:53,538 DEBUG [member: 'jenkins-hbase4.apache.org,40063,1675944167089' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-09 12:02:53,538 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 65a3da3364c26109bbe03b4e408b5d95: 2023-02-09 12:02:53,539 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1675944170049.65a3da3364c26109bbe03b4e408b5d95.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-09 12:02:53,539 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 12:02:53,539 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-09 12:02:53,539 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-09 12:02:53,541 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1675944170049.f1f03c1ee1ed10fc02a07432990a8ea4. completed. 2023-02-09 12:02:53,541 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1675944170049.f1f03c1ee1ed10fc02a07432990a8ea4. 2023-02-09 12:02:53,541 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1675944170049.6a2f68f435ddf37944e60450e130d0c8. 2023-02-09 12:02:53,541 DEBUG [member: 'jenkins-hbase4.apache.org,40063,1675944167089' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-09 12:02:53,541 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1675944170049.6a2f68f435ddf37944e60450e130d0c8. started... 2023-02-09 12:02:53,544 INFO [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 6a2f68f435ddf37944e60450e130d0c8 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-09 12:02:53,547 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1675944170049.adba5c7dd8af5a32d17e2e2d2835e54e. completed. 2023-02-09 12:02:53,547 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1675944170049.adba5c7dd8af5a32d17e2e2d2835e54e. 2023-02-09 12:02:53,547 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1675944170049.4a3fbf78e913c39c9306810357f4e73f. 2023-02-09 12:02:53,547 DEBUG [member: 'jenkins-hbase4.apache.org,43865,1675944167040' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-09 12:02:53,547 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1675944170049.4a3fbf78e913c39c9306810357f4e73f. started... 2023-02-09 12:02:53,548 INFO [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 4a3fbf78e913c39c9306810357f4e73f 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-09 12:02:53,550 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1675944170049.75beec9f46c90b3722fafa385b8aee48. completed. 2023-02-09 12:02:53,550 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1675944170049.75beec9f46c90b3722fafa385b8aee48. 2023-02-09 12:02:53,550 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1675944170049.e512e42931aafc627ee7181cbf9052ca. 2023-02-09 12:02:53,550 DEBUG [member: 'jenkins-hbase4.apache.org,43865,1675944167040' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-09 12:02:53,550 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1675944170049.e512e42931aafc627ee7181cbf9052ca. started... 2023-02-09 12:02:53,550 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for e512e42931aafc627ee7181cbf9052ca: 2023-02-09 12:02:53,551 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1675944170049.e512e42931aafc627ee7181cbf9052ca.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-09 12:02:53,551 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 12:02:53,551 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-09 12:02:53,551 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-09 12:02:53,561 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1675944170049.65a3da3364c26109bbe03b4e408b5d95. completed. 2023-02-09 12:02:53,562 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1675944170049.65a3da3364c26109bbe03b4e408b5d95. 2023-02-09 12:02:53,562 DEBUG [member: 'jenkins-hbase4.apache.org,40063,1675944167089' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-09 12:02:53,568 DEBUG [Listener at localhost/43097] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 12:02:53,568 INFO [Listener at localhost/43097] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:02:53,568 INFO [Listener at localhost/43097] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:02:53,570 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1675944170049.e512e42931aafc627ee7181cbf9052ca. completed. 2023-02-09 12:02:53,570 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1675944170049.e512e42931aafc627ee7181cbf9052ca. 2023-02-09 12:02:53,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32779] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-09 12:02:53,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32779] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-09 12:02:53,573 DEBUG [member: 'jenkins-hbase4.apache.org,43865,1675944167040' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-09 12:02:53,573 DEBUG [Listener at localhost/43097] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-09 12:02:53,579 INFO [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/4a3fbf78e913c39c9306810357f4e73f/.tmp/f1/dbe67ba683384bc9984c20ac38b3243c 2023-02-09 12:02:53,581 INFO [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/6a2f68f435ddf37944e60450e130d0c8/.tmp/f1/3350840e232c489ba5a959075b03152a 2023-02-09 12:02:53,630 INFO [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/4a3fbf78e913c39c9306810357f4e73f/.tmp/f2/a042eb4ebaaf4e2d82e2c393b2110152 2023-02-09 12:02:53,630 INFO [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/6a2f68f435ddf37944e60450e130d0c8/.tmp/f2/380b460b7a9d496b902307e6f7329707 2023-02-09 12:02:53,640 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/6a2f68f435ddf37944e60450e130d0c8/.tmp/f1/3350840e232c489ba5a959075b03152a as hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/6a2f68f435ddf37944e60450e130d0c8/f1/3350840e232c489ba5a959075b03152a 2023-02-09 12:02:53,641 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/4a3fbf78e913c39c9306810357f4e73f/.tmp/f1/dbe67ba683384bc9984c20ac38b3243c as hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/4a3fbf78e913c39c9306810357f4e73f/f1/dbe67ba683384bc9984c20ac38b3243c 2023-02-09 12:02:53,650 INFO [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/4a3fbf78e913c39c9306810357f4e73f/f1/dbe67ba683384bc9984c20ac38b3243c, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 12:02:53,651 INFO [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/6a2f68f435ddf37944e60450e130d0c8/f1/3350840e232c489ba5a959075b03152a, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 12:02:53,652 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/4a3fbf78e913c39c9306810357f4e73f/.tmp/f2/a042eb4ebaaf4e2d82e2c393b2110152 as hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/4a3fbf78e913c39c9306810357f4e73f/f2/a042eb4ebaaf4e2d82e2c393b2110152 2023-02-09 12:02:53,653 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/6a2f68f435ddf37944e60450e130d0c8/.tmp/f2/380b460b7a9d496b902307e6f7329707 as hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/6a2f68f435ddf37944e60450e130d0c8/f2/380b460b7a9d496b902307e6f7329707 2023-02-09 12:02:53,662 INFO [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/4a3fbf78e913c39c9306810357f4e73f/f2/a042eb4ebaaf4e2d82e2c393b2110152, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 12:02:53,663 INFO [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/6a2f68f435ddf37944e60450e130d0c8/f2/380b460b7a9d496b902307e6f7329707, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 12:02:53,663 INFO [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 4a3fbf78e913c39c9306810357f4e73f in 115ms, sequenceid=5, compaction requested=false 2023-02-09 12:02:53,663 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 4a3fbf78e913c39c9306810357f4e73f: 2023-02-09 12:02:53,664 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1675944170049.4a3fbf78e913c39c9306810357f4e73f.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-09 12:02:53,664 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 12:02:53,664 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/4a3fbf78e913c39c9306810357f4e73f/f1/dbe67ba683384bc9984c20ac38b3243c] hfiles 2023-02-09 12:02:53,664 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/4a3fbf78e913c39c9306810357f4e73f/f1/dbe67ba683384bc9984c20ac38b3243c for snapshot=testWithMapReduceMultiRegion 2023-02-09 12:02:53,664 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/4a3fbf78e913c39c9306810357f4e73f/f2/a042eb4ebaaf4e2d82e2c393b2110152] hfiles 2023-02-09 12:02:53,664 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/4a3fbf78e913c39c9306810357f4e73f/f2/a042eb4ebaaf4e2d82e2c393b2110152 for snapshot=testWithMapReduceMultiRegion 2023-02-09 12:02:53,664 INFO [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 6a2f68f435ddf37944e60450e130d0c8 in 120ms, sequenceid=5, compaction requested=false 2023-02-09 12:02:53,664 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 6a2f68f435ddf37944e60450e130d0c8: 2023-02-09 12:02:53,665 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1675944170049.6a2f68f435ddf37944e60450e130d0c8.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-09 12:02:53,665 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 12:02:53,665 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/6a2f68f435ddf37944e60450e130d0c8/f1/3350840e232c489ba5a959075b03152a] hfiles 2023-02-09 12:02:53,665 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/6a2f68f435ddf37944e60450e130d0c8/f1/3350840e232c489ba5a959075b03152a for snapshot=testWithMapReduceMultiRegion 2023-02-09 12:02:53,665 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/6a2f68f435ddf37944e60450e130d0c8/f2/380b460b7a9d496b902307e6f7329707] hfiles 2023-02-09 12:02:53,665 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/6a2f68f435ddf37944e60450e130d0c8/f2/380b460b7a9d496b902307e6f7329707 for snapshot=testWithMapReduceMultiRegion 2023-02-09 12:02:53,682 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1675944170049.6a2f68f435ddf37944e60450e130d0c8. completed. 2023-02-09 12:02:53,683 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1675944170049.6a2f68f435ddf37944e60450e130d0c8. 2023-02-09 12:02:53,683 DEBUG [member: 'jenkins-hbase4.apache.org,40063,1675944167089' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-09 12:02:53,708 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1675944170049.4a3fbf78e913c39c9306810357f4e73f. completed. 2023-02-09 12:02:53,708 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1675944170049.4a3fbf78e913c39c9306810357f4e73f. 2023-02-09 12:02:53,708 DEBUG [member: 'jenkins-hbase4.apache.org,43865,1675944167040' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-09 12:02:53,830 INFO [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/02975433f68555b44244543d329054e2/.tmp/f2/df9930806411417aa95ccf7fcaa3fad3 2023-02-09 12:02:53,839 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/02975433f68555b44244543d329054e2/.tmp/f1/551319def28a4552a6d0c710acefebfe as hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/02975433f68555b44244543d329054e2/f1/551319def28a4552a6d0c710acefebfe 2023-02-09 12:02:53,847 INFO [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/02975433f68555b44244543d329054e2/f1/551319def28a4552a6d0c710acefebfe, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 12:02:53,849 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/02975433f68555b44244543d329054e2/.tmp/f2/df9930806411417aa95ccf7fcaa3fad3 as hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/02975433f68555b44244543d329054e2/f2/df9930806411417aa95ccf7fcaa3fad3 2023-02-09 12:02:53,850 INFO [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/05dd22401f19bc665866ffe134bc07ee/.tmp/f2/d21974d0b35d46d3a6a87b58f11d40e7 2023-02-09 12:02:53,857 INFO [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/02975433f68555b44244543d329054e2/f2/df9930806411417aa95ccf7fcaa3fad3, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 12:02:53,858 INFO [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 02975433f68555b44244543d329054e2 in 836ms, sequenceid=5, compaction requested=false 2023-02-09 12:02:53,858 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 02975433f68555b44244543d329054e2: 2023-02-09 12:02:53,858 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1675944170049.02975433f68555b44244543d329054e2.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-09 12:02:53,858 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 12:02:53,858 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/02975433f68555b44244543d329054e2/f1/551319def28a4552a6d0c710acefebfe] hfiles 2023-02-09 12:02:53,858 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/02975433f68555b44244543d329054e2/f1/551319def28a4552a6d0c710acefebfe for snapshot=testWithMapReduceMultiRegion 2023-02-09 12:02:53,859 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/02975433f68555b44244543d329054e2/f2/df9930806411417aa95ccf7fcaa3fad3] hfiles 2023-02-09 12:02:53,859 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/02975433f68555b44244543d329054e2/f2/df9930806411417aa95ccf7fcaa3fad3 for snapshot=testWithMapReduceMultiRegion 2023-02-09 12:02:53,859 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/05dd22401f19bc665866ffe134bc07ee/.tmp/f1/7fdf9ea615c249c3a8844b1812d071e3 as hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/05dd22401f19bc665866ffe134bc07ee/f1/7fdf9ea615c249c3a8844b1812d071e3 2023-02-09 12:02:53,866 INFO [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/05dd22401f19bc665866ffe134bc07ee/f1/7fdf9ea615c249c3a8844b1812d071e3, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 12:02:53,866 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1675944170049.02975433f68555b44244543d329054e2. completed. 2023-02-09 12:02:53,867 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1675944170049.02975433f68555b44244543d329054e2. 2023-02-09 12:02:53,867 DEBUG [member: 'jenkins-hbase4.apache.org,40063,1675944167089' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-09 12:02:53,867 DEBUG [member: 'jenkins-hbase4.apache.org,40063,1675944167089' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-09 12:02:53,867 DEBUG [member: 'jenkins-hbase4.apache.org,40063,1675944167089' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40063,1675944167089 2023-02-09 12:02:53,867 DEBUG [member: 'jenkins-hbase4.apache.org,40063,1675944167089' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-09 12:02:53,867 DEBUG [member: 'jenkins-hbase4.apache.org,40063,1675944167089' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,40063,1675944167089' in zk 2023-02-09 12:02:53,868 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/05dd22401f19bc665866ffe134bc07ee/.tmp/f2/d21974d0b35d46d3a6a87b58f11d40e7 as hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/05dd22401f19bc665866ffe134bc07ee/f2/d21974d0b35d46d3a6a87b58f11d40e7 2023-02-09 12:02:53,871 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,40063,1675944167089 2023-02-09 12:02:53,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,40063,1675944167089 2023-02-09 12:02:53,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 12:02:53,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 12:02:53,872 DEBUG [member: 'jenkins-hbase4.apache.org,40063,1675944167089' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-09 12:02:53,872 DEBUG [member: 'jenkins-hbase4.apache.org,40063,1675944167089' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 12:02:53,872 DEBUG [member: 'jenkins-hbase4.apache.org,40063,1675944167089' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-09 12:02:53,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 12:02:53,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 12:02:53,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-09 12:02:53,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43865,1675944167040 2023-02-09 12:02:53,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40063,1675944167089 2023-02-09 12:02:53,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 12:02:53,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-09 12:02:53,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40063,1675944167089 2023-02-09 12:02:53,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,40063,1675944167089': 2023-02-09 12:02:53,877 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40063,1675944167089' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-09 12:02:53,878 INFO [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/05dd22401f19bc665866ffe134bc07ee/f2/d21974d0b35d46d3a6a87b58f11d40e7, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 12:02:53,879 INFO [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 05dd22401f19bc665866ffe134bc07ee in 861ms, sequenceid=5, compaction requested=false 2023-02-09 12:02:53,879 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 05dd22401f19bc665866ffe134bc07ee: 2023-02-09 12:02:53,879 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1675944170049.05dd22401f19bc665866ffe134bc07ee.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-09 12:02:53,880 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 12:02:53,880 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/05dd22401f19bc665866ffe134bc07ee/f1/7fdf9ea615c249c3a8844b1812d071e3] hfiles 2023-02-09 12:02:53,880 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/05dd22401f19bc665866ffe134bc07ee/f1/7fdf9ea615c249c3a8844b1812d071e3 for snapshot=testWithMapReduceMultiRegion 2023-02-09 12:02:53,880 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/05dd22401f19bc665866ffe134bc07ee/f2/d21974d0b35d46d3a6a87b58f11d40e7] hfiles 2023-02-09 12:02:53,880 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/05dd22401f19bc665866ffe134bc07ee/f2/d21974d0b35d46d3a6a87b58f11d40e7 for snapshot=testWithMapReduceMultiRegion 2023-02-09 12:02:53,898 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1675944170049.05dd22401f19bc665866ffe134bc07ee. completed. 2023-02-09 12:02:53,898 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1675944170049.05dd22401f19bc665866ffe134bc07ee. 2023-02-09 12:02:53,898 DEBUG [member: 'jenkins-hbase4.apache.org,43865,1675944167040' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-09 12:02:53,899 DEBUG [member: 'jenkins-hbase4.apache.org,43865,1675944167040' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-09 12:02:53,899 DEBUG [member: 'jenkins-hbase4.apache.org,43865,1675944167040' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43865,1675944167040 2023-02-09 12:02:53,899 DEBUG [member: 'jenkins-hbase4.apache.org,43865,1675944167040' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-09 12:02:53,899 DEBUG [member: 'jenkins-hbase4.apache.org,43865,1675944167040' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,43865,1675944167040' in zk 2023-02-09 12:02:53,901 DEBUG [member: 'jenkins-hbase4.apache.org,43865,1675944167040' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-09 12:02:53,901 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43865,1675944167040 2023-02-09 12:02:53,901 DEBUG [member: 'jenkins-hbase4.apache.org,43865,1675944167040' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 12:02:53,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43865,1675944167040 2023-02-09 12:02:53,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 12:02:53,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 12:02:53,901 DEBUG [member: 'jenkins-hbase4.apache.org,43865,1675944167040' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-09 12:02:53,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 12:02:53,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 12:02:53,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-09 12:02:53,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43865,1675944167040 2023-02-09 12:02:53,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40063,1675944167089 2023-02-09 12:02:53,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 12:02:53,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-09 12:02:53,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43865,1675944167040 2023-02-09 12:02:53,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40063,1675944167089 2023-02-09 12:02:53,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,43865,1675944167040': 2023-02-09 12:02:53,907 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43865,1675944167040' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-09 12:02:53,907 INFO [(jenkins-hbase4.apache.org,32779,1675944165832)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceMultiRegion' execution completed 2023-02-09 12:02:53,907 DEBUG [(jenkins-hbase4.apache.org,32779,1675944165832)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 12:02:53,907 DEBUG [(jenkins-hbase4.apache.org,32779,1675944165832)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 12:02:53,907 DEBUG [(jenkins-hbase4.apache.org,32779,1675944165832)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceMultiRegion 2023-02-09 12:02:53,907 INFO [(jenkins-hbase4.apache.org,32779,1675944165832)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-09 12:02:53,911 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): regionserver:40063-0x10038f668060002, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-09 12:02:53,911 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): regionserver:40063-0x10038f668060002, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 12:02:53,911 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-09 12:02:53,911 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-09 12:02:53,911 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): regionserver:43865-0x10038f668060001, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-09 12:02:53,911 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): regionserver:43865-0x10038f668060001, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 12:02:53,911 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-09 12:02:53,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-09 12:02:53,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-09 12:02:53,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-09 12:02:53,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 12:02:53,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 12:02:53,911 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 12:02:53,911 DEBUG [(jenkins-hbase4.apache.org,32779,1675944165832)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43865,1675944167040 2023-02-09 12:02:53,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 12:02:53,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 12:02:53,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 12:02:53,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 12:02:53,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-09 12:02:53,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-09 12:02:53,913 DEBUG [(jenkins-hbase4.apache.org,32779,1675944165832)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,40063,1675944167089 2023-02-09 12:02:53,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-09 12:02:53,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 12:02:53,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-09 12:02:53,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43865,1675944167040 2023-02-09 12:02:53,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40063,1675944167089 2023-02-09 12:02:53,915 DEBUG [(jenkins-hbase4.apache.org,32779,1675944165832)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43865,1675944167040 2023-02-09 12:02:53,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 12:02:53,919 DEBUG [(jenkins-hbase4.apache.org,32779,1675944165832)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,40063,1675944167089 2023-02-09 12:02:53,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-09 12:02:53,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43865,1675944167040 2023-02-09 12:02:53,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40063,1675944167089 2023-02-09 12:02:53,943 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,40063,1675944167089 2023-02-09 12:02:53,943 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-09 12:02:53,943 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): regionserver:43865-0x10038f668060001, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 12:02:53,943 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): regionserver:40063-0x10038f668060002, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 12:02:53,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 12:02:53,943 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43865,1675944167040 2023-02-09 12:02:53,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 12:02:53,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 12:02:53,944 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceMultiRegion 2023-02-09 12:02:53,944 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceMultiRegion 2023-02-09 12:02:53,943 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): regionserver:40063-0x10038f668060002, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 12:02:53,943 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): regionserver:43865-0x10038f668060001, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 12:02:53,945 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion because node does not exist (not an error) 2023-02-09 12:02:53,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 12:02:53,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 12:02:53,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 12:02:53,944 DEBUG [(jenkins-hbase4.apache.org,32779,1675944165832)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 12:02:53,943 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-09 12:02:53,946 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,40063,1675944167089 2023-02-09 12:02:53,946 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-09 12:02:53,946 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43865,1675944167040 2023-02-09 12:02:53,946 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-09 12:02:53,946 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-09 12:02:53,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 12:02:53,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 12:02:53,947 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-09 12:02:54,034 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion to hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.hbase-snapshot/testWithMapReduceMultiRegion 2023-02-09 12:02:54,074 DEBUG [Listener at localhost/43097] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 12:02:54,074 INFO [Listener at localhost/43097] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:02:54,074 INFO [Listener at localhost/43097] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:02:54,075 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed 2023-02-09 12:02:54,075 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-09 12:02:54,075 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-09 12:02:54,075 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1675944172949Consolidate snapshot: testWithMapReduceMultiRegion at 1675944173944 (+995 ms)Loading Region manifests for testWithMapReduceMultiRegion at 1675944173944Writing data manifest for testWithMapReduceMultiRegion at 1675944173970 (+26 ms)Verifying snapshot: testWithMapReduceMultiRegion at 1675944173994 (+24 ms)Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed at 1675944174075 (+81 ms) 2023-02-09 12:02:54,077 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-09 12:02:54,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32779] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-09 12:02:54,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32779] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-09 12:02:54,078 INFO [Listener at localhost/43097] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-09 12:02:54,079 INFO [Listener at localhost/43097] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:02:54,079 INFO [Listener at localhost/43097] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:02:54,081 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 1.1240 sec 2023-02-09 12:02:54,092 INFO [Listener at localhost/43097] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-09 12:02:54,104 INFO [Listener at localhost/43097] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-09 12:02:54,172 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40063] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1675944170049.f19add4d5d04210e250b8c75220e32c6. 2023-02-09 12:02:54,175 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43865] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,d\x84\x84,1675944170049.4a3fbf78e913c39c9306810357f4e73f. 2023-02-09 12:02:54,349 INFO [Listener at localhost/43097] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-09 12:02:54,364 INFO [Listener at localhost/43097] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:02:54,364 INFO [Listener at localhost/43097] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:02:54,368 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32779] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 12:02:54,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32779] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-09 12:02:54,375 INFO [(jenkins-hbase4.apache.org,32779,1675944165832)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-09 12:02:54,375 DEBUG [(jenkins-hbase4.apache.org,32779,1675944165832)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 12:02:54,376 DEBUG [(jenkins-hbase4.apache.org,32779,1675944165832)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-09 12:02:54,376 DEBUG [(jenkins-hbase4.apache.org,32779,1675944165832)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-09 12:02:54,377 DEBUG [(jenkins-hbase4.apache.org,32779,1675944165832)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 12:02:54,377 DEBUG [(jenkins-hbase4.apache.org,32779,1675944165832)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 12:02:54,378 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): regionserver:43865-0x10038f668060001, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 12:02:54,378 DEBUG [(jenkins-hbase4.apache.org,32779,1675944165832)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,40063,1675944167089 2023-02-09 12:02:54,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 12:02:54,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 12:02:54,378 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): regionserver:40063-0x10038f668060002, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 12:02:54,379 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 12:02:54,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 12:02:54,379 DEBUG [(jenkins-hbase4.apache.org,32779,1675944165832)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,40063,1675944167089 2023-02-09 12:02:54,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 12:02:54,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 12:02:54,379 DEBUG [(jenkins-hbase4.apache.org,32779,1675944165832)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,43865,1675944167040 2023-02-09 12:02:54,380 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43865-0x10038f668060001, quorum=127.0.0.1:61812, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 12:02:54,380 DEBUG [(jenkins-hbase4.apache.org,32779,1675944165832)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,43865,1675944167040 2023-02-09 12:02:54,380 DEBUG [(jenkins-hbase4.apache.org,32779,1675944165832)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 12:02:54,380 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40063-0x10038f668060002, quorum=127.0.0.1:61812, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 12:02:54,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 12:02:54,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 12:02:54,380 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-09 12:02:54,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 12:02:54,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 12:02:54,381 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-09 12:02:54,382 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-09 12:02:54,385 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-09 12:02:54,385 DEBUG [member: 'jenkins-hbase4.apache.org,43865,1675944167040' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-09 12:02:54,385 DEBUG [member: 'jenkins-hbase4.apache.org,43865,1675944167040' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 12:02:54,389 DEBUG [member: 'jenkins-hbase4.apache.org,40063,1675944167089' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-09 12:02:54,389 DEBUG [member: 'jenkins-hbase4.apache.org,40063,1675944167089' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 12:02:54,389 DEBUG [member: 'jenkins-hbase4.apache.org,43865,1675944167040' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-09 12:02:54,389 DEBUG [member: 'jenkins-hbase4.apache.org,40063,1675944167089' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-09 12:02:54,391 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1675944170049.f19add4d5d04210e250b8c75220e32c6. 2023-02-09 12:02:54,391 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1675944170049.05dd22401f19bc665866ffe134bc07ee. 2023-02-09 12:02:54,391 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1675944170049.02975433f68555b44244543d329054e2. 2023-02-09 12:02:54,391 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1675944170049.f19add4d5d04210e250b8c75220e32c6. started... 2023-02-09 12:02:54,391 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1675944170049.02975433f68555b44244543d329054e2. started... 2023-02-09 12:02:54,391 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1675944170049.05dd22401f19bc665866ffe134bc07ee. started... 2023-02-09 12:02:54,391 INFO [rs(jenkins-hbase4.apache.org,40063,1675944167089)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f19add4d5d04210e250b8c75220e32c6 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-09 12:02:54,391 INFO [rs(jenkins-hbase4.apache.org,40063,1675944167089)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 02975433f68555b44244543d329054e2 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-09 12:02:54,391 INFO [rs(jenkins-hbase4.apache.org,43865,1675944167040)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 05dd22401f19bc665866ffe134bc07ee 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-09 12:02:54,392 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1675944170049.f1f03c1ee1ed10fc02a07432990a8ea4. 2023-02-09 12:02:54,392 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1675944170049.75beec9f46c90b3722fafa385b8aee48. 2023-02-09 12:02:54,393 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1675944170049.75beec9f46c90b3722fafa385b8aee48. started... 2023-02-09 12:02:54,392 DEBUG [member: 'jenkins-hbase4.apache.org,40063,1675944167089' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-09 12:02:54,393 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1675944170049.f1f03c1ee1ed10fc02a07432990a8ea4. started... 2023-02-09 12:02:54,393 DEBUG [member: 'jenkins-hbase4.apache.org,40063,1675944167089' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 12:02:54,393 INFO [rs(jenkins-hbase4.apache.org,43865,1675944167040)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 75beec9f46c90b3722fafa385b8aee48 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-09 12:02:54,394 INFO [rs(jenkins-hbase4.apache.org,40063,1675944167089)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing f1f03c1ee1ed10fc02a07432990a8ea4 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-09 12:02:54,394 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1675944170049.adba5c7dd8af5a32d17e2e2d2835e54e. 2023-02-09 12:02:54,393 DEBUG [member: 'jenkins-hbase4.apache.org,43865,1675944167040' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-09 12:02:54,395 DEBUG [member: 'jenkins-hbase4.apache.org,43865,1675944167040' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 12:02:54,395 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1675944170049.adba5c7dd8af5a32d17e2e2d2835e54e. started... 2023-02-09 12:02:54,395 INFO [rs(jenkins-hbase4.apache.org,43865,1675944167040)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing adba5c7dd8af5a32d17e2e2d2835e54e 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-09 12:02:54,435 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-09 12:02:54,461 INFO [rs(jenkins-hbase4.apache.org,43865,1675944167040)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/05dd22401f19bc665866ffe134bc07ee/.tmp/f1/d4e762ddd23b4848b375a3e145b3f207 2023-02-09 12:02:54,468 INFO [rs(jenkins-hbase4.apache.org,40063,1675944167089)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/f19add4d5d04210e250b8c75220e32c6/.tmp/f1/b7cce35bdb7e4b44836bd982cfb2ce70 2023-02-09 12:02:54,468 INFO [rs(jenkins-hbase4.apache.org,40063,1675944167089)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/02975433f68555b44244543d329054e2/.tmp/f1/52d90ef899d34c6692ad97ee027db16d 2023-02-09 12:02:54,477 INFO [rs(jenkins-hbase4.apache.org,43865,1675944167040)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/75beec9f46c90b3722fafa385b8aee48/.tmp/f1/4dd6a1b41a7647028e8a6a2f5f19ce9b 2023-02-09 12:02:54,479 INFO [rs(jenkins-hbase4.apache.org,43865,1675944167040)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/adba5c7dd8af5a32d17e2e2d2835e54e/.tmp/f1/1967812bad6446e1a896182443461eae 2023-02-09 12:02:54,540 INFO [rs(jenkins-hbase4.apache.org,43865,1675944167040)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/05dd22401f19bc665866ffe134bc07ee/.tmp/f2/27ac0115d52b4eb0a7001bde3266aa16 2023-02-09 12:02:54,545 INFO [rs(jenkins-hbase4.apache.org,43865,1675944167040)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/adba5c7dd8af5a32d17e2e2d2835e54e/.tmp/f2/7409fe1e98ac48ceb33c08e615876686 2023-02-09 12:02:54,548 INFO [rs(jenkins-hbase4.apache.org,40063,1675944167089)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/f19add4d5d04210e250b8c75220e32c6/.tmp/f2/a1005e5991334e6986822af761f66528 2023-02-09 12:02:54,550 INFO [rs(jenkins-hbase4.apache.org,40063,1675944167089)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/02975433f68555b44244543d329054e2/.tmp/f2/d4de1863843a4c3682ea4882fa219b07 2023-02-09 12:02:54,555 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/05dd22401f19bc665866ffe134bc07ee/.tmp/f1/d4e762ddd23b4848b375a3e145b3f207 as hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/05dd22401f19bc665866ffe134bc07ee/f1/d4e762ddd23b4848b375a3e145b3f207 2023-02-09 12:02:54,559 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/adba5c7dd8af5a32d17e2e2d2835e54e/.tmp/f1/1967812bad6446e1a896182443461eae as hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/adba5c7dd8af5a32d17e2e2d2835e54e/f1/1967812bad6446e1a896182443461eae 2023-02-09 12:02:54,562 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/f19add4d5d04210e250b8c75220e32c6/.tmp/f1/b7cce35bdb7e4b44836bd982cfb2ce70 as hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/f19add4d5d04210e250b8c75220e32c6/f1/b7cce35bdb7e4b44836bd982cfb2ce70 2023-02-09 12:02:54,562 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/02975433f68555b44244543d329054e2/.tmp/f1/52d90ef899d34c6692ad97ee027db16d as hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/02975433f68555b44244543d329054e2/f1/52d90ef899d34c6692ad97ee027db16d 2023-02-09 12:02:54,567 INFO [rs(jenkins-hbase4.apache.org,43865,1675944167040)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/05dd22401f19bc665866ffe134bc07ee/f1/d4e762ddd23b4848b375a3e145b3f207, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 12:02:54,570 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/05dd22401f19bc665866ffe134bc07ee/.tmp/f2/27ac0115d52b4eb0a7001bde3266aa16 as hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/05dd22401f19bc665866ffe134bc07ee/f2/27ac0115d52b4eb0a7001bde3266aa16 2023-02-09 12:02:54,573 INFO [rs(jenkins-hbase4.apache.org,43865,1675944167040)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/adba5c7dd8af5a32d17e2e2d2835e54e/f1/1967812bad6446e1a896182443461eae, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-09 12:02:54,573 INFO [rs(jenkins-hbase4.apache.org,40063,1675944167089)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/02975433f68555b44244543d329054e2/f1/52d90ef899d34c6692ad97ee027db16d, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 12:02:54,575 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/02975433f68555b44244543d329054e2/.tmp/f2/d4de1863843a4c3682ea4882fa219b07 as hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/02975433f68555b44244543d329054e2/f2/d4de1863843a4c3682ea4882fa219b07 2023-02-09 12:02:54,575 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/adba5c7dd8af5a32d17e2e2d2835e54e/.tmp/f2/7409fe1e98ac48ceb33c08e615876686 as hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/adba5c7dd8af5a32d17e2e2d2835e54e/f2/7409fe1e98ac48ceb33c08e615876686 2023-02-09 12:02:54,576 INFO [rs(jenkins-hbase4.apache.org,40063,1675944167089)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/f19add4d5d04210e250b8c75220e32c6/f1/b7cce35bdb7e4b44836bd982cfb2ce70, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-09 12:02:54,577 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/f19add4d5d04210e250b8c75220e32c6/.tmp/f2/a1005e5991334e6986822af761f66528 as hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/f19add4d5d04210e250b8c75220e32c6/f2/a1005e5991334e6986822af761f66528 2023-02-09 12:02:54,585 INFO [rs(jenkins-hbase4.apache.org,40063,1675944167089)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/02975433f68555b44244543d329054e2/f2/d4de1863843a4c3682ea4882fa219b07, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 12:02:54,585 INFO [rs(jenkins-hbase4.apache.org,43865,1675944167040)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/adba5c7dd8af5a32d17e2e2d2835e54e/f2/7409fe1e98ac48ceb33c08e615876686, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-09 12:02:54,586 INFO [rs(jenkins-hbase4.apache.org,40063,1675944167089)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 02975433f68555b44244543d329054e2 in 195ms, sequenceid=9, compaction requested=false 2023-02-09 12:02:54,586 INFO [rs(jenkins-hbase4.apache.org,43865,1675944167040)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for adba5c7dd8af5a32d17e2e2d2835e54e in 191ms, sequenceid=9, compaction requested=false 2023-02-09 12:02:54,586 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 02975433f68555b44244543d329054e2: 2023-02-09 12:02:54,586 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for adba5c7dd8af5a32d17e2e2d2835e54e: 2023-02-09 12:02:54,586 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1675944170049.02975433f68555b44244543d329054e2. 2023-02-09 12:02:54,587 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1675944170049.adba5c7dd8af5a32d17e2e2d2835e54e. 2023-02-09 12:02:54,587 DEBUG [member: 'jenkins-hbase4.apache.org,40063,1675944167089' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-09 12:02:54,587 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1675944170049.4a3fbf78e913c39c9306810357f4e73f. 2023-02-09 12:02:54,587 DEBUG [member: 'jenkins-hbase4.apache.org,43865,1675944167040' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-09 12:02:54,587 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1675944170049.65a3da3364c26109bbe03b4e408b5d95. 2023-02-09 12:02:54,587 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1675944170049.4a3fbf78e913c39c9306810357f4e73f. started... 2023-02-09 12:02:54,587 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1675944170049.65a3da3364c26109bbe03b4e408b5d95. started... 2023-02-09 12:02:54,587 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 65a3da3364c26109bbe03b4e408b5d95: 2023-02-09 12:02:54,587 INFO [rs(jenkins-hbase4.apache.org,43865,1675944167040)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 4a3fbf78e913c39c9306810357f4e73f 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-09 12:02:54,587 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1675944170049.65a3da3364c26109bbe03b4e408b5d95. 2023-02-09 12:02:54,587 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1675944170049.6a2f68f435ddf37944e60450e130d0c8. 2023-02-09 12:02:54,587 INFO [rs(jenkins-hbase4.apache.org,40063,1675944167089)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/f19add4d5d04210e250b8c75220e32c6/f2/a1005e5991334e6986822af761f66528, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-09 12:02:54,587 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1675944170049.6a2f68f435ddf37944e60450e130d0c8. started... 2023-02-09 12:02:54,587 DEBUG [member: 'jenkins-hbase4.apache.org,40063,1675944167089' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-09 12:02:54,588 INFO [rs(jenkins-hbase4.apache.org,40063,1675944167089)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 6a2f68f435ddf37944e60450e130d0c8 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-09 12:02:54,591 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-09 12:02:54,592 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-09 12:02:54,596 INFO [rs(jenkins-hbase4.apache.org,40063,1675944167089)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for f19add4d5d04210e250b8c75220e32c6 in 205ms, sequenceid=9, compaction requested=false 2023-02-09 12:02:54,596 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f19add4d5d04210e250b8c75220e32c6: 2023-02-09 12:02:54,596 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1675944170049.f19add4d5d04210e250b8c75220e32c6. 2023-02-09 12:02:54,596 DEBUG [member: 'jenkins-hbase4.apache.org,40063,1675944167089' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-09 12:02:54,598 INFO [rs(jenkins-hbase4.apache.org,43865,1675944167040)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/05dd22401f19bc665866ffe134bc07ee/f2/27ac0115d52b4eb0a7001bde3266aa16, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 12:02:54,599 INFO [rs(jenkins-hbase4.apache.org,43865,1675944167040)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 05dd22401f19bc665866ffe134bc07ee in 208ms, sequenceid=9, compaction requested=false 2023-02-09 12:02:54,599 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 05dd22401f19bc665866ffe134bc07ee: 2023-02-09 12:02:54,599 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1675944170049.05dd22401f19bc665866ffe134bc07ee. 2023-02-09 12:02:54,600 DEBUG [member: 'jenkins-hbase4.apache.org,43865,1675944167040' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-09 12:02:54,600 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1675944170049.e512e42931aafc627ee7181cbf9052ca. 2023-02-09 12:02:54,600 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1675944170049.e512e42931aafc627ee7181cbf9052ca. started... 2023-02-09 12:02:54,600 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e512e42931aafc627ee7181cbf9052ca: 2023-02-09 12:02:54,600 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1675944170049.e512e42931aafc627ee7181cbf9052ca. 2023-02-09 12:02:54,600 DEBUG [member: 'jenkins-hbase4.apache.org,43865,1675944167040' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-09 12:02:54,612 INFO [rs(jenkins-hbase4.apache.org,43865,1675944167040)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/4a3fbf78e913c39c9306810357f4e73f/.tmp/f1/4764d223234f42a59d78f8c2b620815f 2023-02-09 12:02:54,629 INFO [rs(jenkins-hbase4.apache.org,40063,1675944167089)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/6a2f68f435ddf37944e60450e130d0c8/.tmp/f1/1d33beb07ac241679fa3ab924f78231f 2023-02-09 12:02:54,654 INFO [rs(jenkins-hbase4.apache.org,40063,1675944167089)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/6a2f68f435ddf37944e60450e130d0c8/.tmp/f2/65be0e75c64840c7b5b9e746423ea0e9 2023-02-09 12:02:54,661 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/6a2f68f435ddf37944e60450e130d0c8/.tmp/f1/1d33beb07ac241679fa3ab924f78231f as hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/6a2f68f435ddf37944e60450e130d0c8/f1/1d33beb07ac241679fa3ab924f78231f 2023-02-09 12:02:54,668 INFO [rs(jenkins-hbase4.apache.org,40063,1675944167089)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/6a2f68f435ddf37944e60450e130d0c8/f1/1d33beb07ac241679fa3ab924f78231f, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 12:02:54,669 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/6a2f68f435ddf37944e60450e130d0c8/.tmp/f2/65be0e75c64840c7b5b9e746423ea0e9 as hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/6a2f68f435ddf37944e60450e130d0c8/f2/65be0e75c64840c7b5b9e746423ea0e9 2023-02-09 12:02:54,675 INFO [rs(jenkins-hbase4.apache.org,40063,1675944167089)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/6a2f68f435ddf37944e60450e130d0c8/f2/65be0e75c64840c7b5b9e746423ea0e9, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 12:02:54,676 INFO [rs(jenkins-hbase4.apache.org,40063,1675944167089)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 6a2f68f435ddf37944e60450e130d0c8 in 88ms, sequenceid=9, compaction requested=false 2023-02-09 12:02:54,676 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 6a2f68f435ddf37944e60450e130d0c8: 2023-02-09 12:02:54,676 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1675944170049.6a2f68f435ddf37944e60450e130d0c8. 2023-02-09 12:02:54,676 DEBUG [member: 'jenkins-hbase4.apache.org,40063,1675944167089' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-09 12:02:54,879 INFO [rs(jenkins-hbase4.apache.org,40063,1675944167089)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/f1f03c1ee1ed10fc02a07432990a8ea4/.tmp/f1/2ef9a949cd3341d6a0b5f1dc010a61d3 2023-02-09 12:02:54,896 INFO [rs(jenkins-hbase4.apache.org,40063,1675944167089)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/f1f03c1ee1ed10fc02a07432990a8ea4/.tmp/f2/45926a383e5d4c368c55952e641754c4 2023-02-09 12:02:54,903 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/f1f03c1ee1ed10fc02a07432990a8ea4/.tmp/f1/2ef9a949cd3341d6a0b5f1dc010a61d3 as hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/f1f03c1ee1ed10fc02a07432990a8ea4/f1/2ef9a949cd3341d6a0b5f1dc010a61d3 2023-02-09 12:02:54,910 INFO [rs(jenkins-hbase4.apache.org,40063,1675944167089)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/f1f03c1ee1ed10fc02a07432990a8ea4/f1/2ef9a949cd3341d6a0b5f1dc010a61d3, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 12:02:54,911 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/f1f03c1ee1ed10fc02a07432990a8ea4/.tmp/f2/45926a383e5d4c368c55952e641754c4 as hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/f1f03c1ee1ed10fc02a07432990a8ea4/f2/45926a383e5d4c368c55952e641754c4 2023-02-09 12:02:54,917 INFO [rs(jenkins-hbase4.apache.org,40063,1675944167089)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/f1f03c1ee1ed10fc02a07432990a8ea4/f2/45926a383e5d4c368c55952e641754c4, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 12:02:54,918 INFO [rs(jenkins-hbase4.apache.org,40063,1675944167089)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for f1f03c1ee1ed10fc02a07432990a8ea4 in 524ms, sequenceid=9, compaction requested=false 2023-02-09 12:02:54,918 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for f1f03c1ee1ed10fc02a07432990a8ea4: 2023-02-09 12:02:54,919 DEBUG [rs(jenkins-hbase4.apache.org,40063,1675944167089)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1675944170049.f1f03c1ee1ed10fc02a07432990a8ea4. 2023-02-09 12:02:54,919 DEBUG [member: 'jenkins-hbase4.apache.org,40063,1675944167089' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-09 12:02:54,919 DEBUG [member: 'jenkins-hbase4.apache.org,40063,1675944167089' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-09 12:02:54,919 DEBUG [member: 'jenkins-hbase4.apache.org,40063,1675944167089' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40063,1675944167089 2023-02-09 12:02:54,919 DEBUG [member: 'jenkins-hbase4.apache.org,40063,1675944167089' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-09 12:02:54,919 DEBUG [member: 'jenkins-hbase4.apache.org,40063,1675944167089' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40063,1675944167089' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-09 12:02:54,922 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,40063,1675944167089 2023-02-09 12:02:54,922 DEBUG [member: 'jenkins-hbase4.apache.org,40063,1675944167089' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 12:02:54,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,40063,1675944167089 2023-02-09 12:02:54,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 12:02:54,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 12:02:54,922 DEBUG [member: 'jenkins-hbase4.apache.org,40063,1675944167089' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40063-0x10038f668060002, quorum=127.0.0.1:61812, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 12:02:54,922 DEBUG [member: 'jenkins-hbase4.apache.org,40063,1675944167089' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 12:02:54,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 12:02:54,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 12:02:54,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 12:02:54,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40063,1675944167089 2023-02-09 12:02:54,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 12:02:54,924 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40063,1675944167089' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-09 12:02:54,924 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1dfea55e[Count = 1] remaining members to acquire global barrier 2023-02-09 12:02:54,943 INFO [rs(jenkins-hbase4.apache.org,43865,1675944167040)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/75beec9f46c90b3722fafa385b8aee48/.tmp/f2/8c2ee70ba6134981a9dd08c043612690 2023-02-09 12:02:54,950 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/75beec9f46c90b3722fafa385b8aee48/.tmp/f1/4dd6a1b41a7647028e8a6a2f5f19ce9b as hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/75beec9f46c90b3722fafa385b8aee48/f1/4dd6a1b41a7647028e8a6a2f5f19ce9b 2023-02-09 12:02:54,956 INFO [rs(jenkins-hbase4.apache.org,43865,1675944167040)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/75beec9f46c90b3722fafa385b8aee48/f1/4dd6a1b41a7647028e8a6a2f5f19ce9b, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 12:02:54,958 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/75beec9f46c90b3722fafa385b8aee48/.tmp/f2/8c2ee70ba6134981a9dd08c043612690 as hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/75beec9f46c90b3722fafa385b8aee48/f2/8c2ee70ba6134981a9dd08c043612690 2023-02-09 12:02:54,964 INFO [rs(jenkins-hbase4.apache.org,43865,1675944167040)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/75beec9f46c90b3722fafa385b8aee48/f2/8c2ee70ba6134981a9dd08c043612690, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 12:02:54,965 INFO [rs(jenkins-hbase4.apache.org,43865,1675944167040)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 75beec9f46c90b3722fafa385b8aee48 in 572ms, sequenceid=9, compaction requested=false 2023-02-09 12:02:54,965 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 75beec9f46c90b3722fafa385b8aee48: 2023-02-09 12:02:54,965 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1675944170049.75beec9f46c90b3722fafa385b8aee48. 2023-02-09 12:02:54,966 DEBUG [member: 'jenkins-hbase4.apache.org,43865,1675944167040' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-09 12:02:55,042 INFO [rs(jenkins-hbase4.apache.org,43865,1675944167040)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/4a3fbf78e913c39c9306810357f4e73f/.tmp/f2/9cb947fd65a245cd95fd3ac2aa1a2bf0 2023-02-09 12:02:55,050 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/4a3fbf78e913c39c9306810357f4e73f/.tmp/f1/4764d223234f42a59d78f8c2b620815f as hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/4a3fbf78e913c39c9306810357f4e73f/f1/4764d223234f42a59d78f8c2b620815f 2023-02-09 12:02:55,056 INFO [rs(jenkins-hbase4.apache.org,43865,1675944167040)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/4a3fbf78e913c39c9306810357f4e73f/f1/4764d223234f42a59d78f8c2b620815f, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 12:02:55,057 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/4a3fbf78e913c39c9306810357f4e73f/.tmp/f2/9cb947fd65a245cd95fd3ac2aa1a2bf0 as hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/4a3fbf78e913c39c9306810357f4e73f/f2/9cb947fd65a245cd95fd3ac2aa1a2bf0 2023-02-09 12:02:55,062 INFO [rs(jenkins-hbase4.apache.org,43865,1675944167040)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/4a3fbf78e913c39c9306810357f4e73f/f2/9cb947fd65a245cd95fd3ac2aa1a2bf0, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 12:02:55,064 INFO [rs(jenkins-hbase4.apache.org,43865,1675944167040)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 4a3fbf78e913c39c9306810357f4e73f in 477ms, sequenceid=9, compaction requested=false 2023-02-09 12:02:55,064 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 4a3fbf78e913c39c9306810357f4e73f: 2023-02-09 12:02:55,064 DEBUG [rs(jenkins-hbase4.apache.org,43865,1675944167040)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1675944170049.4a3fbf78e913c39c9306810357f4e73f. 2023-02-09 12:02:55,064 DEBUG [member: 'jenkins-hbase4.apache.org,43865,1675944167040' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-09 12:02:55,064 DEBUG [member: 'jenkins-hbase4.apache.org,43865,1675944167040' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-09 12:02:55,064 DEBUG [member: 'jenkins-hbase4.apache.org,43865,1675944167040' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43865,1675944167040 2023-02-09 12:02:55,064 DEBUG [member: 'jenkins-hbase4.apache.org,43865,1675944167040' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-09 12:02:55,064 DEBUG [member: 'jenkins-hbase4.apache.org,43865,1675944167040' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43865,1675944167040' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-09 12:02:55,066 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,43865,1675944167040 2023-02-09 12:02:55,066 DEBUG [member: 'jenkins-hbase4.apache.org,43865,1675944167040' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 12:02:55,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,43865,1675944167040 2023-02-09 12:02:55,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 12:02:55,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 12:02:55,066 DEBUG [member: 'jenkins-hbase4.apache.org,43865,1675944167040' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43865-0x10038f668060001, quorum=127.0.0.1:61812, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 12:02:55,066 DEBUG [member: 'jenkins-hbase4.apache.org,43865,1675944167040' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 12:02:55,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 12:02:55,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 12:02:55,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 12:02:55,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43865,1675944167040 2023-02-09 12:02:55,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40063,1675944167089 2023-02-09 12:02:55,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 12:02:55,069 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43865,1675944167040' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-09 12:02:55,069 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1dfea55e[Count = 0] remaining members to acquire global barrier 2023-02-09 12:02:55,069 DEBUG [(jenkins-hbase4.apache.org,32779,1675944165832)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-09 12:02:55,069 DEBUG [(jenkins-hbase4.apache.org,32779,1675944165832)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 12:02:55,072 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): regionserver:40063-0x10038f668060002, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 12:02:55,072 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): regionserver:43865-0x10038f668060001, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 12:02:55,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 12:02:55,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 12:02:55,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 12:02:55,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 12:02:55,072 DEBUG [(jenkins-hbase4.apache.org,32779,1675944165832)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,40063,1675944167089 2023-02-09 12:02:55,073 DEBUG [member: 'jenkins-hbase4.apache.org,40063,1675944167089' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-09 12:02:55,072 DEBUG [member: 'jenkins-hbase4.apache.org,43865,1675944167040' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-09 12:02:55,073 DEBUG [member: 'jenkins-hbase4.apache.org,43865,1675944167040' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-09 12:02:55,073 DEBUG [member: 'jenkins-hbase4.apache.org,43865,1675944167040' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,43865,1675944167040' in zk 2023-02-09 12:02:55,073 DEBUG [member: 'jenkins-hbase4.apache.org,40063,1675944167089' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-09 12:02:55,073 DEBUG [member: 'jenkins-hbase4.apache.org,40063,1675944167089' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,40063,1675944167089' in zk 2023-02-09 12:02:55,073 DEBUG [(jenkins-hbase4.apache.org,32779,1675944165832)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,43865,1675944167040 2023-02-09 12:02:55,073 DEBUG [(jenkins-hbase4.apache.org,32779,1675944165832)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 12:02:55,075 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,43865,1675944167040 2023-02-09 12:02:55,075 DEBUG [member: 'jenkins-hbase4.apache.org,43865,1675944167040' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-09 12:02:55,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,43865,1675944167040 2023-02-09 12:02:55,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 12:02:55,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 12:02:55,075 DEBUG [member: 'jenkins-hbase4.apache.org,43865,1675944167040' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 12:02:55,075 DEBUG [member: 'jenkins-hbase4.apache.org,43865,1675944167040' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-09 12:02:55,076 DEBUG [member: 'jenkins-hbase4.apache.org,40063,1675944167089' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-09 12:02:55,076 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,40063,1675944167089 2023-02-09 12:02:55,076 DEBUG [member: 'jenkins-hbase4.apache.org,40063,1675944167089' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 12:02:55,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 12:02:55,076 DEBUG [member: 'jenkins-hbase4.apache.org,40063,1675944167089' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-09 12:02:55,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 12:02:55,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 12:02:55,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43865,1675944167040 2023-02-09 12:02:55,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40063,1675944167089 2023-02-09 12:02:55,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 12:02:55,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 12:02:55,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43865,1675944167040 2023-02-09 12:02:55,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40063,1675944167089 2023-02-09 12:02:55,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,43865,1675944167040': 2023-02-09 12:02:55,081 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43865,1675944167040' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-09 12:02:55,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,40063,1675944167089 2023-02-09 12:02:55,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 12:02:55,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 12:02:55,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 12:02:55,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 12:02:55,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 12:02:55,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43865,1675944167040 2023-02-09 12:02:55,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40063,1675944167089 2023-02-09 12:02:55,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 12:02:55,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 12:02:55,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43865,1675944167040 2023-02-09 12:02:55,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40063,1675944167089 2023-02-09 12:02:55,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,40063,1675944167089': 2023-02-09 12:02:55,084 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40063,1675944167089' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-09 12:02:55,084 INFO [(jenkins-hbase4.apache.org,32779,1675944165832)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-09 12:02:55,085 DEBUG [(jenkins-hbase4.apache.org,32779,1675944165832)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 12:02:55,085 DEBUG [(jenkins-hbase4.apache.org,32779,1675944165832)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 12:02:55,085 DEBUG [(jenkins-hbase4.apache.org,32779,1675944165832)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-09 12:02:55,085 INFO [(jenkins-hbase4.apache.org,32779,1675944165832)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 12:02:55,087 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 12:02:55,087 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): regionserver:40063-0x10038f668060002, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 12:02:55,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 12:02:55,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 12:02:55,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 12:02:55,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 12:02:55,087 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): regionserver:40063-0x10038f668060002, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 12:02:55,087 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): regionserver:43865-0x10038f668060001, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 12:02:55,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 12:02:55,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 12:02:55,087 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): regionserver:43865-0x10038f668060001, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 12:02:55,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 12:02:55,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 12:02:55,088 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 12:02:55,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 12:02:55,088 DEBUG [(jenkins-hbase4.apache.org,32779,1675944165832)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,43865,1675944167040 2023-02-09 12:02:55,088 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 12:02:55,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 12:02:55,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 12:02:55,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 12:02:55,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 12:02:55,089 DEBUG [(jenkins-hbase4.apache.org,32779,1675944165832)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,40063,1675944167089 2023-02-09 12:02:55,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 12:02:55,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 12:02:55,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43865,1675944167040 2023-02-09 12:02:55,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40063,1675944167089 2023-02-09 12:02:55,090 DEBUG [(jenkins-hbase4.apache.org,32779,1675944165832)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,43865,1675944167040 2023-02-09 12:02:55,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 12:02:55,091 DEBUG [(jenkins-hbase4.apache.org,32779,1675944165832)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,40063,1675944167089 2023-02-09 12:02:55,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 12:02:55,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43865,1675944167040 2023-02-09 12:02:55,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40063,1675944167089 2023-02-09 12:02:55,097 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): regionserver:43865-0x10038f668060001, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 12:02:55,097 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): regionserver:43865-0x10038f668060001, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 12:02:55,097 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 12:02:55,098 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,40063,1675944167089 2023-02-09 12:02:55,098 DEBUG [(jenkins-hbase4.apache.org,32779,1675944165832)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 12:02:55,098 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 12:02:55,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 12:02:55,098 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,43865,1675944167040 2023-02-09 12:02:55,098 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): regionserver:40063-0x10038f668060002, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 12:02:55,098 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32779] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-09 12:02:55,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 12:02:55,098 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): regionserver:40063-0x10038f668060002, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 12:02:55,098 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 12:02:55,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 12:02:55,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 12:02:55,099 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32779] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 12:02:55,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 12:02:55,099 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,40063,1675944167089 2023-02-09 12:02:55,099 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 12:02:55,099 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,43865,1675944167040 2023-02-09 12:02:55,099 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 12:02:55,099 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 12:02:55,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 12:02:55,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 12:02:55,101 DEBUG [Listener at localhost/43097] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-09 12:02:55,101 DEBUG [Listener at localhost/43097] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 12:02:55,201 DEBUG [Listener at localhost/43097] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 12:02:55,202 INFO [Listener at localhost/43097] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:02:55,202 INFO [Listener at localhost/43097] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:02:55,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32779] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 12:02:55,305 DEBUG [Listener at localhost/43097] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30ca3dca-f74a-9aa7-fe8b-05af2eaef0f9/hadoop-4376057079941443135.jar 2023-02-09 12:02:55,321 INFO [Listener at localhost/43097] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1675944172897 type: FLUSH version: 2 ttl: 0 2023-02-09 12:02:55,322 DEBUG [Listener at localhost/43097] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:35113/user/jenkins/test-data/2cbb219e-33e2-6152-83c4-a0d89c239a73/testWithMapReduceMultiRegion/05832a5c-06eb-4032-9726-a19277ab0002/data/default/testWithMapReduce 2023-02-09 12:02:55,323 INFO [Listener at localhost/43097] snapshot.RestoreSnapshotHelper(239): region to add: 05dd22401f19bc665866ffe134bc07ee 2023-02-09 12:02:55,323 INFO [Listener at localhost/43097] snapshot.RestoreSnapshotHelper(239): region to add: f19add4d5d04210e250b8c75220e32c6 2023-02-09 12:02:55,323 INFO [Listener at localhost/43097] snapshot.RestoreSnapshotHelper(239): region to add: 02975433f68555b44244543d329054e2 2023-02-09 12:02:55,323 INFO [Listener at localhost/43097] snapshot.RestoreSnapshotHelper(239): region to add: f1f03c1ee1ed10fc02a07432990a8ea4 2023-02-09 12:02:55,323 INFO [Listener at localhost/43097] snapshot.RestoreSnapshotHelper(239): region to add: 75beec9f46c90b3722fafa385b8aee48 2023-02-09 12:02:55,323 INFO [Listener at localhost/43097] snapshot.RestoreSnapshotHelper(239): region to add: adba5c7dd8af5a32d17e2e2d2835e54e 2023-02-09 12:02:55,324 INFO [Listener at localhost/43097] snapshot.RestoreSnapshotHelper(239): region to add: 65a3da3364c26109bbe03b4e408b5d95 2023-02-09 12:02:55,324 INFO [Listener at localhost/43097] snapshot.RestoreSnapshotHelper(239): region to add: 4a3fbf78e913c39c9306810357f4e73f 2023-02-09 12:02:55,324 INFO [Listener at localhost/43097] snapshot.RestoreSnapshotHelper(239): region to add: 6a2f68f435ddf37944e60450e130d0c8 2023-02-09 12:02:55,324 INFO [Listener at localhost/43097] snapshot.RestoreSnapshotHelper(239): region to add: e512e42931aafc627ee7181cbf9052ca 2023-02-09 12:02:55,324 INFO [Listener at localhost/43097] snapshot.RestoreSnapshotHelper(585): clone region=05dd22401f19bc665866ffe134bc07ee as 05dd22401f19bc665866ffe134bc07ee in snapshot testWithMapReduceMultiRegion 2023-02-09 12:02:55,324 INFO [Listener at localhost/43097] snapshot.RestoreSnapshotHelper(585): clone region=f19add4d5d04210e250b8c75220e32c6 as f19add4d5d04210e250b8c75220e32c6 in snapshot testWithMapReduceMultiRegion 2023-02-09 12:02:55,324 INFO [Listener at localhost/43097] snapshot.RestoreSnapshotHelper(585): clone region=02975433f68555b44244543d329054e2 as 02975433f68555b44244543d329054e2 in snapshot testWithMapReduceMultiRegion 2023-02-09 12:02:55,324 INFO [Listener at localhost/43097] snapshot.RestoreSnapshotHelper(585): clone region=f1f03c1ee1ed10fc02a07432990a8ea4 as f1f03c1ee1ed10fc02a07432990a8ea4 in snapshot testWithMapReduceMultiRegion 2023-02-09 12:02:55,324 INFO [Listener at localhost/43097] snapshot.RestoreSnapshotHelper(585): clone region=75beec9f46c90b3722fafa385b8aee48 as 75beec9f46c90b3722fafa385b8aee48 in snapshot testWithMapReduceMultiRegion 2023-02-09 12:02:55,324 INFO [Listener at localhost/43097] snapshot.RestoreSnapshotHelper(585): clone region=adba5c7dd8af5a32d17e2e2d2835e54e as adba5c7dd8af5a32d17e2e2d2835e54e in snapshot testWithMapReduceMultiRegion 2023-02-09 12:02:55,324 INFO [Listener at localhost/43097] snapshot.RestoreSnapshotHelper(585): clone region=65a3da3364c26109bbe03b4e408b5d95 as 65a3da3364c26109bbe03b4e408b5d95 in snapshot testWithMapReduceMultiRegion 2023-02-09 12:02:55,324 INFO [Listener at localhost/43097] snapshot.RestoreSnapshotHelper(585): clone region=4a3fbf78e913c39c9306810357f4e73f as 4a3fbf78e913c39c9306810357f4e73f in snapshot testWithMapReduceMultiRegion 2023-02-09 12:02:55,325 INFO [Listener at localhost/43097] snapshot.RestoreSnapshotHelper(585): clone region=6a2f68f435ddf37944e60450e130d0c8 as 6a2f68f435ddf37944e60450e130d0c8 in snapshot testWithMapReduceMultiRegion 2023-02-09 12:02:55,325 INFO [Listener at localhost/43097] snapshot.RestoreSnapshotHelper(585): clone region=e512e42931aafc627ee7181cbf9052ca as e512e42931aafc627ee7181cbf9052ca in snapshot testWithMapReduceMultiRegion 2023-02-09 12:02:55,328 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 65a3da3364c26109bbe03b4e408b5d95, NAME => 'testWithMapReduce,zz{,1675944170049.65a3da3364c26109bbe03b4e408b5d95.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35113/user/jenkins/test-data/2cbb219e-33e2-6152-83c4-a0d89c239a73/testWithMapReduceMultiRegion/05832a5c-06eb-4032-9726-a19277ab0002 2023-02-09 12:02:55,328 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => f19add4d5d04210e250b8c75220e32c6, NAME => 'testWithMapReduce,aaa,1675944170049.f19add4d5d04210e250b8c75220e32c6.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35113/user/jenkins/test-data/2cbb219e-33e2-6152-83c4-a0d89c239a73/testWithMapReduceMultiRegion/05832a5c-06eb-4032-9726-a19277ab0002 2023-02-09 12:02:55,329 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 4a3fbf78e913c39c9306810357f4e73f, NAME => 'testWithMapReduce,d\x84\x84,1675944170049.4a3fbf78e913c39c9306810357f4e73f.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35113/user/jenkins/test-data/2cbb219e-33e2-6152-83c4-a0d89c239a73/testWithMapReduceMultiRegion/05832a5c-06eb-4032-9726-a19277ab0002 2023-02-09 12:02:55,329 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 02975433f68555b44244543d329054e2, NAME => 'testWithMapReduce,m\xED\xED,1675944170049.02975433f68555b44244543d329054e2.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35113/user/jenkins/test-data/2cbb219e-33e2-6152-83c4-a0d89c239a73/testWithMapReduceMultiRegion/05832a5c-06eb-4032-9726-a19277ab0002 2023-02-09 12:02:55,329 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => adba5c7dd8af5a32d17e2e2d2835e54e, NAME => 'testWithMapReduce,wWV,1675944170049.adba5c7dd8af5a32d17e2e2d2835e54e.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35113/user/jenkins/test-data/2cbb219e-33e2-6152-83c4-a0d89c239a73/testWithMapReduceMultiRegion/05832a5c-06eb-4032-9726-a19277ab0002 2023-02-09 12:02:55,329 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 75beec9f46c90b3722fafa385b8aee48, NAME => 'testWithMapReduce,q\x11\x10,1675944170049.75beec9f46c90b3722fafa385b8aee48.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35113/user/jenkins/test-data/2cbb219e-33e2-6152-83c4-a0d89c239a73/testWithMapReduceMultiRegion/05832a5c-06eb-4032-9726-a19277ab0002 2023-02-09 12:02:55,330 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => f1f03c1ee1ed10fc02a07432990a8ea4, NAME => 'testWithMapReduce,t43,1675944170049.f1f03c1ee1ed10fc02a07432990a8ea4.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35113/user/jenkins/test-data/2cbb219e-33e2-6152-83c4-a0d89c239a73/testWithMapReduceMultiRegion/05832a5c-06eb-4032-9726-a19277ab0002 2023-02-09 12:02:55,330 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 05dd22401f19bc665866ffe134bc07ee, NAME => 'testWithMapReduce,j\xCA\xCA,1675944170049.05dd22401f19bc665866ffe134bc07ee.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35113/user/jenkins/test-data/2cbb219e-33e2-6152-83c4-a0d89c239a73/testWithMapReduceMultiRegion/05832a5c-06eb-4032-9726-a19277ab0002 2023-02-09 12:02:55,357 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1675944170049.75beec9f46c90b3722fafa385b8aee48.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:02:55,357 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 6a1feb2b02ae4a1fb7e2b035b748873d from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-09 12:02:55,370 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 97a521d6225d4655994ba1bf8590c07e from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-09 12:02:55,381 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1675944170049.02975433f68555b44244543d329054e2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:02:55,382 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 551319def28a4552a6d0c710acefebfe from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-09 12:02:55,382 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 75beec9f46c90b3722fafa385b8aee48, disabling compactions & flushes 2023-02-09 12:02:55,382 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1675944170049.75beec9f46c90b3722fafa385b8aee48. 2023-02-09 12:02:55,382 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1675944170049.75beec9f46c90b3722fafa385b8aee48. 2023-02-09 12:02:55,383 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1675944170049.75beec9f46c90b3722fafa385b8aee48. after waiting 0 ms 2023-02-09 12:02:55,383 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1675944170049.75beec9f46c90b3722fafa385b8aee48. 2023-02-09 12:02:55,383 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1675944170049.75beec9f46c90b3722fafa385b8aee48. 2023-02-09 12:02:55,383 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 75beec9f46c90b3722fafa385b8aee48: Waiting for close lock at 1675944175382Disabling compacts and flushes for region at 1675944175382Disabling writes for close at 1675944175383 (+1 ms)Writing region close event to WAL at 1675944175383Closed at 1675944175383 2023-02-09 12:02:55,383 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 6a2f68f435ddf37944e60450e130d0c8, NAME => 'testWithMapReduce,g\xA7\xA7,1675944170049.6a2f68f435ddf37944e60450e130d0c8.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35113/user/jenkins/test-data/2cbb219e-33e2-6152-83c4-a0d89c239a73/testWithMapReduceMultiRegion/05832a5c-06eb-4032-9726-a19277ab0002 2023-02-09 12:02:55,389 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1675944170049.4a3fbf78e913c39c9306810357f4e73f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:02:55,389 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1675944170049.adba5c7dd8af5a32d17e2e2d2835e54e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:02:55,389 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a084e8fd09f445e59bfc1b89e81d0b11 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-09 12:02:55,389 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink dbe67ba683384bc9984c20ac38b3243c from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-09 12:02:55,390 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1675944170049.f1f03c1ee1ed10fc02a07432990a8ea4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:02:55,390 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 5c6372329cd54a32ac08ca9a1a624522 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-09 12:02:55,390 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink df9930806411417aa95ccf7fcaa3fad3 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-09 12:02:55,392 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1675944170049.f19add4d5d04210e250b8c75220e32c6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:02:55,392 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 65a3e5c9e0254e4bbeca68e2805638e4 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-09 12:02:55,392 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1675944170049.05dd22401f19bc665866ffe134bc07ee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:02:55,393 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 7fdf9ea615c249c3a8844b1812d071e3 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-09 12:02:55,408 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 02975433f68555b44244543d329054e2, disabling compactions & flushes 2023-02-09 12:02:55,408 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1675944170049.02975433f68555b44244543d329054e2. 2023-02-09 12:02:55,408 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f72e68df43834ffebeb550b8fe94765b from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-09 12:02:55,408 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1675944170049.65a3da3364c26109bbe03b4e408b5d95.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:02:55,408 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1675944170049.02975433f68555b44244543d329054e2. 2023-02-09 12:02:55,408 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1675944170049.02975433f68555b44244543d329054e2. after waiting 0 ms 2023-02-09 12:02:55,408 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 65a3da3364c26109bbe03b4e408b5d95, disabling compactions & flushes 2023-02-09 12:02:55,409 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1675944170049.65a3da3364c26109bbe03b4e408b5d95. 2023-02-09 12:02:55,409 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1675944170049.65a3da3364c26109bbe03b4e408b5d95. 2023-02-09 12:02:55,409 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1675944170049.65a3da3364c26109bbe03b4e408b5d95. after waiting 0 ms 2023-02-09 12:02:55,409 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1675944170049.65a3da3364c26109bbe03b4e408b5d95. 2023-02-09 12:02:55,409 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1675944170049.65a3da3364c26109bbe03b4e408b5d95. 2023-02-09 12:02:55,409 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 65a3da3364c26109bbe03b4e408b5d95: Waiting for close lock at 1675944175408Disabling compacts and flushes for region at 1675944175408Disabling writes for close at 1675944175409 (+1 ms)Writing region close event to WAL at 1675944175409Closed at 1675944175409 2023-02-09 12:02:55,409 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1675944170049.02975433f68555b44244543d329054e2. 2023-02-09 12:02:55,409 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1675944170049.02975433f68555b44244543d329054e2. 2023-02-09 12:02:55,409 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 02975433f68555b44244543d329054e2: Waiting for close lock at 1675944175408Disabling compacts and flushes for region at 1675944175408Disabling writes for close at 1675944175409 (+1 ms)Writing region close event to WAL at 1675944175409Closed at 1675944175409 2023-02-09 12:02:55,409 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => e512e42931aafc627ee7181cbf9052ca, NAME => 'testWithMapReduce,,1675944170049.e512e42931aafc627ee7181cbf9052ca.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35113/user/jenkins/test-data/2cbb219e-33e2-6152-83c4-a0d89c239a73/testWithMapReduceMultiRegion/05832a5c-06eb-4032-9726-a19277ab0002 2023-02-09 12:02:55,410 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d21974d0b35d46d3a6a87b58f11d40e7 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-09 12:02:55,410 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 5c120a6693bd48058f8f2173425c5955 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-09 12:02:55,415 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a042eb4ebaaf4e2d82e2c393b2110152 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-09 12:02:55,416 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1675944170049.6a2f68f435ddf37944e60450e130d0c8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:02:55,416 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 3350840e232c489ba5a959075b03152a from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-09 12:02:55,416 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 50653eed597a464a85814d050a6a5c7f from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-09 12:02:55,420 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing f1f03c1ee1ed10fc02a07432990a8ea4, disabling compactions & flushes 2023-02-09 12:02:55,420 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1675944170049.f1f03c1ee1ed10fc02a07432990a8ea4. 2023-02-09 12:02:55,420 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1675944170049.f1f03c1ee1ed10fc02a07432990a8ea4. 2023-02-09 12:02:55,420 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1675944170049.f1f03c1ee1ed10fc02a07432990a8ea4. after waiting 0 ms 2023-02-09 12:02:55,420 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1675944170049.f1f03c1ee1ed10fc02a07432990a8ea4. 2023-02-09 12:02:55,420 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1675944170049.f1f03c1ee1ed10fc02a07432990a8ea4. 2023-02-09 12:02:55,420 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for f1f03c1ee1ed10fc02a07432990a8ea4: Waiting for close lock at 1675944175420Disabling compacts and flushes for region at 1675944175420Disabling writes for close at 1675944175420Writing region close event to WAL at 1675944175420Closed at 1675944175420 2023-02-09 12:02:55,421 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 05dd22401f19bc665866ffe134bc07ee, disabling compactions & flushes 2023-02-09 12:02:55,421 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1675944170049.05dd22401f19bc665866ffe134bc07ee. 2023-02-09 12:02:55,421 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1675944170049.05dd22401f19bc665866ffe134bc07ee. 2023-02-09 12:02:55,421 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1675944170049.05dd22401f19bc665866ffe134bc07ee. after waiting 0 ms 2023-02-09 12:02:55,421 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1675944170049.05dd22401f19bc665866ffe134bc07ee. 2023-02-09 12:02:55,421 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1675944170049.05dd22401f19bc665866ffe134bc07ee. 2023-02-09 12:02:55,421 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 05dd22401f19bc665866ffe134bc07ee: Waiting for close lock at 1675944175421Disabling compacts and flushes for region at 1675944175421Disabling writes for close at 1675944175421Writing region close event to WAL at 1675944175421Closed at 1675944175421 2023-02-09 12:02:55,421 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing f19add4d5d04210e250b8c75220e32c6, disabling compactions & flushes 2023-02-09 12:02:55,421 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1675944170049.f19add4d5d04210e250b8c75220e32c6. 2023-02-09 12:02:55,421 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1675944170049.f19add4d5d04210e250b8c75220e32c6. 2023-02-09 12:02:55,421 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1675944170049.f19add4d5d04210e250b8c75220e32c6. after waiting 0 ms 2023-02-09 12:02:55,421 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1675944170049.f19add4d5d04210e250b8c75220e32c6. 2023-02-09 12:02:55,421 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1675944170049.f19add4d5d04210e250b8c75220e32c6. 2023-02-09 12:02:55,421 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for f19add4d5d04210e250b8c75220e32c6: Waiting for close lock at 1675944175421Disabling compacts and flushes for region at 1675944175421Disabling writes for close at 1675944175421Writing region close event to WAL at 1675944175421Closed at 1675944175421 2023-02-09 12:02:55,423 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 380b460b7a9d496b902307e6f7329707 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-09 12:02:55,423 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 4a3fbf78e913c39c9306810357f4e73f, disabling compactions & flushes 2023-02-09 12:02:55,423 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1675944170049.4a3fbf78e913c39c9306810357f4e73f. 2023-02-09 12:02:55,423 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1675944170049.4a3fbf78e913c39c9306810357f4e73f. 2023-02-09 12:02:55,423 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1675944170049.4a3fbf78e913c39c9306810357f4e73f. after waiting 0 ms 2023-02-09 12:02:55,423 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1675944170049.4a3fbf78e913c39c9306810357f4e73f. 2023-02-09 12:02:55,423 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1675944170049.4a3fbf78e913c39c9306810357f4e73f. 2023-02-09 12:02:55,423 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing adba5c7dd8af5a32d17e2e2d2835e54e, disabling compactions & flushes 2023-02-09 12:02:55,423 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 4a3fbf78e913c39c9306810357f4e73f: Waiting for close lock at 1675944175423Disabling compacts and flushes for region at 1675944175423Disabling writes for close at 1675944175423Writing region close event to WAL at 1675944175423Closed at 1675944175423 2023-02-09 12:02:55,423 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1675944170049.adba5c7dd8af5a32d17e2e2d2835e54e. 2023-02-09 12:02:55,424 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1675944170049.adba5c7dd8af5a32d17e2e2d2835e54e. 2023-02-09 12:02:55,424 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1675944170049.adba5c7dd8af5a32d17e2e2d2835e54e. after waiting 0 ms 2023-02-09 12:02:55,424 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1675944170049.adba5c7dd8af5a32d17e2e2d2835e54e. 2023-02-09 12:02:55,424 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1675944170049.adba5c7dd8af5a32d17e2e2d2835e54e. 2023-02-09 12:02:55,424 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for adba5c7dd8af5a32d17e2e2d2835e54e: Waiting for close lock at 1675944175423Disabling compacts and flushes for region at 1675944175423Disabling writes for close at 1675944175424 (+1 ms)Writing region close event to WAL at 1675944175424Closed at 1675944175424 2023-02-09 12:02:55,426 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675944170049.e512e42931aafc627ee7181cbf9052ca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:02:55,426 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 6a2f68f435ddf37944e60450e130d0c8, disabling compactions & flushes 2023-02-09 12:02:55,426 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing e512e42931aafc627ee7181cbf9052ca, disabling compactions & flushes 2023-02-09 12:02:55,426 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1675944170049.6a2f68f435ddf37944e60450e130d0c8. 2023-02-09 12:02:55,426 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675944170049.e512e42931aafc627ee7181cbf9052ca. 2023-02-09 12:02:55,427 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1675944170049.6a2f68f435ddf37944e60450e130d0c8. 2023-02-09 12:02:55,427 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675944170049.e512e42931aafc627ee7181cbf9052ca. 2023-02-09 12:02:55,427 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1675944170049.6a2f68f435ddf37944e60450e130d0c8. after waiting 0 ms 2023-02-09 12:02:55,427 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675944170049.e512e42931aafc627ee7181cbf9052ca. after waiting 0 ms 2023-02-09 12:02:55,427 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1675944170049.6a2f68f435ddf37944e60450e130d0c8. 2023-02-09 12:02:55,427 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675944170049.e512e42931aafc627ee7181cbf9052ca. 2023-02-09 12:02:55,427 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1675944170049.6a2f68f435ddf37944e60450e130d0c8. 2023-02-09 12:02:55,427 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,,1675944170049.e512e42931aafc627ee7181cbf9052ca. 2023-02-09 12:02:55,427 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 6a2f68f435ddf37944e60450e130d0c8: Waiting for close lock at 1675944175426Disabling compacts and flushes for region at 1675944175426Disabling writes for close at 1675944175427 (+1 ms)Writing region close event to WAL at 1675944175427Closed at 1675944175427 2023-02-09 12:02:55,427 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for e512e42931aafc627ee7181cbf9052ca: Waiting for close lock at 1675944175426Disabling compacts and flushes for region at 1675944175426Disabling writes for close at 1675944175427 (+1 ms)Writing region close event to WAL at 1675944175427Closed at 1675944175427 2023-02-09 12:02:55,427 INFO [Listener at localhost/43097] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1675944172897 type: FLUSH version: 2 ttl: 0 2023-02-09 12:02:55,428 DEBUG [Listener at localhost/43097] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:35113/user/jenkins/test-data/2cbb219e-33e2-6152-83c4-a0d89c239a73/testWithMapReduceMultiRegion/05832a5c-06eb-4032-9726-a19277ab0002 2023-02-09 12:02:55,428 DEBUG [Listener at localhost/43097] util.CommonFSUtils(682): File system contents for path hdfs://localhost:35113/user/jenkins/test-data/2cbb219e-33e2-6152-83c4-a0d89c239a73/testWithMapReduceMultiRegion/05832a5c-06eb-4032-9726-a19277ab0002 2023-02-09 12:02:55,428 DEBUG [Listener at localhost/43097] util.CommonFSUtils(699): |-data/ 2023-02-09 12:02:55,429 DEBUG [Listener at localhost/43097] util.CommonFSUtils(699): |----default/ 2023-02-09 12:02:55,429 DEBUG [Listener at localhost/43097] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-09 12:02:55,430 DEBUG [Listener at localhost/43097] util.CommonFSUtils(699): |----------02975433f68555b44244543d329054e2/ 2023-02-09 12:02:55,431 DEBUG [Listener at localhost/43097] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 12:02:55,431 DEBUG [Listener at localhost/43097] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 12:02:55,431 DEBUG [Listener at localhost/43097] util.CommonFSUtils(702): |----------------testWithMapReduce=02975433f68555b44244543d329054e2-551319def28a4552a6d0c710acefebfe 2023-02-09 12:02:55,431 DEBUG [Listener at localhost/43097] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 12:02:55,432 DEBUG [Listener at localhost/43097] util.CommonFSUtils(702): |----------------testWithMapReduce=02975433f68555b44244543d329054e2-df9930806411417aa95ccf7fcaa3fad3 2023-02-09 12:02:55,432 DEBUG [Listener at localhost/43097] util.CommonFSUtils(699): |----------05dd22401f19bc665866ffe134bc07ee/ 2023-02-09 12:02:55,432 DEBUG [Listener at localhost/43097] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 12:02:55,432 DEBUG [Listener at localhost/43097] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 12:02:55,433 DEBUG [Listener at localhost/43097] util.CommonFSUtils(702): |----------------testWithMapReduce=05dd22401f19bc665866ffe134bc07ee-7fdf9ea615c249c3a8844b1812d071e3 2023-02-09 12:02:55,433 DEBUG [Listener at localhost/43097] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 12:02:55,434 DEBUG [Listener at localhost/43097] util.CommonFSUtils(702): |----------------testWithMapReduce=05dd22401f19bc665866ffe134bc07ee-d21974d0b35d46d3a6a87b58f11d40e7 2023-02-09 12:02:55,434 DEBUG [Listener at localhost/43097] util.CommonFSUtils(699): |----------4a3fbf78e913c39c9306810357f4e73f/ 2023-02-09 12:02:55,434 DEBUG [Listener at localhost/43097] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 12:02:55,434 DEBUG [Listener at localhost/43097] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 12:02:55,435 DEBUG [Listener at localhost/43097] util.CommonFSUtils(702): |----------------testWithMapReduce=4a3fbf78e913c39c9306810357f4e73f-dbe67ba683384bc9984c20ac38b3243c 2023-02-09 12:02:55,435 DEBUG [Listener at localhost/43097] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 12:02:55,435 DEBUG [Listener at localhost/43097] util.CommonFSUtils(702): |----------------testWithMapReduce=4a3fbf78e913c39c9306810357f4e73f-a042eb4ebaaf4e2d82e2c393b2110152 2023-02-09 12:02:55,435 DEBUG [Listener at localhost/43097] util.CommonFSUtils(699): |----------65a3da3364c26109bbe03b4e408b5d95/ 2023-02-09 12:02:55,436 DEBUG [Listener at localhost/43097] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 12:02:55,436 DEBUG [Listener at localhost/43097] util.CommonFSUtils(699): |----------6a2f68f435ddf37944e60450e130d0c8/ 2023-02-09 12:02:55,436 DEBUG [Listener at localhost/43097] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 12:02:55,436 DEBUG [Listener at localhost/43097] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 12:02:55,437 DEBUG [Listener at localhost/43097] util.CommonFSUtils(702): |----------------testWithMapReduce=6a2f68f435ddf37944e60450e130d0c8-3350840e232c489ba5a959075b03152a 2023-02-09 12:02:55,437 DEBUG [Listener at localhost/43097] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 12:02:55,437 DEBUG [Listener at localhost/43097] util.CommonFSUtils(702): |----------------testWithMapReduce=6a2f68f435ddf37944e60450e130d0c8-380b460b7a9d496b902307e6f7329707 2023-02-09 12:02:55,437 DEBUG [Listener at localhost/43097] util.CommonFSUtils(699): |----------75beec9f46c90b3722fafa385b8aee48/ 2023-02-09 12:02:55,438 DEBUG [Listener at localhost/43097] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 12:02:55,438 DEBUG [Listener at localhost/43097] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 12:02:55,439 DEBUG [Listener at localhost/43097] util.CommonFSUtils(702): |----------------testWithMapReduce=75beec9f46c90b3722fafa385b8aee48-6a1feb2b02ae4a1fb7e2b035b748873d 2023-02-09 12:02:55,439 DEBUG [Listener at localhost/43097] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 12:02:55,439 DEBUG [Listener at localhost/43097] util.CommonFSUtils(702): |----------------testWithMapReduce=75beec9f46c90b3722fafa385b8aee48-97a521d6225d4655994ba1bf8590c07e 2023-02-09 12:02:55,439 DEBUG [Listener at localhost/43097] util.CommonFSUtils(699): |----------adba5c7dd8af5a32d17e2e2d2835e54e/ 2023-02-09 12:02:55,440 DEBUG [Listener at localhost/43097] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 12:02:55,440 DEBUG [Listener at localhost/43097] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 12:02:55,440 DEBUG [Listener at localhost/43097] util.CommonFSUtils(702): |----------------testWithMapReduce=adba5c7dd8af5a32d17e2e2d2835e54e-a084e8fd09f445e59bfc1b89e81d0b11 2023-02-09 12:02:55,440 DEBUG [Listener at localhost/43097] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 12:02:55,441 DEBUG [Listener at localhost/43097] util.CommonFSUtils(702): |----------------testWithMapReduce=adba5c7dd8af5a32d17e2e2d2835e54e-50653eed597a464a85814d050a6a5c7f 2023-02-09 12:02:55,441 DEBUG [Listener at localhost/43097] util.CommonFSUtils(699): |----------e512e42931aafc627ee7181cbf9052ca/ 2023-02-09 12:02:55,441 DEBUG [Listener at localhost/43097] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 12:02:55,441 DEBUG [Listener at localhost/43097] util.CommonFSUtils(699): |----------f19add4d5d04210e250b8c75220e32c6/ 2023-02-09 12:02:55,442 DEBUG [Listener at localhost/43097] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 12:02:55,442 DEBUG [Listener at localhost/43097] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 12:02:55,442 DEBUG [Listener at localhost/43097] util.CommonFSUtils(702): |----------------testWithMapReduce=f19add4d5d04210e250b8c75220e32c6-65a3e5c9e0254e4bbeca68e2805638e4 2023-02-09 12:02:55,443 DEBUG [Listener at localhost/43097] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 12:02:55,443 DEBUG [Listener at localhost/43097] util.CommonFSUtils(702): |----------------testWithMapReduce=f19add4d5d04210e250b8c75220e32c6-f72e68df43834ffebeb550b8fe94765b 2023-02-09 12:02:55,443 DEBUG [Listener at localhost/43097] util.CommonFSUtils(699): |----------f1f03c1ee1ed10fc02a07432990a8ea4/ 2023-02-09 12:02:55,444 DEBUG [Listener at localhost/43097] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 12:02:55,444 DEBUG [Listener at localhost/43097] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 12:02:55,444 DEBUG [Listener at localhost/43097] util.CommonFSUtils(702): |----------------testWithMapReduce=f1f03c1ee1ed10fc02a07432990a8ea4-5c6372329cd54a32ac08ca9a1a624522 2023-02-09 12:02:55,444 DEBUG [Listener at localhost/43097] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 12:02:55,445 DEBUG [Listener at localhost/43097] util.CommonFSUtils(702): |----------------testWithMapReduce=f1f03c1ee1ed10fc02a07432990a8ea4-5c120a6693bd48058f8f2173425c5955 2023-02-09 12:02:55,454 DEBUG [Listener at localhost/43097] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-09 12:02:55,455 DEBUG [Listener at localhost/43097] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-09 12:02:55,455 DEBUG [Listener at localhost/43097] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-09 12:02:55,456 DEBUG [Listener at localhost/43097] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-09 12:02:55,456 DEBUG [Listener at localhost/43097] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.17-SNAPSHOT.jar 2023-02-09 12:02:55,457 DEBUG [Listener at localhost/43097] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-09 12:02:55,457 DEBUG [Listener at localhost/43097] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-09 12:02:55,526 DEBUG [Listener at localhost/43097] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30ca3dca-f74a-9aa7-fe8b-05af2eaef0f9/hadoop-8960461063019667623.jar 2023-02-09 12:02:55,527 DEBUG [Listener at localhost/43097] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-09 12:02:55,527 DEBUG [Listener at localhost/43097] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-09 12:02:55,528 DEBUG [Listener at localhost/43097] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-09 12:02:55,528 DEBUG [Listener at localhost/43097] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-09 12:02:55,529 DEBUG [Listener at localhost/43097] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-09 12:02:55,529 DEBUG [Listener at localhost/43097] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-09 12:02:55,530 DEBUG [Listener at localhost/43097] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-09 12:02:55,530 DEBUG [Listener at localhost/43097] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-09 12:02:55,531 DEBUG [Listener at localhost/43097] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-09 12:02:55,531 DEBUG [Listener at localhost/43097] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-09 12:02:55,531 DEBUG [Listener at localhost/43097] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-09 12:02:55,532 DEBUG [Listener at localhost/43097] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-09 12:02:55,533 DEBUG [Listener at localhost/43097] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-09 12:02:55,533 DEBUG [Listener at localhost/43097] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-09 12:02:55,533 DEBUG [Listener at localhost/43097] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-09 12:02:55,534 DEBUG [Listener at localhost/43097] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-09 12:02:55,539 DEBUG [Listener at localhost/43097] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-09 12:02:55,540 DEBUG [Listener at localhost/43097] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-09 12:02:55,540 DEBUG [Listener at localhost/43097] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-09 12:02:55,540 DEBUG [Listener at localhost/43097] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-09 12:02:55,541 DEBUG [Listener at localhost/43097] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-09 12:02:55,609 DEBUG [Listener at localhost/43097] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30ca3dca-f74a-9aa7-fe8b-05af2eaef0f9/hadoop-7008299453245990253.jar 2023-02-09 12:02:55,610 DEBUG [Listener at localhost/43097] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-09 12:02:55,670 WARN [Listener at localhost/43097] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-09 12:02:55,726 INFO [Listener at localhost/43097] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-09 12:02:55,985 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-09 12:02:55,986 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-02-09 12:02:56,120 WARN [Listener at localhost/43097] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30ca3dca-f74a-9aa7-fe8b-05af2eaef0f9/mapreduce.cluster.local.dir/1675944176028/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-09 12:02:56,121 WARN [Listener at localhost/43097] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30ca3dca-f74a-9aa7-fe8b-05af2eaef0f9/mapreduce.cluster.local.dir/1675944176028/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-09 12:02:56,306 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1675944170049.02975433f68555b44244543d329054e2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:02:56,306 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 12:02:56,308 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 12:02:56,310 INFO [StoreOpener-02975433f68555b44244543d329054e2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 02975433f68555b44244543d329054e2 2023-02-09 12:02:56,311 DEBUG [StoreOpener-02975433f68555b44244543d329054e2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35113/user/jenkins/test-data/2cbb219e-33e2-6152-83c4-a0d89c239a73/testWithMapReduceMultiRegion/05832a5c-06eb-4032-9726-a19277ab0002/data/default/testWithMapReduce/02975433f68555b44244543d329054e2/f1 2023-02-09 12:02:56,312 INFO [StoreOpener-02975433f68555b44244543d329054e2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 02975433f68555b44244543d329054e2 columnFamilyName f1 2023-02-09 12:02:56,321 DEBUG [StoreOpener-02975433f68555b44244543d329054e2-1] regionserver.HStore(539): loaded hdfs://localhost:35113/user/jenkins/test-data/2cbb219e-33e2-6152-83c4-a0d89c239a73/testWithMapReduceMultiRegion/05832a5c-06eb-4032-9726-a19277ab0002/data/default/testWithMapReduce/02975433f68555b44244543d329054e2/f1/testWithMapReduce=02975433f68555b44244543d329054e2-551319def28a4552a6d0c710acefebfe 2023-02-09 12:02:56,322 INFO [StoreOpener-02975433f68555b44244543d329054e2-1] regionserver.HStore(310): Store=02975433f68555b44244543d329054e2/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:02:56,322 INFO [StoreOpener-02975433f68555b44244543d329054e2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 02975433f68555b44244543d329054e2 2023-02-09 12:02:56,323 DEBUG [StoreOpener-02975433f68555b44244543d329054e2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35113/user/jenkins/test-data/2cbb219e-33e2-6152-83c4-a0d89c239a73/testWithMapReduceMultiRegion/05832a5c-06eb-4032-9726-a19277ab0002/data/default/testWithMapReduce/02975433f68555b44244543d329054e2/f2 2023-02-09 12:02:56,324 INFO [StoreOpener-02975433f68555b44244543d329054e2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 02975433f68555b44244543d329054e2 columnFamilyName f2 2023-02-09 12:02:56,331 DEBUG [StoreOpener-02975433f68555b44244543d329054e2-1] regionserver.HStore(539): loaded hdfs://localhost:35113/user/jenkins/test-data/2cbb219e-33e2-6152-83c4-a0d89c239a73/testWithMapReduceMultiRegion/05832a5c-06eb-4032-9726-a19277ab0002/data/default/testWithMapReduce/02975433f68555b44244543d329054e2/f2/testWithMapReduce=02975433f68555b44244543d329054e2-df9930806411417aa95ccf7fcaa3fad3 2023-02-09 12:02:56,332 INFO [StoreOpener-02975433f68555b44244543d329054e2-1] regionserver.HStore(310): Store=02975433f68555b44244543d329054e2/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:02:56,332 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 12:02:56,332 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 02975433f68555b44244543d329054e2; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62298965, jitterRate=-0.07167308032512665}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 12:02:56,332 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 02975433f68555b44244543d329054e2: Writing region info on filesystem at 1675944176308Initializing all the Stores at 1675944176309 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944176309Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944176309Region opened successfully at 1675944176332 (+23 ms) 2023-02-09 12:02:56,520 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 02975433f68555b44244543d329054e2, disabling compactions & flushes 2023-02-09 12:02:56,521 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1675944170049.02975433f68555b44244543d329054e2. 2023-02-09 12:02:56,521 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1675944170049.02975433f68555b44244543d329054e2. 2023-02-09 12:02:56,521 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1675944170049.02975433f68555b44244543d329054e2. after waiting 0 ms 2023-02-09 12:02:56,521 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1675944170049.02975433f68555b44244543d329054e2. 2023-02-09 12:02:56,525 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1675944170049.02975433f68555b44244543d329054e2. 2023-02-09 12:02:56,525 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 02975433f68555b44244543d329054e2: Waiting for close lock at 1675944176520Disabling compacts and flushes for region at 1675944176520Disabling writes for close at 1675944176521 (+1 ms)Writing region close event to WAL at 1675944176525 (+4 ms)Closed at 1675944176525 2023-02-09 12:02:56,540 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1675944170049.6a2f68f435ddf37944e60450e130d0c8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:02:56,540 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 12:02:56,541 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 12:02:56,543 INFO [StoreOpener-6a2f68f435ddf37944e60450e130d0c8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 6a2f68f435ddf37944e60450e130d0c8 2023-02-09 12:02:56,545 DEBUG [StoreOpener-6a2f68f435ddf37944e60450e130d0c8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35113/user/jenkins/test-data/2cbb219e-33e2-6152-83c4-a0d89c239a73/testWithMapReduceMultiRegion/05832a5c-06eb-4032-9726-a19277ab0002/data/default/testWithMapReduce/6a2f68f435ddf37944e60450e130d0c8/f1 2023-02-09 12:02:56,545 INFO [StoreOpener-6a2f68f435ddf37944e60450e130d0c8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6a2f68f435ddf37944e60450e130d0c8 columnFamilyName f1 2023-02-09 12:02:56,553 DEBUG [StoreOpener-6a2f68f435ddf37944e60450e130d0c8-1] regionserver.HStore(539): loaded hdfs://localhost:35113/user/jenkins/test-data/2cbb219e-33e2-6152-83c4-a0d89c239a73/testWithMapReduceMultiRegion/05832a5c-06eb-4032-9726-a19277ab0002/data/default/testWithMapReduce/6a2f68f435ddf37944e60450e130d0c8/f1/testWithMapReduce=6a2f68f435ddf37944e60450e130d0c8-3350840e232c489ba5a959075b03152a 2023-02-09 12:02:56,553 INFO [StoreOpener-6a2f68f435ddf37944e60450e130d0c8-1] regionserver.HStore(310): Store=6a2f68f435ddf37944e60450e130d0c8/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:02:56,553 INFO [StoreOpener-6a2f68f435ddf37944e60450e130d0c8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 6a2f68f435ddf37944e60450e130d0c8 2023-02-09 12:02:56,554 DEBUG [StoreOpener-6a2f68f435ddf37944e60450e130d0c8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35113/user/jenkins/test-data/2cbb219e-33e2-6152-83c4-a0d89c239a73/testWithMapReduceMultiRegion/05832a5c-06eb-4032-9726-a19277ab0002/data/default/testWithMapReduce/6a2f68f435ddf37944e60450e130d0c8/f2 2023-02-09 12:02:56,555 INFO [StoreOpener-6a2f68f435ddf37944e60450e130d0c8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6a2f68f435ddf37944e60450e130d0c8 columnFamilyName f2 2023-02-09 12:02:56,562 DEBUG [StoreOpener-6a2f68f435ddf37944e60450e130d0c8-1] regionserver.HStore(539): loaded hdfs://localhost:35113/user/jenkins/test-data/2cbb219e-33e2-6152-83c4-a0d89c239a73/testWithMapReduceMultiRegion/05832a5c-06eb-4032-9726-a19277ab0002/data/default/testWithMapReduce/6a2f68f435ddf37944e60450e130d0c8/f2/testWithMapReduce=6a2f68f435ddf37944e60450e130d0c8-380b460b7a9d496b902307e6f7329707 2023-02-09 12:02:56,562 INFO [StoreOpener-6a2f68f435ddf37944e60450e130d0c8-1] regionserver.HStore(310): Store=6a2f68f435ddf37944e60450e130d0c8/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:02:56,563 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 12:02:56,563 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 6a2f68f435ddf37944e60450e130d0c8; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70656925, jitterRate=0.05287022888660431}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 12:02:56,563 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 6a2f68f435ddf37944e60450e130d0c8: Writing region info on filesystem at 1675944176541Initializing all the Stores at 1675944176543 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944176543Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944176543Region opened successfully at 1675944176563 (+20 ms) 2023-02-09 12:02:56,611 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 6a2f68f435ddf37944e60450e130d0c8, disabling compactions & flushes 2023-02-09 12:02:56,611 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1675944170049.6a2f68f435ddf37944e60450e130d0c8. 2023-02-09 12:02:56,611 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1675944170049.6a2f68f435ddf37944e60450e130d0c8. 2023-02-09 12:02:56,611 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1675944170049.6a2f68f435ddf37944e60450e130d0c8. after waiting 0 ms 2023-02-09 12:02:56,611 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1675944170049.6a2f68f435ddf37944e60450e130d0c8. 2023-02-09 12:02:56,615 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1675944170049.6a2f68f435ddf37944e60450e130d0c8. 2023-02-09 12:02:56,615 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 6a2f68f435ddf37944e60450e130d0c8: Waiting for close lock at 1675944176611Disabling compacts and flushes for region at 1675944176611Disabling writes for close at 1675944176611Writing region close event to WAL at 1675944176615 (+4 ms)Closed at 1675944176615 2023-02-09 12:02:56,619 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1675944170049.05dd22401f19bc665866ffe134bc07ee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:02:56,619 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 12:02:56,621 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 12:02:56,624 INFO [StoreOpener-05dd22401f19bc665866ffe134bc07ee-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 05dd22401f19bc665866ffe134bc07ee 2023-02-09 12:02:56,625 DEBUG [StoreOpener-05dd22401f19bc665866ffe134bc07ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35113/user/jenkins/test-data/2cbb219e-33e2-6152-83c4-a0d89c239a73/testWithMapReduceMultiRegion/05832a5c-06eb-4032-9726-a19277ab0002/data/default/testWithMapReduce/05dd22401f19bc665866ffe134bc07ee/f1 2023-02-09 12:02:56,625 INFO [StoreOpener-05dd22401f19bc665866ffe134bc07ee-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 05dd22401f19bc665866ffe134bc07ee columnFamilyName f1 2023-02-09 12:02:56,634 DEBUG [StoreOpener-05dd22401f19bc665866ffe134bc07ee-1] regionserver.HStore(539): loaded hdfs://localhost:35113/user/jenkins/test-data/2cbb219e-33e2-6152-83c4-a0d89c239a73/testWithMapReduceMultiRegion/05832a5c-06eb-4032-9726-a19277ab0002/data/default/testWithMapReduce/05dd22401f19bc665866ffe134bc07ee/f1/testWithMapReduce=05dd22401f19bc665866ffe134bc07ee-7fdf9ea615c249c3a8844b1812d071e3 2023-02-09 12:02:56,634 INFO [StoreOpener-05dd22401f19bc665866ffe134bc07ee-1] regionserver.HStore(310): Store=05dd22401f19bc665866ffe134bc07ee/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:02:56,635 INFO [StoreOpener-05dd22401f19bc665866ffe134bc07ee-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 05dd22401f19bc665866ffe134bc07ee 2023-02-09 12:02:56,636 DEBUG [StoreOpener-05dd22401f19bc665866ffe134bc07ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35113/user/jenkins/test-data/2cbb219e-33e2-6152-83c4-a0d89c239a73/testWithMapReduceMultiRegion/05832a5c-06eb-4032-9726-a19277ab0002/data/default/testWithMapReduce/05dd22401f19bc665866ffe134bc07ee/f2 2023-02-09 12:02:56,636 INFO [StoreOpener-05dd22401f19bc665866ffe134bc07ee-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 05dd22401f19bc665866ffe134bc07ee columnFamilyName f2 2023-02-09 12:02:56,644 DEBUG [StoreOpener-05dd22401f19bc665866ffe134bc07ee-1] regionserver.HStore(539): loaded hdfs://localhost:35113/user/jenkins/test-data/2cbb219e-33e2-6152-83c4-a0d89c239a73/testWithMapReduceMultiRegion/05832a5c-06eb-4032-9726-a19277ab0002/data/default/testWithMapReduce/05dd22401f19bc665866ffe134bc07ee/f2/testWithMapReduce=05dd22401f19bc665866ffe134bc07ee-d21974d0b35d46d3a6a87b58f11d40e7 2023-02-09 12:02:56,645 INFO [StoreOpener-05dd22401f19bc665866ffe134bc07ee-1] regionserver.HStore(310): Store=05dd22401f19bc665866ffe134bc07ee/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:02:56,645 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 12:02:56,645 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 05dd22401f19bc665866ffe134bc07ee; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60182584, jitterRate=-0.10320961475372314}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 12:02:56,645 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 05dd22401f19bc665866ffe134bc07ee: Writing region info on filesystem at 1675944176622Initializing all the Stores at 1675944176623 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944176623Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944176623Region opened successfully at 1675944176645 (+22 ms) 2023-02-09 12:02:56,687 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 05dd22401f19bc665866ffe134bc07ee, disabling compactions & flushes 2023-02-09 12:02:56,687 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1675944170049.05dd22401f19bc665866ffe134bc07ee. 2023-02-09 12:02:56,687 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1675944170049.05dd22401f19bc665866ffe134bc07ee. 2023-02-09 12:02:56,687 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1675944170049.05dd22401f19bc665866ffe134bc07ee. after waiting 0 ms 2023-02-09 12:02:56,687 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1675944170049.05dd22401f19bc665866ffe134bc07ee. 2023-02-09 12:02:56,691 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1675944170049.05dd22401f19bc665866ffe134bc07ee. 2023-02-09 12:02:56,691 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 05dd22401f19bc665866ffe134bc07ee: Waiting for close lock at 1675944176687Disabling compacts and flushes for region at 1675944176687Disabling writes for close at 1675944176687Writing region close event to WAL at 1675944176691 (+4 ms)Closed at 1675944176691 2023-02-09 12:02:56,696 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1675944170049.75beec9f46c90b3722fafa385b8aee48.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:02:56,696 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 12:02:56,700 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 12:02:56,702 INFO [StoreOpener-75beec9f46c90b3722fafa385b8aee48-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 75beec9f46c90b3722fafa385b8aee48 2023-02-09 12:02:56,703 DEBUG [StoreOpener-75beec9f46c90b3722fafa385b8aee48-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35113/user/jenkins/test-data/2cbb219e-33e2-6152-83c4-a0d89c239a73/testWithMapReduceMultiRegion/05832a5c-06eb-4032-9726-a19277ab0002/data/default/testWithMapReduce/75beec9f46c90b3722fafa385b8aee48/f1 2023-02-09 12:02:56,703 INFO [StoreOpener-75beec9f46c90b3722fafa385b8aee48-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 75beec9f46c90b3722fafa385b8aee48 columnFamilyName f1 2023-02-09 12:02:56,713 DEBUG [StoreOpener-75beec9f46c90b3722fafa385b8aee48-1] regionserver.HStore(539): loaded hdfs://localhost:35113/user/jenkins/test-data/2cbb219e-33e2-6152-83c4-a0d89c239a73/testWithMapReduceMultiRegion/05832a5c-06eb-4032-9726-a19277ab0002/data/default/testWithMapReduce/75beec9f46c90b3722fafa385b8aee48/f1/testWithMapReduce=75beec9f46c90b3722fafa385b8aee48-6a1feb2b02ae4a1fb7e2b035b748873d 2023-02-09 12:02:56,714 INFO [StoreOpener-75beec9f46c90b3722fafa385b8aee48-1] regionserver.HStore(310): Store=75beec9f46c90b3722fafa385b8aee48/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:02:56,714 INFO [StoreOpener-75beec9f46c90b3722fafa385b8aee48-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 75beec9f46c90b3722fafa385b8aee48 2023-02-09 12:02:56,715 DEBUG [StoreOpener-75beec9f46c90b3722fafa385b8aee48-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35113/user/jenkins/test-data/2cbb219e-33e2-6152-83c4-a0d89c239a73/testWithMapReduceMultiRegion/05832a5c-06eb-4032-9726-a19277ab0002/data/default/testWithMapReduce/75beec9f46c90b3722fafa385b8aee48/f2 2023-02-09 12:02:56,716 INFO [StoreOpener-75beec9f46c90b3722fafa385b8aee48-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 75beec9f46c90b3722fafa385b8aee48 columnFamilyName f2 2023-02-09 12:02:56,726 DEBUG [StoreOpener-75beec9f46c90b3722fafa385b8aee48-1] regionserver.HStore(539): loaded hdfs://localhost:35113/user/jenkins/test-data/2cbb219e-33e2-6152-83c4-a0d89c239a73/testWithMapReduceMultiRegion/05832a5c-06eb-4032-9726-a19277ab0002/data/default/testWithMapReduce/75beec9f46c90b3722fafa385b8aee48/f2/testWithMapReduce=75beec9f46c90b3722fafa385b8aee48-97a521d6225d4655994ba1bf8590c07e 2023-02-09 12:02:56,726 INFO [StoreOpener-75beec9f46c90b3722fafa385b8aee48-1] regionserver.HStore(310): Store=75beec9f46c90b3722fafa385b8aee48/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:02:56,726 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 12:02:56,726 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 75beec9f46c90b3722fafa385b8aee48; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65613817, jitterRate=-0.022277936339378357}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 12:02:56,726 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 75beec9f46c90b3722fafa385b8aee48: Writing region info on filesystem at 1675944176700Initializing all the Stores at 1675944176701 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944176701Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944176701Region opened successfully at 1675944176726 (+25 ms) 2023-02-09 12:02:56,769 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 75beec9f46c90b3722fafa385b8aee48, disabling compactions & flushes 2023-02-09 12:02:56,769 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1675944170049.75beec9f46c90b3722fafa385b8aee48. 2023-02-09 12:02:56,769 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1675944170049.75beec9f46c90b3722fafa385b8aee48. 2023-02-09 12:02:56,770 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1675944170049.75beec9f46c90b3722fafa385b8aee48. after waiting 0 ms 2023-02-09 12:02:56,770 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1675944170049.75beec9f46c90b3722fafa385b8aee48. 2023-02-09 12:02:56,773 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1675944170049.75beec9f46c90b3722fafa385b8aee48. 2023-02-09 12:02:56,773 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 75beec9f46c90b3722fafa385b8aee48: Waiting for close lock at 1675944176769Disabling compacts and flushes for region at 1675944176769Disabling writes for close at 1675944176770 (+1 ms)Writing region close event to WAL at 1675944176773 (+3 ms)Closed at 1675944176773 2023-02-09 12:02:56,779 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1675944170049.65a3da3364c26109bbe03b4e408b5d95.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:02:56,779 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 12:02:56,784 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 12:02:56,788 INFO [StoreOpener-65a3da3364c26109bbe03b4e408b5d95-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 65a3da3364c26109bbe03b4e408b5d95 2023-02-09 12:02:56,790 DEBUG [StoreOpener-65a3da3364c26109bbe03b4e408b5d95-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35113/user/jenkins/test-data/2cbb219e-33e2-6152-83c4-a0d89c239a73/testWithMapReduceMultiRegion/05832a5c-06eb-4032-9726-a19277ab0002/data/default/testWithMapReduce/65a3da3364c26109bbe03b4e408b5d95/f1 2023-02-09 12:02:56,791 INFO [StoreOpener-65a3da3364c26109bbe03b4e408b5d95-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 65a3da3364c26109bbe03b4e408b5d95 columnFamilyName f1 2023-02-09 12:02:56,791 INFO [StoreOpener-65a3da3364c26109bbe03b4e408b5d95-1] regionserver.HStore(310): Store=65a3da3364c26109bbe03b4e408b5d95/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:02:56,791 INFO [StoreOpener-65a3da3364c26109bbe03b4e408b5d95-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 65a3da3364c26109bbe03b4e408b5d95 2023-02-09 12:02:56,793 DEBUG [StoreOpener-65a3da3364c26109bbe03b4e408b5d95-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35113/user/jenkins/test-data/2cbb219e-33e2-6152-83c4-a0d89c239a73/testWithMapReduceMultiRegion/05832a5c-06eb-4032-9726-a19277ab0002/data/default/testWithMapReduce/65a3da3364c26109bbe03b4e408b5d95/f2 2023-02-09 12:02:56,793 INFO [StoreOpener-65a3da3364c26109bbe03b4e408b5d95-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 65a3da3364c26109bbe03b4e408b5d95 columnFamilyName f2 2023-02-09 12:02:56,794 INFO [StoreOpener-65a3da3364c26109bbe03b4e408b5d95-1] regionserver.HStore(310): Store=65a3da3364c26109bbe03b4e408b5d95/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:02:56,794 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 12:02:56,794 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 65a3da3364c26109bbe03b4e408b5d95; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65937995, jitterRate=-0.01744730770587921}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 12:02:56,794 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 65a3da3364c26109bbe03b4e408b5d95: Writing region info on filesystem at 1675944176785Initializing all the Stores at 1675944176786 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944176786Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944176788 (+2 ms)Region opened successfully at 1675944176794 (+6 ms) 2023-02-09 12:02:56,832 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 65a3da3364c26109bbe03b4e408b5d95, disabling compactions & flushes 2023-02-09 12:02:56,832 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1675944170049.65a3da3364c26109bbe03b4e408b5d95. 2023-02-09 12:02:56,832 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1675944170049.65a3da3364c26109bbe03b4e408b5d95. 2023-02-09 12:02:56,833 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1675944170049.65a3da3364c26109bbe03b4e408b5d95. after waiting 0 ms 2023-02-09 12:02:56,833 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1675944170049.65a3da3364c26109bbe03b4e408b5d95. 2023-02-09 12:02:56,833 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1675944170049.65a3da3364c26109bbe03b4e408b5d95. 2023-02-09 12:02:56,833 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 65a3da3364c26109bbe03b4e408b5d95: Waiting for close lock at 1675944176832Disabling compacts and flushes for region at 1675944176832Disabling writes for close at 1675944176833 (+1 ms)Writing region close event to WAL at 1675944176833Closed at 1675944176833 2023-02-09 12:02:56,839 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1675944170049.adba5c7dd8af5a32d17e2e2d2835e54e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:02:56,839 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 12:02:56,840 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 12:02:56,843 INFO [StoreOpener-adba5c7dd8af5a32d17e2e2d2835e54e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region adba5c7dd8af5a32d17e2e2d2835e54e 2023-02-09 12:02:56,844 DEBUG [StoreOpener-adba5c7dd8af5a32d17e2e2d2835e54e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35113/user/jenkins/test-data/2cbb219e-33e2-6152-83c4-a0d89c239a73/testWithMapReduceMultiRegion/05832a5c-06eb-4032-9726-a19277ab0002/data/default/testWithMapReduce/adba5c7dd8af5a32d17e2e2d2835e54e/f1 2023-02-09 12:02:56,845 INFO [StoreOpener-adba5c7dd8af5a32d17e2e2d2835e54e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region adba5c7dd8af5a32d17e2e2d2835e54e columnFamilyName f1 2023-02-09 12:02:56,851 DEBUG [StoreOpener-adba5c7dd8af5a32d17e2e2d2835e54e-1] regionserver.HStore(539): loaded hdfs://localhost:35113/user/jenkins/test-data/2cbb219e-33e2-6152-83c4-a0d89c239a73/testWithMapReduceMultiRegion/05832a5c-06eb-4032-9726-a19277ab0002/data/default/testWithMapReduce/adba5c7dd8af5a32d17e2e2d2835e54e/f1/testWithMapReduce=adba5c7dd8af5a32d17e2e2d2835e54e-a084e8fd09f445e59bfc1b89e81d0b11 2023-02-09 12:02:56,851 INFO [StoreOpener-adba5c7dd8af5a32d17e2e2d2835e54e-1] regionserver.HStore(310): Store=adba5c7dd8af5a32d17e2e2d2835e54e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:02:56,852 INFO [StoreOpener-adba5c7dd8af5a32d17e2e2d2835e54e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region adba5c7dd8af5a32d17e2e2d2835e54e 2023-02-09 12:02:56,853 DEBUG [StoreOpener-adba5c7dd8af5a32d17e2e2d2835e54e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35113/user/jenkins/test-data/2cbb219e-33e2-6152-83c4-a0d89c239a73/testWithMapReduceMultiRegion/05832a5c-06eb-4032-9726-a19277ab0002/data/default/testWithMapReduce/adba5c7dd8af5a32d17e2e2d2835e54e/f2 2023-02-09 12:02:56,853 INFO [StoreOpener-adba5c7dd8af5a32d17e2e2d2835e54e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region adba5c7dd8af5a32d17e2e2d2835e54e columnFamilyName f2 2023-02-09 12:02:56,862 DEBUG [StoreOpener-adba5c7dd8af5a32d17e2e2d2835e54e-1] regionserver.HStore(539): loaded hdfs://localhost:35113/user/jenkins/test-data/2cbb219e-33e2-6152-83c4-a0d89c239a73/testWithMapReduceMultiRegion/05832a5c-06eb-4032-9726-a19277ab0002/data/default/testWithMapReduce/adba5c7dd8af5a32d17e2e2d2835e54e/f2/testWithMapReduce=adba5c7dd8af5a32d17e2e2d2835e54e-50653eed597a464a85814d050a6a5c7f 2023-02-09 12:02:56,862 INFO [StoreOpener-adba5c7dd8af5a32d17e2e2d2835e54e-1] regionserver.HStore(310): Store=adba5c7dd8af5a32d17e2e2d2835e54e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:02:56,862 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 12:02:56,862 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened adba5c7dd8af5a32d17e2e2d2835e54e; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64214723, jitterRate=-0.04312606155872345}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 12:02:56,862 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for adba5c7dd8af5a32d17e2e2d2835e54e: Writing region info on filesystem at 1675944176840Initializing all the Stores at 1675944176842 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944176842Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944176843 (+1 ms)Region opened successfully at 1675944176862 (+19 ms) 2023-02-09 12:02:56,998 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing adba5c7dd8af5a32d17e2e2d2835e54e, disabling compactions & flushes 2023-02-09 12:02:56,998 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1675944170049.adba5c7dd8af5a32d17e2e2d2835e54e. 2023-02-09 12:02:56,998 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1675944170049.adba5c7dd8af5a32d17e2e2d2835e54e. 2023-02-09 12:02:56,998 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1675944170049.adba5c7dd8af5a32d17e2e2d2835e54e. after waiting 0 ms 2023-02-09 12:02:56,998 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1675944170049.adba5c7dd8af5a32d17e2e2d2835e54e. 2023-02-09 12:02:57,004 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1675944170049.adba5c7dd8af5a32d17e2e2d2835e54e. 2023-02-09 12:02:57,005 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for adba5c7dd8af5a32d17e2e2d2835e54e: Waiting for close lock at 1675944176998Disabling compacts and flushes for region at 1675944176998Disabling writes for close at 1675944176998Writing region close event to WAL at 1675944177004 (+6 ms)Closed at 1675944177004 2023-02-09 12:02:57,010 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1675944170049.4a3fbf78e913c39c9306810357f4e73f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:02:57,010 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 12:02:57,013 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 12:02:57,015 INFO [StoreOpener-4a3fbf78e913c39c9306810357f4e73f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4a3fbf78e913c39c9306810357f4e73f 2023-02-09 12:02:57,016 DEBUG [StoreOpener-4a3fbf78e913c39c9306810357f4e73f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35113/user/jenkins/test-data/2cbb219e-33e2-6152-83c4-a0d89c239a73/testWithMapReduceMultiRegion/05832a5c-06eb-4032-9726-a19277ab0002/data/default/testWithMapReduce/4a3fbf78e913c39c9306810357f4e73f/f1 2023-02-09 12:02:57,017 INFO [StoreOpener-4a3fbf78e913c39c9306810357f4e73f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4a3fbf78e913c39c9306810357f4e73f columnFamilyName f1 2023-02-09 12:02:57,023 DEBUG [StoreOpener-4a3fbf78e913c39c9306810357f4e73f-1] regionserver.HStore(539): loaded hdfs://localhost:35113/user/jenkins/test-data/2cbb219e-33e2-6152-83c4-a0d89c239a73/testWithMapReduceMultiRegion/05832a5c-06eb-4032-9726-a19277ab0002/data/default/testWithMapReduce/4a3fbf78e913c39c9306810357f4e73f/f1/testWithMapReduce=4a3fbf78e913c39c9306810357f4e73f-dbe67ba683384bc9984c20ac38b3243c 2023-02-09 12:02:57,023 INFO [StoreOpener-4a3fbf78e913c39c9306810357f4e73f-1] regionserver.HStore(310): Store=4a3fbf78e913c39c9306810357f4e73f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:02:57,023 INFO [StoreOpener-4a3fbf78e913c39c9306810357f4e73f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4a3fbf78e913c39c9306810357f4e73f 2023-02-09 12:02:57,024 DEBUG [StoreOpener-4a3fbf78e913c39c9306810357f4e73f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35113/user/jenkins/test-data/2cbb219e-33e2-6152-83c4-a0d89c239a73/testWithMapReduceMultiRegion/05832a5c-06eb-4032-9726-a19277ab0002/data/default/testWithMapReduce/4a3fbf78e913c39c9306810357f4e73f/f2 2023-02-09 12:02:57,025 INFO [StoreOpener-4a3fbf78e913c39c9306810357f4e73f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4a3fbf78e913c39c9306810357f4e73f columnFamilyName f2 2023-02-09 12:02:57,033 DEBUG [StoreOpener-4a3fbf78e913c39c9306810357f4e73f-1] regionserver.HStore(539): loaded hdfs://localhost:35113/user/jenkins/test-data/2cbb219e-33e2-6152-83c4-a0d89c239a73/testWithMapReduceMultiRegion/05832a5c-06eb-4032-9726-a19277ab0002/data/default/testWithMapReduce/4a3fbf78e913c39c9306810357f4e73f/f2/testWithMapReduce=4a3fbf78e913c39c9306810357f4e73f-a042eb4ebaaf4e2d82e2c393b2110152 2023-02-09 12:02:57,033 INFO [StoreOpener-4a3fbf78e913c39c9306810357f4e73f-1] regionserver.HStore(310): Store=4a3fbf78e913c39c9306810357f4e73f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:02:57,033 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 12:02:57,033 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 4a3fbf78e913c39c9306810357f4e73f; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60624116, jitterRate=-0.0966302752494812}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 12:02:57,033 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 4a3fbf78e913c39c9306810357f4e73f: Writing region info on filesystem at 1675944177013Initializing all the Stores at 1675944177014 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944177014Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944177014Region opened successfully at 1675944177033 (+19 ms) 2023-02-09 12:02:57,071 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 4a3fbf78e913c39c9306810357f4e73f, disabling compactions & flushes 2023-02-09 12:02:57,071 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1675944170049.4a3fbf78e913c39c9306810357f4e73f. 2023-02-09 12:02:57,071 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1675944170049.4a3fbf78e913c39c9306810357f4e73f. 2023-02-09 12:02:57,071 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1675944170049.4a3fbf78e913c39c9306810357f4e73f. after waiting 0 ms 2023-02-09 12:02:57,071 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1675944170049.4a3fbf78e913c39c9306810357f4e73f. 2023-02-09 12:02:57,075 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1675944170049.4a3fbf78e913c39c9306810357f4e73f. 2023-02-09 12:02:57,076 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 4a3fbf78e913c39c9306810357f4e73f: Waiting for close lock at 1675944177071Disabling compacts and flushes for region at 1675944177071Disabling writes for close at 1675944177071Writing region close event to WAL at 1675944177075 (+4 ms)Closed at 1675944177075 2023-02-09 12:02:57,083 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675944170049.e512e42931aafc627ee7181cbf9052ca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:02:57,083 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 12:02:57,086 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 12:02:57,088 INFO [StoreOpener-e512e42931aafc627ee7181cbf9052ca-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e512e42931aafc627ee7181cbf9052ca 2023-02-09 12:02:57,090 DEBUG [StoreOpener-e512e42931aafc627ee7181cbf9052ca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35113/user/jenkins/test-data/2cbb219e-33e2-6152-83c4-a0d89c239a73/testWithMapReduceMultiRegion/05832a5c-06eb-4032-9726-a19277ab0002/data/default/testWithMapReduce/e512e42931aafc627ee7181cbf9052ca/f1 2023-02-09 12:02:57,090 INFO [StoreOpener-e512e42931aafc627ee7181cbf9052ca-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e512e42931aafc627ee7181cbf9052ca columnFamilyName f1 2023-02-09 12:02:57,091 INFO [StoreOpener-e512e42931aafc627ee7181cbf9052ca-1] regionserver.HStore(310): Store=e512e42931aafc627ee7181cbf9052ca/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:02:57,091 INFO [StoreOpener-e512e42931aafc627ee7181cbf9052ca-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e512e42931aafc627ee7181cbf9052ca 2023-02-09 12:02:57,093 DEBUG [StoreOpener-e512e42931aafc627ee7181cbf9052ca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35113/user/jenkins/test-data/2cbb219e-33e2-6152-83c4-a0d89c239a73/testWithMapReduceMultiRegion/05832a5c-06eb-4032-9726-a19277ab0002/data/default/testWithMapReduce/e512e42931aafc627ee7181cbf9052ca/f2 2023-02-09 12:02:57,093 INFO [StoreOpener-e512e42931aafc627ee7181cbf9052ca-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e512e42931aafc627ee7181cbf9052ca columnFamilyName f2 2023-02-09 12:02:57,094 INFO [StoreOpener-e512e42931aafc627ee7181cbf9052ca-1] regionserver.HStore(310): Store=e512e42931aafc627ee7181cbf9052ca/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:02:57,094 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 12:02:57,094 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened e512e42931aafc627ee7181cbf9052ca; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66288321, jitterRate=-0.012227043509483337}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 12:02:57,094 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for e512e42931aafc627ee7181cbf9052ca: Writing region info on filesystem at 1675944177086Initializing all the Stores at 1675944177087 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944177087Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944177087Region opened successfully at 1675944177094 (+7 ms) 2023-02-09 12:02:57,112 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing e512e42931aafc627ee7181cbf9052ca, disabling compactions & flushes 2023-02-09 12:02:57,112 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675944170049.e512e42931aafc627ee7181cbf9052ca. 2023-02-09 12:02:57,112 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675944170049.e512e42931aafc627ee7181cbf9052ca. 2023-02-09 12:02:57,112 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675944170049.e512e42931aafc627ee7181cbf9052ca. after waiting 0 ms 2023-02-09 12:02:57,112 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675944170049.e512e42931aafc627ee7181cbf9052ca. 2023-02-09 12:02:57,112 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675944170049.e512e42931aafc627ee7181cbf9052ca. 2023-02-09 12:02:57,112 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for e512e42931aafc627ee7181cbf9052ca: Waiting for close lock at 1675944177112Disabling compacts and flushes for region at 1675944177112Disabling writes for close at 1675944177112Writing region close event to WAL at 1675944177112Closed at 1675944177112 2023-02-09 12:02:57,116 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1675944170049.f19add4d5d04210e250b8c75220e32c6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:02:57,116 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 12:02:57,119 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 12:02:57,121 INFO [StoreOpener-f19add4d5d04210e250b8c75220e32c6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f19add4d5d04210e250b8c75220e32c6 2023-02-09 12:02:57,122 DEBUG [StoreOpener-f19add4d5d04210e250b8c75220e32c6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35113/user/jenkins/test-data/2cbb219e-33e2-6152-83c4-a0d89c239a73/testWithMapReduceMultiRegion/05832a5c-06eb-4032-9726-a19277ab0002/data/default/testWithMapReduce/f19add4d5d04210e250b8c75220e32c6/f1 2023-02-09 12:02:57,122 INFO [StoreOpener-f19add4d5d04210e250b8c75220e32c6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f19add4d5d04210e250b8c75220e32c6 columnFamilyName f1 2023-02-09 12:02:57,128 DEBUG [StoreOpener-f19add4d5d04210e250b8c75220e32c6-1] regionserver.HStore(539): loaded hdfs://localhost:35113/user/jenkins/test-data/2cbb219e-33e2-6152-83c4-a0d89c239a73/testWithMapReduceMultiRegion/05832a5c-06eb-4032-9726-a19277ab0002/data/default/testWithMapReduce/f19add4d5d04210e250b8c75220e32c6/f1/testWithMapReduce=f19add4d5d04210e250b8c75220e32c6-65a3e5c9e0254e4bbeca68e2805638e4 2023-02-09 12:02:57,128 INFO [StoreOpener-f19add4d5d04210e250b8c75220e32c6-1] regionserver.HStore(310): Store=f19add4d5d04210e250b8c75220e32c6/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:02:57,128 INFO [StoreOpener-f19add4d5d04210e250b8c75220e32c6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f19add4d5d04210e250b8c75220e32c6 2023-02-09 12:02:57,129 DEBUG [StoreOpener-f19add4d5d04210e250b8c75220e32c6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35113/user/jenkins/test-data/2cbb219e-33e2-6152-83c4-a0d89c239a73/testWithMapReduceMultiRegion/05832a5c-06eb-4032-9726-a19277ab0002/data/default/testWithMapReduce/f19add4d5d04210e250b8c75220e32c6/f2 2023-02-09 12:02:57,130 INFO [StoreOpener-f19add4d5d04210e250b8c75220e32c6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f19add4d5d04210e250b8c75220e32c6 columnFamilyName f2 2023-02-09 12:02:57,135 DEBUG [StoreOpener-f19add4d5d04210e250b8c75220e32c6-1] regionserver.HStore(539): loaded hdfs://localhost:35113/user/jenkins/test-data/2cbb219e-33e2-6152-83c4-a0d89c239a73/testWithMapReduceMultiRegion/05832a5c-06eb-4032-9726-a19277ab0002/data/default/testWithMapReduce/f19add4d5d04210e250b8c75220e32c6/f2/testWithMapReduce=f19add4d5d04210e250b8c75220e32c6-f72e68df43834ffebeb550b8fe94765b 2023-02-09 12:02:57,135 INFO [StoreOpener-f19add4d5d04210e250b8c75220e32c6-1] regionserver.HStore(310): Store=f19add4d5d04210e250b8c75220e32c6/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:02:57,135 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 12:02:57,135 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened f19add4d5d04210e250b8c75220e32c6; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67253269, jitterRate=0.002151802182197571}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 12:02:57,135 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for f19add4d5d04210e250b8c75220e32c6: Writing region info on filesystem at 1675944177119Initializing all the Stores at 1675944177120 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944177120Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944177120Region opened successfully at 1675944177135 (+15 ms) 2023-02-09 12:02:57,166 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing f19add4d5d04210e250b8c75220e32c6, disabling compactions & flushes 2023-02-09 12:02:57,166 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1675944170049.f19add4d5d04210e250b8c75220e32c6. 2023-02-09 12:02:57,166 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1675944170049.f19add4d5d04210e250b8c75220e32c6. 2023-02-09 12:02:57,166 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1675944170049.f19add4d5d04210e250b8c75220e32c6. after waiting 0 ms 2023-02-09 12:02:57,166 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1675944170049.f19add4d5d04210e250b8c75220e32c6. 2023-02-09 12:02:57,169 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1675944170049.f19add4d5d04210e250b8c75220e32c6. 2023-02-09 12:02:57,169 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for f19add4d5d04210e250b8c75220e32c6: Waiting for close lock at 1675944177166Disabling compacts and flushes for region at 1675944177166Disabling writes for close at 1675944177166Writing region close event to WAL at 1675944177169 (+3 ms)Closed at 1675944177169 2023-02-09 12:02:57,173 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1675944170049.f1f03c1ee1ed10fc02a07432990a8ea4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:02:57,173 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 12:02:57,175 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 12:02:57,177 INFO [StoreOpener-f1f03c1ee1ed10fc02a07432990a8ea4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f1f03c1ee1ed10fc02a07432990a8ea4 2023-02-09 12:02:57,177 DEBUG [StoreOpener-f1f03c1ee1ed10fc02a07432990a8ea4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35113/user/jenkins/test-data/2cbb219e-33e2-6152-83c4-a0d89c239a73/testWithMapReduceMultiRegion/05832a5c-06eb-4032-9726-a19277ab0002/data/default/testWithMapReduce/f1f03c1ee1ed10fc02a07432990a8ea4/f1 2023-02-09 12:02:57,178 INFO [StoreOpener-f1f03c1ee1ed10fc02a07432990a8ea4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f1f03c1ee1ed10fc02a07432990a8ea4 columnFamilyName f1 2023-02-09 12:02:57,184 DEBUG [StoreOpener-f1f03c1ee1ed10fc02a07432990a8ea4-1] regionserver.HStore(539): loaded hdfs://localhost:35113/user/jenkins/test-data/2cbb219e-33e2-6152-83c4-a0d89c239a73/testWithMapReduceMultiRegion/05832a5c-06eb-4032-9726-a19277ab0002/data/default/testWithMapReduce/f1f03c1ee1ed10fc02a07432990a8ea4/f1/testWithMapReduce=f1f03c1ee1ed10fc02a07432990a8ea4-5c6372329cd54a32ac08ca9a1a624522 2023-02-09 12:02:57,184 INFO [StoreOpener-f1f03c1ee1ed10fc02a07432990a8ea4-1] regionserver.HStore(310): Store=f1f03c1ee1ed10fc02a07432990a8ea4/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:02:57,184 INFO [StoreOpener-f1f03c1ee1ed10fc02a07432990a8ea4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f1f03c1ee1ed10fc02a07432990a8ea4 2023-02-09 12:02:57,185 DEBUG [StoreOpener-f1f03c1ee1ed10fc02a07432990a8ea4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35113/user/jenkins/test-data/2cbb219e-33e2-6152-83c4-a0d89c239a73/testWithMapReduceMultiRegion/05832a5c-06eb-4032-9726-a19277ab0002/data/default/testWithMapReduce/f1f03c1ee1ed10fc02a07432990a8ea4/f2 2023-02-09 12:02:57,186 INFO [StoreOpener-f1f03c1ee1ed10fc02a07432990a8ea4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f1f03c1ee1ed10fc02a07432990a8ea4 columnFamilyName f2 2023-02-09 12:02:57,191 DEBUG [StoreOpener-f1f03c1ee1ed10fc02a07432990a8ea4-1] regionserver.HStore(539): loaded hdfs://localhost:35113/user/jenkins/test-data/2cbb219e-33e2-6152-83c4-a0d89c239a73/testWithMapReduceMultiRegion/05832a5c-06eb-4032-9726-a19277ab0002/data/default/testWithMapReduce/f1f03c1ee1ed10fc02a07432990a8ea4/f2/testWithMapReduce=f1f03c1ee1ed10fc02a07432990a8ea4-5c120a6693bd48058f8f2173425c5955 2023-02-09 12:02:57,191 INFO [StoreOpener-f1f03c1ee1ed10fc02a07432990a8ea4-1] regionserver.HStore(310): Store=f1f03c1ee1ed10fc02a07432990a8ea4/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:02:57,191 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 12:02:57,192 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened f1f03c1ee1ed10fc02a07432990a8ea4; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73076259, jitterRate=0.08892111480236053}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 12:02:57,192 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for f1f03c1ee1ed10fc02a07432990a8ea4: Writing region info on filesystem at 1675944177175Initializing all the Stores at 1675944177176 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944177176Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944177176Region opened successfully at 1675944177192 (+16 ms) 2023-02-09 12:02:57,222 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing f1f03c1ee1ed10fc02a07432990a8ea4, disabling compactions & flushes 2023-02-09 12:02:57,222 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1675944170049.f1f03c1ee1ed10fc02a07432990a8ea4. 2023-02-09 12:02:57,222 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1675944170049.f1f03c1ee1ed10fc02a07432990a8ea4. 2023-02-09 12:02:57,222 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1675944170049.f1f03c1ee1ed10fc02a07432990a8ea4. after waiting 0 ms 2023-02-09 12:02:57,222 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1675944170049.f1f03c1ee1ed10fc02a07432990a8ea4. 2023-02-09 12:02:57,225 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1675944170049.f1f03c1ee1ed10fc02a07432990a8ea4. 2023-02-09 12:02:57,225 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for f1f03c1ee1ed10fc02a07432990a8ea4: Waiting for close lock at 1675944177222Disabling compacts and flushes for region at 1675944177222Disabling writes for close at 1675944177222Writing region close event to WAL at 1675944177225 (+3 ms)Closed at 1675944177225 2023-02-09 12:02:58,219 INFO [Listener at localhost/43097] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:02:58,219 INFO [Listener at localhost/43097] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:02:58,224 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32779] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMapReduceMultiRegion" 2023-02-09 12:02:58,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32779] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceMultiRegion 2023-02-09 12:02:58,230 INFO [Listener at localhost/43097] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:02:58,230 INFO [Listener at localhost/43097] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:02:58,231 INFO [Listener at localhost/43097] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-09 12:02:58,231 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32779] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-09 12:02:58,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32779] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-09 12:02:58,242 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675944178242"}]},"ts":"1675944178242"} 2023-02-09 12:02:58,243 INFO [Listener at localhost/43097] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:02:58,243 INFO [Listener at localhost/43097] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:02:58,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32779] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-09 12:02:58,245 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-09 12:02:58,247 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-09 12:02:58,250 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=e512e42931aafc627ee7181cbf9052ca, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=f19add4d5d04210e250b8c75220e32c6, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=4a3fbf78e913c39c9306810357f4e73f, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=6a2f68f435ddf37944e60450e130d0c8, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=05dd22401f19bc665866ffe134bc07ee, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=02975433f68555b44244543d329054e2, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=75beec9f46c90b3722fafa385b8aee48, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=f1f03c1ee1ed10fc02a07432990a8ea4, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=adba5c7dd8af5a32d17e2e2d2835e54e, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=65a3da3364c26109bbe03b4e408b5d95, UNASSIGN}] 2023-02-09 12:02:58,253 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=05dd22401f19bc665866ffe134bc07ee, UNASSIGN 2023-02-09 12:02:58,253 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=02975433f68555b44244543d329054e2, UNASSIGN 2023-02-09 12:02:58,253 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=6a2f68f435ddf37944e60450e130d0c8, UNASSIGN 2023-02-09 12:02:58,253 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=4a3fbf78e913c39c9306810357f4e73f, UNASSIGN 2023-02-09 12:02:58,253 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=65a3da3364c26109bbe03b4e408b5d95, UNASSIGN 2023-02-09 12:02:58,255 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=02975433f68555b44244543d329054e2, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40063,1675944167089 2023-02-09 12:02:58,255 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=05dd22401f19bc665866ffe134bc07ee, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43865,1675944167040 2023-02-09 12:02:58,255 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1675944170049.02975433f68555b44244543d329054e2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675944178254"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675944178254"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675944178254"}]},"ts":"1675944178254"} 2023-02-09 12:02:58,255 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=4a3fbf78e913c39c9306810357f4e73f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43865,1675944167040 2023-02-09 12:02:58,255 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=6a2f68f435ddf37944e60450e130d0c8, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40063,1675944167089 2023-02-09 12:02:58,255 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1675944170049.4a3fbf78e913c39c9306810357f4e73f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675944178255"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675944178255"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675944178255"}]},"ts":"1675944178255"} 2023-02-09 12:02:58,255 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1675944170049.05dd22401f19bc665866ffe134bc07ee.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675944178254"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675944178254"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675944178254"}]},"ts":"1675944178254"} 2023-02-09 12:02:58,255 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1675944170049.6a2f68f435ddf37944e60450e130d0c8.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675944178255"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675944178255"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675944178255"}]},"ts":"1675944178255"} 2023-02-09 12:02:58,256 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=65a3da3364c26109bbe03b4e408b5d95, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40063,1675944167089 2023-02-09 12:02:58,256 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1675944170049.65a3da3364c26109bbe03b4e408b5d95.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675944178255"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675944178255"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675944178255"}]},"ts":"1675944178255"} 2023-02-09 12:02:58,257 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=39, state=RUNNABLE; CloseRegionProcedure 02975433f68555b44244543d329054e2, server=jenkins-hbase4.apache.org,40063,1675944167089}] 2023-02-09 12:02:58,259 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=36, state=RUNNABLE; CloseRegionProcedure 4a3fbf78e913c39c9306810357f4e73f, server=jenkins-hbase4.apache.org,43865,1675944167040}] 2023-02-09 12:02:58,260 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=38, state=RUNNABLE; CloseRegionProcedure 05dd22401f19bc665866ffe134bc07ee, server=jenkins-hbase4.apache.org,43865,1675944167040}] 2023-02-09 12:02:58,261 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=37, state=RUNNABLE; CloseRegionProcedure 6a2f68f435ddf37944e60450e130d0c8, server=jenkins-hbase4.apache.org,40063,1675944167089}] 2023-02-09 12:02:58,262 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=43, state=RUNNABLE; CloseRegionProcedure 65a3da3364c26109bbe03b4e408b5d95, server=jenkins-hbase4.apache.org,40063,1675944167089}] 2023-02-09 12:02:58,269 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=adba5c7dd8af5a32d17e2e2d2835e54e, UNASSIGN 2023-02-09 12:02:58,269 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=f1f03c1ee1ed10fc02a07432990a8ea4, UNASSIGN 2023-02-09 12:02:58,269 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=75beec9f46c90b3722fafa385b8aee48, UNASSIGN 2023-02-09 12:02:58,270 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=f19add4d5d04210e250b8c75220e32c6, UNASSIGN 2023-02-09 12:02:58,270 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=adba5c7dd8af5a32d17e2e2d2835e54e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43865,1675944167040 2023-02-09 12:02:58,270 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1675944170049.adba5c7dd8af5a32d17e2e2d2835e54e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675944178270"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675944178270"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675944178270"}]},"ts":"1675944178270"} 2023-02-09 12:02:58,271 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=75beec9f46c90b3722fafa385b8aee48, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43865,1675944167040 2023-02-09 12:02:58,271 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1675944170049.75beec9f46c90b3722fafa385b8aee48.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675944178271"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675944178271"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675944178271"}]},"ts":"1675944178271"} 2023-02-09 12:02:58,271 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=f19add4d5d04210e250b8c75220e32c6, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40063,1675944167089 2023-02-09 12:02:58,272 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1675944170049.f19add4d5d04210e250b8c75220e32c6.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675944178271"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675944178271"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675944178271"}]},"ts":"1675944178271"} 2023-02-09 12:02:58,272 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=f1f03c1ee1ed10fc02a07432990a8ea4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40063,1675944167089 2023-02-09 12:02:58,272 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1675944170049.f1f03c1ee1ed10fc02a07432990a8ea4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675944178272"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675944178272"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675944178272"}]},"ts":"1675944178272"} 2023-02-09 12:02:58,272 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=e512e42931aafc627ee7181cbf9052ca, UNASSIGN 2023-02-09 12:02:58,273 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=42, state=RUNNABLE; CloseRegionProcedure adba5c7dd8af5a32d17e2e2d2835e54e, server=jenkins-hbase4.apache.org,43865,1675944167040}] 2023-02-09 12:02:58,274 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=e512e42931aafc627ee7181cbf9052ca, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43865,1675944167040 2023-02-09 12:02:58,274 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1675944170049.e512e42931aafc627ee7181cbf9052ca.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675944178274"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675944178274"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675944178274"}]},"ts":"1675944178274"} 2023-02-09 12:02:58,274 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=40, state=RUNNABLE; CloseRegionProcedure 75beec9f46c90b3722fafa385b8aee48, server=jenkins-hbase4.apache.org,43865,1675944167040}] 2023-02-09 12:02:58,275 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=35, state=RUNNABLE; CloseRegionProcedure f19add4d5d04210e250b8c75220e32c6, server=jenkins-hbase4.apache.org,40063,1675944167089}] 2023-02-09 12:02:58,276 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=41, state=RUNNABLE; CloseRegionProcedure f1f03c1ee1ed10fc02a07432990a8ea4, server=jenkins-hbase4.apache.org,40063,1675944167089}] 2023-02-09 12:02:58,277 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=34, state=RUNNABLE; CloseRegionProcedure e512e42931aafc627ee7181cbf9052ca, server=jenkins-hbase4.apache.org,43865,1675944167040}] 2023-02-09 12:02:58,344 INFO [Listener at localhost/43097] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:02:58,344 INFO [Listener at localhost/43097] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:02:58,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32779] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-09 12:02:58,421 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 05dd22401f19bc665866ffe134bc07ee 2023-02-09 12:02:58,421 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 6a2f68f435ddf37944e60450e130d0c8 2023-02-09 12:02:58,421 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 05dd22401f19bc665866ffe134bc07ee, disabling compactions & flushes 2023-02-09 12:02:58,421 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 6a2f68f435ddf37944e60450e130d0c8, disabling compactions & flushes 2023-02-09 12:02:58,421 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1675944170049.05dd22401f19bc665866ffe134bc07ee. 2023-02-09 12:02:58,422 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1675944170049.05dd22401f19bc665866ffe134bc07ee. 2023-02-09 12:02:58,422 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1675944170049.6a2f68f435ddf37944e60450e130d0c8. 2023-02-09 12:02:58,422 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1675944170049.05dd22401f19bc665866ffe134bc07ee. after waiting 0 ms 2023-02-09 12:02:58,422 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1675944170049.05dd22401f19bc665866ffe134bc07ee. 2023-02-09 12:02:58,422 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1675944170049.6a2f68f435ddf37944e60450e130d0c8. 2023-02-09 12:02:58,424 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1675944170049.6a2f68f435ddf37944e60450e130d0c8. after waiting 0 ms 2023-02-09 12:02:58,425 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1675944170049.6a2f68f435ddf37944e60450e130d0c8. 2023-02-09 12:02:58,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/6a2f68f435ddf37944e60450e130d0c8/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 12:02:58,441 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1675944170049.6a2f68f435ddf37944e60450e130d0c8. 2023-02-09 12:02:58,441 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 6a2f68f435ddf37944e60450e130d0c8: Waiting for close lock at 1675944178421Running coprocessor pre-close hooks at 1675944178421Disabling compacts and flushes for region at 1675944178421Disabling writes for close at 1675944178425 (+4 ms)Writing region close event to WAL at 1675944178435 (+10 ms)Running coprocessor post-close hooks at 1675944178440 (+5 ms)Closed at 1675944178441 (+1 ms) 2023-02-09 12:02:58,442 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/05dd22401f19bc665866ffe134bc07ee/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 12:02:58,444 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1675944170049.05dd22401f19bc665866ffe134bc07ee. 2023-02-09 12:02:58,444 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 05dd22401f19bc665866ffe134bc07ee: Waiting for close lock at 1675944178421Running coprocessor pre-close hooks at 1675944178421Disabling compacts and flushes for region at 1675944178421Disabling writes for close at 1675944178422 (+1 ms)Writing region close event to WAL at 1675944178433 (+11 ms)Running coprocessor post-close hooks at 1675944178443 (+10 ms)Closed at 1675944178444 (+1 ms) 2023-02-09 12:02:58,445 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 6a2f68f435ddf37944e60450e130d0c8 2023-02-09 12:02:58,446 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 02975433f68555b44244543d329054e2 2023-02-09 12:02:58,446 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 02975433f68555b44244543d329054e2, disabling compactions & flushes 2023-02-09 12:02:58,446 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1675944170049.02975433f68555b44244543d329054e2. 2023-02-09 12:02:58,446 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1675944170049.02975433f68555b44244543d329054e2. 2023-02-09 12:02:58,446 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=6a2f68f435ddf37944e60450e130d0c8, regionState=CLOSED 2023-02-09 12:02:58,446 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1675944170049.02975433f68555b44244543d329054e2. after waiting 0 ms 2023-02-09 12:02:58,446 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1675944170049.02975433f68555b44244543d329054e2. 2023-02-09 12:02:58,446 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1675944170049.6a2f68f435ddf37944e60450e130d0c8.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675944178446"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675944178446"}]},"ts":"1675944178446"} 2023-02-09 12:02:58,446 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 05dd22401f19bc665866ffe134bc07ee 2023-02-09 12:02:58,446 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close adba5c7dd8af5a32d17e2e2d2835e54e 2023-02-09 12:02:58,446 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing adba5c7dd8af5a32d17e2e2d2835e54e, disabling compactions & flushes 2023-02-09 12:02:58,446 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1675944170049.adba5c7dd8af5a32d17e2e2d2835e54e. 2023-02-09 12:02:58,446 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1675944170049.adba5c7dd8af5a32d17e2e2d2835e54e. 2023-02-09 12:02:58,446 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1675944170049.adba5c7dd8af5a32d17e2e2d2835e54e. after waiting 0 ms 2023-02-09 12:02:58,447 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1675944170049.adba5c7dd8af5a32d17e2e2d2835e54e. 2023-02-09 12:02:58,447 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=05dd22401f19bc665866ffe134bc07ee, regionState=CLOSED 2023-02-09 12:02:58,447 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1675944170049.05dd22401f19bc665866ffe134bc07ee.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675944178447"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675944178447"}]},"ts":"1675944178447"} 2023-02-09 12:02:58,454 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=37 2023-02-09 12:02:58,454 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=37, state=SUCCESS; CloseRegionProcedure 6a2f68f435ddf37944e60450e130d0c8, server=jenkins-hbase4.apache.org,40063,1675944167089 in 189 msec 2023-02-09 12:02:58,455 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=38 2023-02-09 12:02:58,455 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=38, state=SUCCESS; CloseRegionProcedure 05dd22401f19bc665866ffe134bc07ee, server=jenkins-hbase4.apache.org,43865,1675944167040 in 191 msec 2023-02-09 12:02:58,456 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=6a2f68f435ddf37944e60450e130d0c8, UNASSIGN in 205 msec 2023-02-09 12:02:58,457 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=05dd22401f19bc665866ffe134bc07ee, UNASSIGN in 206 msec 2023-02-09 12:02:58,494 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/02975433f68555b44244543d329054e2/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 12:02:58,494 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/adba5c7dd8af5a32d17e2e2d2835e54e/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 12:02:58,496 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1675944170049.02975433f68555b44244543d329054e2. 2023-02-09 12:02:58,496 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 02975433f68555b44244543d329054e2: Waiting for close lock at 1675944178446Running coprocessor pre-close hooks at 1675944178446Disabling compacts and flushes for region at 1675944178446Disabling writes for close at 1675944178446Writing region close event to WAL at 1675944178488 (+42 ms)Running coprocessor post-close hooks at 1675944178495 (+7 ms)Closed at 1675944178496 (+1 ms) 2023-02-09 12:02:58,497 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1675944170049.adba5c7dd8af5a32d17e2e2d2835e54e. 2023-02-09 12:02:58,497 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for adba5c7dd8af5a32d17e2e2d2835e54e: Waiting for close lock at 1675944178446Running coprocessor pre-close hooks at 1675944178446Disabling compacts and flushes for region at 1675944178446Disabling writes for close at 1675944178447 (+1 ms)Writing region close event to WAL at 1675944178489 (+42 ms)Running coprocessor post-close hooks at 1675944178495 (+6 ms)Closed at 1675944178497 (+2 ms) 2023-02-09 12:02:58,499 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 02975433f68555b44244543d329054e2 2023-02-09 12:02:58,499 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close f19add4d5d04210e250b8c75220e32c6 2023-02-09 12:02:58,499 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing f19add4d5d04210e250b8c75220e32c6, disabling compactions & flushes 2023-02-09 12:02:58,499 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1675944170049.f19add4d5d04210e250b8c75220e32c6. 2023-02-09 12:02:58,499 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1675944170049.f19add4d5d04210e250b8c75220e32c6. 2023-02-09 12:02:58,499 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1675944170049.f19add4d5d04210e250b8c75220e32c6. after waiting 0 ms 2023-02-09 12:02:58,499 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1675944170049.f19add4d5d04210e250b8c75220e32c6. 2023-02-09 12:02:58,499 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=02975433f68555b44244543d329054e2, regionState=CLOSED 2023-02-09 12:02:58,499 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1675944170049.02975433f68555b44244543d329054e2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675944178499"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675944178499"}]},"ts":"1675944178499"} 2023-02-09 12:02:58,500 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed adba5c7dd8af5a32d17e2e2d2835e54e 2023-02-09 12:02:58,500 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close e512e42931aafc627ee7181cbf9052ca 2023-02-09 12:02:58,501 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing e512e42931aafc627ee7181cbf9052ca, disabling compactions & flushes 2023-02-09 12:02:58,501 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675944170049.e512e42931aafc627ee7181cbf9052ca. 2023-02-09 12:02:58,501 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675944170049.e512e42931aafc627ee7181cbf9052ca. 2023-02-09 12:02:58,501 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675944170049.e512e42931aafc627ee7181cbf9052ca. after waiting 0 ms 2023-02-09 12:02:58,501 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675944170049.e512e42931aafc627ee7181cbf9052ca. 2023-02-09 12:02:58,501 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=adba5c7dd8af5a32d17e2e2d2835e54e, regionState=CLOSED 2023-02-09 12:02:58,501 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1675944170049.adba5c7dd8af5a32d17e2e2d2835e54e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675944178501"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675944178501"}]},"ts":"1675944178501"} 2023-02-09 12:02:58,505 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=39 2023-02-09 12:02:58,505 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=39, state=SUCCESS; CloseRegionProcedure 02975433f68555b44244543d329054e2, server=jenkins-hbase4.apache.org,40063,1675944167089 in 245 msec 2023-02-09 12:02:58,506 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=42 2023-02-09 12:02:58,506 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=42, state=SUCCESS; CloseRegionProcedure adba5c7dd8af5a32d17e2e2d2835e54e, server=jenkins-hbase4.apache.org,43865,1675944167040 in 231 msec 2023-02-09 12:02:58,508 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=02975433f68555b44244543d329054e2, UNASSIGN in 256 msec 2023-02-09 12:02:58,509 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=adba5c7dd8af5a32d17e2e2d2835e54e, UNASSIGN in 256 msec 2023-02-09 12:02:58,522 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/e512e42931aafc627ee7181cbf9052ca/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-09 12:02:58,523 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675944170049.e512e42931aafc627ee7181cbf9052ca. 2023-02-09 12:02:58,523 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for e512e42931aafc627ee7181cbf9052ca: Waiting for close lock at 1675944178501Running coprocessor pre-close hooks at 1675944178501Disabling compacts and flushes for region at 1675944178501Disabling writes for close at 1675944178501Writing region close event to WAL at 1675944178516 (+15 ms)Running coprocessor post-close hooks at 1675944178523 (+7 ms)Closed at 1675944178523 2023-02-09 12:02:58,525 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed e512e42931aafc627ee7181cbf9052ca 2023-02-09 12:02:58,525 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 75beec9f46c90b3722fafa385b8aee48 2023-02-09 12:02:58,526 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 75beec9f46c90b3722fafa385b8aee48, disabling compactions & flushes 2023-02-09 12:02:58,526 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1675944170049.75beec9f46c90b3722fafa385b8aee48. 2023-02-09 12:02:58,526 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1675944170049.75beec9f46c90b3722fafa385b8aee48. 2023-02-09 12:02:58,526 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1675944170049.75beec9f46c90b3722fafa385b8aee48. after waiting 0 ms 2023-02-09 12:02:58,526 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1675944170049.75beec9f46c90b3722fafa385b8aee48. 2023-02-09 12:02:58,526 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=e512e42931aafc627ee7181cbf9052ca, regionState=CLOSED 2023-02-09 12:02:58,526 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1675944170049.e512e42931aafc627ee7181cbf9052ca.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675944178526"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675944178526"}]},"ts":"1675944178526"} 2023-02-09 12:02:58,527 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/f19add4d5d04210e250b8c75220e32c6/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 12:02:58,529 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1675944170049.f19add4d5d04210e250b8c75220e32c6. 2023-02-09 12:02:58,529 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for f19add4d5d04210e250b8c75220e32c6: Waiting for close lock at 1675944178499Running coprocessor pre-close hooks at 1675944178499Disabling compacts and flushes for region at 1675944178499Disabling writes for close at 1675944178499Writing region close event to WAL at 1675944178519 (+20 ms)Running coprocessor post-close hooks at 1675944178528 (+9 ms)Closed at 1675944178528 2023-02-09 12:02:58,538 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed f19add4d5d04210e250b8c75220e32c6 2023-02-09 12:02:58,538 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close f1f03c1ee1ed10fc02a07432990a8ea4 2023-02-09 12:02:58,538 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing f1f03c1ee1ed10fc02a07432990a8ea4, disabling compactions & flushes 2023-02-09 12:02:58,538 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1675944170049.f1f03c1ee1ed10fc02a07432990a8ea4. 2023-02-09 12:02:58,538 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1675944170049.f1f03c1ee1ed10fc02a07432990a8ea4. 2023-02-09 12:02:58,538 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1675944170049.f1f03c1ee1ed10fc02a07432990a8ea4. after waiting 0 ms 2023-02-09 12:02:58,538 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1675944170049.f1f03c1ee1ed10fc02a07432990a8ea4. 2023-02-09 12:02:58,539 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=34 2023-02-09 12:02:58,539 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=34, state=SUCCESS; CloseRegionProcedure e512e42931aafc627ee7181cbf9052ca, server=jenkins-hbase4.apache.org,43865,1675944167040 in 252 msec 2023-02-09 12:02:58,539 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=f19add4d5d04210e250b8c75220e32c6, regionState=CLOSED 2023-02-09 12:02:58,539 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1675944170049.f19add4d5d04210e250b8c75220e32c6.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675944178539"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675944178539"}]},"ts":"1675944178539"} 2023-02-09 12:02:58,540 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=e512e42931aafc627ee7181cbf9052ca, UNASSIGN in 290 msec 2023-02-09 12:02:58,543 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=35 2023-02-09 12:02:58,543 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=35, state=SUCCESS; CloseRegionProcedure f19add4d5d04210e250b8c75220e32c6, server=jenkins-hbase4.apache.org,40063,1675944167089 in 266 msec 2023-02-09 12:02:58,544 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/75beec9f46c90b3722fafa385b8aee48/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 12:02:58,545 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=f19add4d5d04210e250b8c75220e32c6, UNASSIGN in 294 msec 2023-02-09 12:02:58,546 INFO [Listener at localhost/43097] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:02:58,547 INFO [Listener at localhost/43097] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:02:58,548 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1675944170049.75beec9f46c90b3722fafa385b8aee48. 2023-02-09 12:02:58,548 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 75beec9f46c90b3722fafa385b8aee48: Waiting for close lock at 1675944178526Running coprocessor pre-close hooks at 1675944178526Disabling compacts and flushes for region at 1675944178526Disabling writes for close at 1675944178526Writing region close event to WAL at 1675944178528 (+2 ms)Running coprocessor post-close hooks at 1675944178545 (+17 ms)Closed at 1675944178548 (+3 ms) 2023-02-09 12:02:58,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32779] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-09 12:02:58,550 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 75beec9f46c90b3722fafa385b8aee48 2023-02-09 12:02:58,550 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 4a3fbf78e913c39c9306810357f4e73f 2023-02-09 12:02:58,550 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 4a3fbf78e913c39c9306810357f4e73f, disabling compactions & flushes 2023-02-09 12:02:58,550 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1675944170049.4a3fbf78e913c39c9306810357f4e73f. 2023-02-09 12:02:58,550 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1675944170049.4a3fbf78e913c39c9306810357f4e73f. 2023-02-09 12:02:58,550 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1675944170049.4a3fbf78e913c39c9306810357f4e73f. after waiting 0 ms 2023-02-09 12:02:58,550 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1675944170049.4a3fbf78e913c39c9306810357f4e73f. 2023-02-09 12:02:58,551 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=75beec9f46c90b3722fafa385b8aee48, regionState=CLOSED 2023-02-09 12:02:58,551 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1675944170049.75beec9f46c90b3722fafa385b8aee48.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675944178550"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675944178550"}]},"ts":"1675944178550"} 2023-02-09 12:02:58,555 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=40 2023-02-09 12:02:58,555 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=40, state=SUCCESS; CloseRegionProcedure 75beec9f46c90b3722fafa385b8aee48, server=jenkins-hbase4.apache.org,43865,1675944167040 in 279 msec 2023-02-09 12:02:58,556 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=75beec9f46c90b3722fafa385b8aee48, UNASSIGN in 306 msec 2023-02-09 12:02:58,584 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/f1f03c1ee1ed10fc02a07432990a8ea4/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 12:02:58,585 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/4a3fbf78e913c39c9306810357f4e73f/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 12:02:58,586 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1675944170049.f1f03c1ee1ed10fc02a07432990a8ea4. 2023-02-09 12:02:58,586 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for f1f03c1ee1ed10fc02a07432990a8ea4: Waiting for close lock at 1675944178538Running coprocessor pre-close hooks at 1675944178538Disabling compacts and flushes for region at 1675944178538Disabling writes for close at 1675944178538Writing region close event to WAL at 1675944178572 (+34 ms)Running coprocessor post-close hooks at 1675944178585 (+13 ms)Closed at 1675944178586 (+1 ms) 2023-02-09 12:02:58,587 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1675944170049.4a3fbf78e913c39c9306810357f4e73f. 2023-02-09 12:02:58,587 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 4a3fbf78e913c39c9306810357f4e73f: Waiting for close lock at 1675944178550Running coprocessor pre-close hooks at 1675944178550Disabling compacts and flushes for region at 1675944178550Disabling writes for close at 1675944178550Writing region close event to WAL at 1675944178573 (+23 ms)Running coprocessor post-close hooks at 1675944178586 (+13 ms)Closed at 1675944178587 (+1 ms) 2023-02-09 12:02:58,589 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed f1f03c1ee1ed10fc02a07432990a8ea4 2023-02-09 12:02:58,589 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 65a3da3364c26109bbe03b4e408b5d95 2023-02-09 12:02:58,589 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 65a3da3364c26109bbe03b4e408b5d95, disabling compactions & flushes 2023-02-09 12:02:58,589 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1675944170049.65a3da3364c26109bbe03b4e408b5d95. 2023-02-09 12:02:58,589 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1675944170049.65a3da3364c26109bbe03b4e408b5d95. 2023-02-09 12:02:58,590 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1675944170049.65a3da3364c26109bbe03b4e408b5d95. after waiting 1 ms 2023-02-09 12:02:58,590 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1675944170049.65a3da3364c26109bbe03b4e408b5d95. 2023-02-09 12:02:58,590 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=f1f03c1ee1ed10fc02a07432990a8ea4, regionState=CLOSED 2023-02-09 12:02:58,590 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 4a3fbf78e913c39c9306810357f4e73f 2023-02-09 12:02:58,591 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1675944170049.f1f03c1ee1ed10fc02a07432990a8ea4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675944178590"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675944178590"}]},"ts":"1675944178590"} 2023-02-09 12:02:58,591 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=4a3fbf78e913c39c9306810357f4e73f, regionState=CLOSED 2023-02-09 12:02:58,591 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1675944170049.4a3fbf78e913c39c9306810357f4e73f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675944178591"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675944178591"}]},"ts":"1675944178591"} 2023-02-09 12:02:58,601 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/default/testWithMapReduce/65a3da3364c26109bbe03b4e408b5d95/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-09 12:02:58,602 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1675944170049.65a3da3364c26109bbe03b4e408b5d95. 2023-02-09 12:02:58,603 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 65a3da3364c26109bbe03b4e408b5d95: Waiting for close lock at 1675944178589Running coprocessor pre-close hooks at 1675944178589Disabling compacts and flushes for region at 1675944178589Disabling writes for close at 1675944178590 (+1 ms)Writing region close event to WAL at 1675944178591 (+1 ms)Running coprocessor post-close hooks at 1675944178602 (+11 ms)Closed at 1675944178602 2023-02-09 12:02:58,603 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=41 2023-02-09 12:02:58,603 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=41, state=SUCCESS; CloseRegionProcedure f1f03c1ee1ed10fc02a07432990a8ea4, server=jenkins-hbase4.apache.org,40063,1675944167089 in 318 msec 2023-02-09 12:02:58,604 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=36 2023-02-09 12:02:58,604 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=36, state=SUCCESS; CloseRegionProcedure 4a3fbf78e913c39c9306810357f4e73f, server=jenkins-hbase4.apache.org,43865,1675944167040 in 336 msec 2023-02-09 12:02:58,605 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 65a3da3364c26109bbe03b4e408b5d95 2023-02-09 12:02:58,606 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=f1f03c1ee1ed10fc02a07432990a8ea4, UNASSIGN in 355 msec 2023-02-09 12:02:58,606 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=65a3da3364c26109bbe03b4e408b5d95, regionState=CLOSED 2023-02-09 12:02:58,606 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1675944170049.65a3da3364c26109bbe03b4e408b5d95.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675944178606"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675944178606"}]},"ts":"1675944178606"} 2023-02-09 12:02:58,607 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=4a3fbf78e913c39c9306810357f4e73f, UNASSIGN in 355 msec 2023-02-09 12:02:58,610 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=43 2023-02-09 12:02:58,610 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=43, state=SUCCESS; CloseRegionProcedure 65a3da3364c26109bbe03b4e408b5d95, server=jenkins-hbase4.apache.org,40063,1675944167089 in 346 msec 2023-02-09 12:02:58,612 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=43, resume processing ppid=33 2023-02-09 12:02:58,613 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=65a3da3364c26109bbe03b4e408b5d95, UNASSIGN in 360 msec 2023-02-09 12:02:58,614 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675944178613"}]},"ts":"1675944178613"} 2023-02-09 12:02:58,615 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-09 12:02:58,618 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-09 12:02:58,620 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 385 msec 2023-02-09 12:02:58,850 INFO [Listener at localhost/43097] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:02:58,850 INFO [Listener at localhost/43097] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:02:58,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32779] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-09 12:02:58,852 INFO [Listener at localhost/43097] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 33 completed 2023-02-09 12:02:58,853 INFO [Listener at localhost/43097] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:02:58,853 INFO [Listener at localhost/43097] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:02:58,857 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32779] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testWithMapReduce 2023-02-09 12:02:58,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32779] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-09 12:02:58,868 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-09 12:02:58,870 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-09 12:02:58,870 INFO [Listener at localhost/43097] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:02:58,870 INFO [Listener at localhost/43097] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:02:58,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32779] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-09 12:02:58,885 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/e512e42931aafc627ee7181cbf9052ca 2023-02-09 12:02:58,885 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/f19add4d5d04210e250b8c75220e32c6 2023-02-09 12:02:58,885 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/05dd22401f19bc665866ffe134bc07ee 2023-02-09 12:02:58,885 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/02975433f68555b44244543d329054e2 2023-02-09 12:02:58,885 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/75beec9f46c90b3722fafa385b8aee48 2023-02-09 12:02:58,885 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/f1f03c1ee1ed10fc02a07432990a8ea4 2023-02-09 12:02:58,885 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/6a2f68f435ddf37944e60450e130d0c8 2023-02-09 12:02:58,885 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/4a3fbf78e913c39c9306810357f4e73f 2023-02-09 12:02:58,891 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/e512e42931aafc627ee7181cbf9052ca/f1, FileablePath, hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/e512e42931aafc627ee7181cbf9052ca/f2, FileablePath, hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/e512e42931aafc627ee7181cbf9052ca/recovered.edits] 2023-02-09 12:02:58,891 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/f1f03c1ee1ed10fc02a07432990a8ea4/f1, FileablePath, hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/f1f03c1ee1ed10fc02a07432990a8ea4/f2, FileablePath, hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/f1f03c1ee1ed10fc02a07432990a8ea4/recovered.edits] 2023-02-09 12:02:58,892 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/4a3fbf78e913c39c9306810357f4e73f/f1, FileablePath, hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/4a3fbf78e913c39c9306810357f4e73f/f2, FileablePath, hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/4a3fbf78e913c39c9306810357f4e73f/recovered.edits] 2023-02-09 12:02:58,892 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/f19add4d5d04210e250b8c75220e32c6/f1, FileablePath, hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/f19add4d5d04210e250b8c75220e32c6/f2, FileablePath, hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/f19add4d5d04210e250b8c75220e32c6/recovered.edits] 2023-02-09 12:02:58,892 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/6a2f68f435ddf37944e60450e130d0c8/f1, FileablePath, hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/6a2f68f435ddf37944e60450e130d0c8/f2, FileablePath, hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/6a2f68f435ddf37944e60450e130d0c8/recovered.edits] 2023-02-09 12:02:58,893 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/05dd22401f19bc665866ffe134bc07ee/f1, FileablePath, hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/05dd22401f19bc665866ffe134bc07ee/f2, FileablePath, hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/05dd22401f19bc665866ffe134bc07ee/recovered.edits] 2023-02-09 12:02:58,894 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/02975433f68555b44244543d329054e2/f1, FileablePath, hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/02975433f68555b44244543d329054e2/f2, FileablePath, hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/02975433f68555b44244543d329054e2/recovered.edits] 2023-02-09 12:02:58,895 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/75beec9f46c90b3722fafa385b8aee48/f1, FileablePath, hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/75beec9f46c90b3722fafa385b8aee48/f2, FileablePath, hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/75beec9f46c90b3722fafa385b8aee48/recovered.edits] 2023-02-09 12:02:58,905 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/75beec9f46c90b3722fafa385b8aee48/f1/4dd6a1b41a7647028e8a6a2f5f19ce9b to hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/archive/data/default/testWithMapReduce/75beec9f46c90b3722fafa385b8aee48/f1/4dd6a1b41a7647028e8a6a2f5f19ce9b 2023-02-09 12:02:58,905 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/05dd22401f19bc665866ffe134bc07ee/f1/7fdf9ea615c249c3a8844b1812d071e3 to hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/archive/data/default/testWithMapReduce/05dd22401f19bc665866ffe134bc07ee/f1/7fdf9ea615c249c3a8844b1812d071e3 2023-02-09 12:02:58,905 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/6a2f68f435ddf37944e60450e130d0c8/f1/1d33beb07ac241679fa3ab924f78231f to hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/archive/data/default/testWithMapReduce/6a2f68f435ddf37944e60450e130d0c8/f1/1d33beb07ac241679fa3ab924f78231f 2023-02-09 12:02:58,906 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/02975433f68555b44244543d329054e2/f1/52d90ef899d34c6692ad97ee027db16d to hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/archive/data/default/testWithMapReduce/02975433f68555b44244543d329054e2/f1/52d90ef899d34c6692ad97ee027db16d 2023-02-09 12:02:58,906 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/f1f03c1ee1ed10fc02a07432990a8ea4/f1/2ef9a949cd3341d6a0b5f1dc010a61d3 to hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/archive/data/default/testWithMapReduce/f1f03c1ee1ed10fc02a07432990a8ea4/f1/2ef9a949cd3341d6a0b5f1dc010a61d3 2023-02-09 12:02:58,906 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/4a3fbf78e913c39c9306810357f4e73f/f1/4764d223234f42a59d78f8c2b620815f to hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/archive/data/default/testWithMapReduce/4a3fbf78e913c39c9306810357f4e73f/f1/4764d223234f42a59d78f8c2b620815f 2023-02-09 12:02:58,906 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/f19add4d5d04210e250b8c75220e32c6/f1/65a3e5c9e0254e4bbeca68e2805638e4 to hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/archive/data/default/testWithMapReduce/f19add4d5d04210e250b8c75220e32c6/f1/65a3e5c9e0254e4bbeca68e2805638e4 2023-02-09 12:02:58,907 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/e512e42931aafc627ee7181cbf9052ca/recovered.edits/6.seqid to hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/archive/data/default/testWithMapReduce/e512e42931aafc627ee7181cbf9052ca/recovered.edits/6.seqid 2023-02-09 12:02:58,908 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/e512e42931aafc627ee7181cbf9052ca 2023-02-09 12:02:58,908 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/adba5c7dd8af5a32d17e2e2d2835e54e 2023-02-09 12:02:58,909 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/02975433f68555b44244543d329054e2/f1/551319def28a4552a6d0c710acefebfe to hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/archive/data/default/testWithMapReduce/02975433f68555b44244543d329054e2/f1/551319def28a4552a6d0c710acefebfe 2023-02-09 12:02:58,909 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/75beec9f46c90b3722fafa385b8aee48/f1/6a1feb2b02ae4a1fb7e2b035b748873d to hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/archive/data/default/testWithMapReduce/75beec9f46c90b3722fafa385b8aee48/f1/6a1feb2b02ae4a1fb7e2b035b748873d 2023-02-09 12:02:58,910 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/6a2f68f435ddf37944e60450e130d0c8/f1/3350840e232c489ba5a959075b03152a to hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/archive/data/default/testWithMapReduce/6a2f68f435ddf37944e60450e130d0c8/f1/3350840e232c489ba5a959075b03152a 2023-02-09 12:02:58,910 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/f19add4d5d04210e250b8c75220e32c6/f1/b7cce35bdb7e4b44836bd982cfb2ce70 to hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/archive/data/default/testWithMapReduce/f19add4d5d04210e250b8c75220e32c6/f1/b7cce35bdb7e4b44836bd982cfb2ce70 2023-02-09 12:02:58,910 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/4a3fbf78e913c39c9306810357f4e73f/f1/dbe67ba683384bc9984c20ac38b3243c to hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/archive/data/default/testWithMapReduce/4a3fbf78e913c39c9306810357f4e73f/f1/dbe67ba683384bc9984c20ac38b3243c 2023-02-09 12:02:58,910 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/05dd22401f19bc665866ffe134bc07ee/f1/d4e762ddd23b4848b375a3e145b3f207 to hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/archive/data/default/testWithMapReduce/05dd22401f19bc665866ffe134bc07ee/f1/d4e762ddd23b4848b375a3e145b3f207 2023-02-09 12:02:58,911 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/f1f03c1ee1ed10fc02a07432990a8ea4/f1/5c6372329cd54a32ac08ca9a1a624522 to hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/archive/data/default/testWithMapReduce/f1f03c1ee1ed10fc02a07432990a8ea4/f1/5c6372329cd54a32ac08ca9a1a624522 2023-02-09 12:02:58,915 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/adba5c7dd8af5a32d17e2e2d2835e54e/f1, FileablePath, hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/adba5c7dd8af5a32d17e2e2d2835e54e/f2, FileablePath, hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/adba5c7dd8af5a32d17e2e2d2835e54e/recovered.edits] 2023-02-09 12:02:58,917 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/02975433f68555b44244543d329054e2/f2/d4de1863843a4c3682ea4882fa219b07 to hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/archive/data/default/testWithMapReduce/02975433f68555b44244543d329054e2/f2/d4de1863843a4c3682ea4882fa219b07 2023-02-09 12:02:58,919 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/4a3fbf78e913c39c9306810357f4e73f/f2/9cb947fd65a245cd95fd3ac2aa1a2bf0 to hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/archive/data/default/testWithMapReduce/4a3fbf78e913c39c9306810357f4e73f/f2/9cb947fd65a245cd95fd3ac2aa1a2bf0 2023-02-09 12:02:58,919 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/05dd22401f19bc665866ffe134bc07ee/f2/27ac0115d52b4eb0a7001bde3266aa16 to hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/archive/data/default/testWithMapReduce/05dd22401f19bc665866ffe134bc07ee/f2/27ac0115d52b4eb0a7001bde3266aa16 2023-02-09 12:02:58,919 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/75beec9f46c90b3722fafa385b8aee48/f2/8c2ee70ba6134981a9dd08c043612690 to hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/archive/data/default/testWithMapReduce/75beec9f46c90b3722fafa385b8aee48/f2/8c2ee70ba6134981a9dd08c043612690 2023-02-09 12:02:58,920 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/f19add4d5d04210e250b8c75220e32c6/f2/a1005e5991334e6986822af761f66528 to hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/archive/data/default/testWithMapReduce/f19add4d5d04210e250b8c75220e32c6/f2/a1005e5991334e6986822af761f66528 2023-02-09 12:02:58,920 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/f1f03c1ee1ed10fc02a07432990a8ea4/f2/45926a383e5d4c368c55952e641754c4 to hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/archive/data/default/testWithMapReduce/f1f03c1ee1ed10fc02a07432990a8ea4/f2/45926a383e5d4c368c55952e641754c4 2023-02-09 12:02:58,921 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/6a2f68f435ddf37944e60450e130d0c8/f2/380b460b7a9d496b902307e6f7329707 to hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/archive/data/default/testWithMapReduce/6a2f68f435ddf37944e60450e130d0c8/f2/380b460b7a9d496b902307e6f7329707 2023-02-09 12:02:58,923 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/02975433f68555b44244543d329054e2/f2/df9930806411417aa95ccf7fcaa3fad3 to hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/archive/data/default/testWithMapReduce/02975433f68555b44244543d329054e2/f2/df9930806411417aa95ccf7fcaa3fad3 2023-02-09 12:02:58,925 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/05dd22401f19bc665866ffe134bc07ee/f2/d21974d0b35d46d3a6a87b58f11d40e7 to hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/archive/data/default/testWithMapReduce/05dd22401f19bc665866ffe134bc07ee/f2/d21974d0b35d46d3a6a87b58f11d40e7 2023-02-09 12:02:58,925 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/4a3fbf78e913c39c9306810357f4e73f/f2/a042eb4ebaaf4e2d82e2c393b2110152 to hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/archive/data/default/testWithMapReduce/4a3fbf78e913c39c9306810357f4e73f/f2/a042eb4ebaaf4e2d82e2c393b2110152 2023-02-09 12:02:58,925 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/75beec9f46c90b3722fafa385b8aee48/f2/97a521d6225d4655994ba1bf8590c07e to hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/archive/data/default/testWithMapReduce/75beec9f46c90b3722fafa385b8aee48/f2/97a521d6225d4655994ba1bf8590c07e 2023-02-09 12:02:58,925 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/f1f03c1ee1ed10fc02a07432990a8ea4/f2/5c120a6693bd48058f8f2173425c5955 to hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/archive/data/default/testWithMapReduce/f1f03c1ee1ed10fc02a07432990a8ea4/f2/5c120a6693bd48058f8f2173425c5955 2023-02-09 12:02:58,925 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/f19add4d5d04210e250b8c75220e32c6/f2/f72e68df43834ffebeb550b8fe94765b to hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/archive/data/default/testWithMapReduce/f19add4d5d04210e250b8c75220e32c6/f2/f72e68df43834ffebeb550b8fe94765b 2023-02-09 12:02:58,926 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/6a2f68f435ddf37944e60450e130d0c8/f2/65be0e75c64840c7b5b9e746423ea0e9 to hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/archive/data/default/testWithMapReduce/6a2f68f435ddf37944e60450e130d0c8/f2/65be0e75c64840c7b5b9e746423ea0e9 2023-02-09 12:02:58,931 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/adba5c7dd8af5a32d17e2e2d2835e54e/f1/1967812bad6446e1a896182443461eae to hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/archive/data/default/testWithMapReduce/adba5c7dd8af5a32d17e2e2d2835e54e/f1/1967812bad6446e1a896182443461eae 2023-02-09 12:02:58,935 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/02975433f68555b44244543d329054e2/recovered.edits/12.seqid to hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/archive/data/default/testWithMapReduce/02975433f68555b44244543d329054e2/recovered.edits/12.seqid 2023-02-09 12:02:58,937 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/adba5c7dd8af5a32d17e2e2d2835e54e/f1/a084e8fd09f445e59bfc1b89e81d0b11 to hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/archive/data/default/testWithMapReduce/adba5c7dd8af5a32d17e2e2d2835e54e/f1/a084e8fd09f445e59bfc1b89e81d0b11 2023-02-09 12:02:58,937 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/02975433f68555b44244543d329054e2 2023-02-09 12:02:58,937 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/65a3da3364c26109bbe03b4e408b5d95 2023-02-09 12:02:58,937 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/05dd22401f19bc665866ffe134bc07ee/recovered.edits/12.seqid to hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/archive/data/default/testWithMapReduce/05dd22401f19bc665866ffe134bc07ee/recovered.edits/12.seqid 2023-02-09 12:02:58,938 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/f1f03c1ee1ed10fc02a07432990a8ea4/recovered.edits/12.seqid to hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/archive/data/default/testWithMapReduce/f1f03c1ee1ed10fc02a07432990a8ea4/recovered.edits/12.seqid 2023-02-09 12:02:58,938 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/6a2f68f435ddf37944e60450e130d0c8/recovered.edits/12.seqid to hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/archive/data/default/testWithMapReduce/6a2f68f435ddf37944e60450e130d0c8/recovered.edits/12.seqid 2023-02-09 12:02:58,938 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/75beec9f46c90b3722fafa385b8aee48/recovered.edits/12.seqid to hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/archive/data/default/testWithMapReduce/75beec9f46c90b3722fafa385b8aee48/recovered.edits/12.seqid 2023-02-09 12:02:58,939 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/f19add4d5d04210e250b8c75220e32c6/recovered.edits/12.seqid to hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/archive/data/default/testWithMapReduce/f19add4d5d04210e250b8c75220e32c6/recovered.edits/12.seqid 2023-02-09 12:02:58,939 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/4a3fbf78e913c39c9306810357f4e73f/recovered.edits/12.seqid to hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/archive/data/default/testWithMapReduce/4a3fbf78e913c39c9306810357f4e73f/recovered.edits/12.seqid 2023-02-09 12:02:58,939 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/05dd22401f19bc665866ffe134bc07ee 2023-02-09 12:02:58,940 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/f1f03c1ee1ed10fc02a07432990a8ea4 2023-02-09 12:02:58,940 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/6a2f68f435ddf37944e60450e130d0c8 2023-02-09 12:02:58,940 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/75beec9f46c90b3722fafa385b8aee48 2023-02-09 12:02:58,941 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/f19add4d5d04210e250b8c75220e32c6 2023-02-09 12:02:58,941 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/4a3fbf78e913c39c9306810357f4e73f 2023-02-09 12:02:58,942 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/65a3da3364c26109bbe03b4e408b5d95/f1, FileablePath, hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/65a3da3364c26109bbe03b4e408b5d95/f2, FileablePath, hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/65a3da3364c26109bbe03b4e408b5d95/recovered.edits] 2023-02-09 12:02:58,944 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/adba5c7dd8af5a32d17e2e2d2835e54e/f2/50653eed597a464a85814d050a6a5c7f to hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/archive/data/default/testWithMapReduce/adba5c7dd8af5a32d17e2e2d2835e54e/f2/50653eed597a464a85814d050a6a5c7f 2023-02-09 12:02:58,946 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/adba5c7dd8af5a32d17e2e2d2835e54e/f2/7409fe1e98ac48ceb33c08e615876686 to hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/archive/data/default/testWithMapReduce/adba5c7dd8af5a32d17e2e2d2835e54e/f2/7409fe1e98ac48ceb33c08e615876686 2023-02-09 12:02:58,950 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/65a3da3364c26109bbe03b4e408b5d95/recovered.edits/6.seqid to hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/archive/data/default/testWithMapReduce/65a3da3364c26109bbe03b4e408b5d95/recovered.edits/6.seqid 2023-02-09 12:02:58,950 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/adba5c7dd8af5a32d17e2e2d2835e54e/recovered.edits/12.seqid to hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/archive/data/default/testWithMapReduce/adba5c7dd8af5a32d17e2e2d2835e54e/recovered.edits/12.seqid 2023-02-09 12:02:58,951 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/65a3da3364c26109bbe03b4e408b5d95 2023-02-09 12:02:58,951 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/.tmp/data/default/testWithMapReduce/adba5c7dd8af5a32d17e2e2d2835e54e 2023-02-09 12:02:58,952 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-09 12:02:58,955 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-09 12:02:58,972 INFO [Listener at localhost/43097] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:02:58,972 INFO [Listener at localhost/43097] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:02:58,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32779] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-09 12:02:58,983 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMapReduce from hbase:meta 2023-02-09 12:02:58,988 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-09 12:02:58,990 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-09 12:02:58,990 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-09 12:02:58,990 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1675944170049.e512e42931aafc627ee7181cbf9052ca.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675944178990"}]},"ts":"9223372036854775807"} 2023-02-09 12:02:58,990 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,aaa,1675944170049.f19add4d5d04210e250b8c75220e32c6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675944178990"}]},"ts":"9223372036854775807"} 2023-02-09 12:02:58,990 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,d\\x84\\x84,1675944170049.4a3fbf78e913c39c9306810357f4e73f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675944178990"}]},"ts":"9223372036854775807"} 2023-02-09 12:02:58,990 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,g\\xA7\\xA7,1675944170049.6a2f68f435ddf37944e60450e130d0c8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675944178990"}]},"ts":"9223372036854775807"} 2023-02-09 12:02:58,990 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,j\\xCA\\xCA,1675944170049.05dd22401f19bc665866ffe134bc07ee.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675944178990"}]},"ts":"9223372036854775807"} 2023-02-09 12:02:58,991 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,m\\xED\\xED,1675944170049.02975433f68555b44244543d329054e2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675944178990"}]},"ts":"9223372036854775807"} 2023-02-09 12:02:58,991 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,q\\x11\\x10,1675944170049.75beec9f46c90b3722fafa385b8aee48.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675944178990"}]},"ts":"9223372036854775807"} 2023-02-09 12:02:58,991 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,t43,1675944170049.f1f03c1ee1ed10fc02a07432990a8ea4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675944178990"}]},"ts":"9223372036854775807"} 2023-02-09 12:02:58,991 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,wWV,1675944170049.adba5c7dd8af5a32d17e2e2d2835e54e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675944178990"}]},"ts":"9223372036854775807"} 2023-02-09 12:02:58,991 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,zz{,1675944170049.65a3da3364c26109bbe03b4e408b5d95.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675944178990"}]},"ts":"9223372036854775807"} 2023-02-09 12:02:58,996 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-09 12:02:58,996 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => e512e42931aafc627ee7181cbf9052ca, NAME => 'testWithMapReduce,,1675944170049.e512e42931aafc627ee7181cbf9052ca.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => f19add4d5d04210e250b8c75220e32c6, NAME => 'testWithMapReduce,aaa,1675944170049.f19add4d5d04210e250b8c75220e32c6.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => 4a3fbf78e913c39c9306810357f4e73f, NAME => 'testWithMapReduce,d\x84\x84,1675944170049.4a3fbf78e913c39c9306810357f4e73f.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => 6a2f68f435ddf37944e60450e130d0c8, NAME => 'testWithMapReduce,g\xA7\xA7,1675944170049.6a2f68f435ddf37944e60450e130d0c8.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => 05dd22401f19bc665866ffe134bc07ee, NAME => 'testWithMapReduce,j\xCA\xCA,1675944170049.05dd22401f19bc665866ffe134bc07ee.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => 02975433f68555b44244543d329054e2, NAME => 'testWithMapReduce,m\xED\xED,1675944170049.02975433f68555b44244543d329054e2.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => 75beec9f46c90b3722fafa385b8aee48, NAME => 'testWithMapReduce,q\x11\x10,1675944170049.75beec9f46c90b3722fafa385b8aee48.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => f1f03c1ee1ed10fc02a07432990a8ea4, NAME => 'testWithMapReduce,t43,1675944170049.f1f03c1ee1ed10fc02a07432990a8ea4.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => adba5c7dd8af5a32d17e2e2d2835e54e, NAME => 'testWithMapReduce,wWV,1675944170049.adba5c7dd8af5a32d17e2e2d2835e54e.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => 65a3da3364c26109bbe03b4e408b5d95, NAME => 'testWithMapReduce,zz{,1675944170049.65a3da3364c26109bbe03b4e408b5d95.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-09 12:02:58,996 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-09 12:02:58,996 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1675944178996"}]},"ts":"9223372036854775807"} 2023-02-09 12:02:58,998 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-09 12:02:59,001 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-09 12:02:59,002 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 142 msec 2023-02-09 12:02:59,174 INFO [Listener at localhost/43097] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:02:59,174 INFO [Listener at localhost/43097] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:02:59,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32779] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-09 12:02:59,176 INFO [Listener at localhost/43097] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 54 completed 2023-02-09 12:02:59,177 INFO [Listener at localhost/43097] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-09 12:02:59,177 INFO [Listener at localhost/43097] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-09 12:02:59,177 DEBUG [Listener at localhost/43097] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0ac00ad9 to 127.0.0.1:61812 2023-02-09 12:02:59,177 DEBUG [Listener at localhost/43097] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 12:02:59,177 DEBUG [Listener at localhost/43097] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-09 12:02:59,177 DEBUG [Listener at localhost/43097] util.JVMClusterUtil(257): Found active master hash=1929830294, stopped=false 2023-02-09 12:02:59,177 INFO [Listener at localhost/43097] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,32779,1675944165832 2023-02-09 12:02:59,182 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 12:02:59,182 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): regionserver:40063-0x10038f668060002, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 12:02:59,182 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 12:02:59,182 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): regionserver:43865-0x10038f668060001, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 12:02:59,182 INFO [Listener at localhost/43097] procedure2.ProcedureExecutor(629): Stopping 2023-02-09 12:02:59,184 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 12:02:59,184 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40063-0x10038f668060002, quorum=127.0.0.1:61812, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 12:02:59,184 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43865-0x10038f668060001, quorum=127.0.0.1:61812, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 12:02:59,185 DEBUG [Listener at localhost/43097] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x42965873 to 127.0.0.1:61812 2023-02-09 12:02:59,185 DEBUG [Listener at localhost/43097] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 12:02:59,185 INFO [Listener at localhost/43097] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,43865,1675944167040' ***** 2023-02-09 12:02:59,185 INFO [Listener at localhost/43097] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-09 12:02:59,185 INFO [Listener at localhost/43097] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,40063,1675944167089' ***** 2023-02-09 12:02:59,185 INFO [Listener at localhost/43097] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-09 12:02:59,185 INFO [RS:0;jenkins-hbase4:43865] regionserver.HeapMemoryManager(220): Stopping 2023-02-09 12:02:59,185 INFO [RS:1;jenkins-hbase4:40063] regionserver.HeapMemoryManager(220): Stopping 2023-02-09 12:02:59,186 INFO [RS:1;jenkins-hbase4:40063] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-09 12:02:59,186 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-09 12:02:59,186 INFO [RS:1;jenkins-hbase4:40063] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-09 12:02:59,186 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-09 12:02:59,186 INFO [RS:0;jenkins-hbase4:43865] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-09 12:02:59,186 INFO [RS:0;jenkins-hbase4:43865] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-09 12:02:59,187 INFO [RS:1;jenkins-hbase4:40063] regionserver.HRegionServer(3304): Received CLOSE for e958df22f036975dc576dac705f19f5e 2023-02-09 12:02:59,187 INFO [RS:0;jenkins-hbase4:43865] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,43865,1675944167040 2023-02-09 12:02:59,187 DEBUG [RS:0;jenkins-hbase4:43865] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x39af17e7 to 127.0.0.1:61812 2023-02-09 12:02:59,187 DEBUG [RS:0;jenkins-hbase4:43865] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 12:02:59,187 INFO [RS:0;jenkins-hbase4:43865] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-09 12:02:59,187 INFO [RS:0;jenkins-hbase4:43865] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-09 12:02:59,187 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing e958df22f036975dc576dac705f19f5e, disabling compactions & flushes 2023-02-09 12:02:59,187 INFO [RS:1;jenkins-hbase4:40063] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,40063,1675944167089 2023-02-09 12:02:59,188 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675944169138.e958df22f036975dc576dac705f19f5e. 2023-02-09 12:02:59,188 DEBUG [RS:1;jenkins-hbase4:40063] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x369ea0d5 to 127.0.0.1:61812 2023-02-09 12:02:59,188 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675944169138.e958df22f036975dc576dac705f19f5e. 2023-02-09 12:02:59,188 INFO [RS:0;jenkins-hbase4:43865] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-09 12:02:59,188 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675944169138.e958df22f036975dc576dac705f19f5e. after waiting 0 ms 2023-02-09 12:02:59,188 INFO [RS:0;jenkins-hbase4:43865] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-09 12:02:59,188 DEBUG [RS:1;jenkins-hbase4:40063] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 12:02:59,188 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675944169138.e958df22f036975dc576dac705f19f5e. 2023-02-09 12:02:59,188 INFO [RS:1;jenkins-hbase4:40063] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-09 12:02:59,188 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing e958df22f036975dc576dac705f19f5e 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-09 12:02:59,188 INFO [RS:0;jenkins-hbase4:43865] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-09 12:02:59,188 DEBUG [RS:1;jenkins-hbase4:40063] regionserver.HRegionServer(1479): Online Regions={e958df22f036975dc576dac705f19f5e=hbase:namespace,,1675944169138.e958df22f036975dc576dac705f19f5e.} 2023-02-09 12:02:59,188 DEBUG [RS:0;jenkins-hbase4:43865] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-09 12:02:59,189 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-09 12:02:59,189 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-09 12:02:59,189 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-09 12:02:59,189 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-09 12:02:59,189 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-09 12:02:59,189 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=24.29 KB heapSize=40.20 KB 2023-02-09 12:02:59,191 DEBUG [RS:0;jenkins-hbase4:43865] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-09 12:02:59,191 DEBUG [RS:1;jenkins-hbase4:40063] regionserver.HRegionServer(1505): Waiting on e958df22f036975dc576dac705f19f5e 2023-02-09 12:02:59,251 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/hbase/namespace/e958df22f036975dc576dac705f19f5e/.tmp/info/bd1f739995e54b8c9980b0643c082e82 2023-02-09 12:02:59,255 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.08 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/hbase/meta/1588230740/.tmp/info/d2b3f3857ab8458089dd133a267dda8b 2023-02-09 12:02:59,263 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-09 12:02:59,263 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-09 12:02:59,266 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d2b3f3857ab8458089dd133a267dda8b 2023-02-09 12:02:59,267 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/hbase/namespace/e958df22f036975dc576dac705f19f5e/.tmp/info/bd1f739995e54b8c9980b0643c082e82 as hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/hbase/namespace/e958df22f036975dc576dac705f19f5e/info/bd1f739995e54b8c9980b0643c082e82 2023-02-09 12:02:59,280 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/hbase/namespace/e958df22f036975dc576dac705f19f5e/info/bd1f739995e54b8c9980b0643c082e82, entries=2, sequenceid=6, filesize=4.8 K 2023-02-09 12:02:59,281 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=997 B at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/hbase/meta/1588230740/.tmp/rep_barrier/79c2ba3a9da041de935facdbbfad8329 2023-02-09 12:02:59,281 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for e958df22f036975dc576dac705f19f5e in 93ms, sequenceid=6, compaction requested=false 2023-02-09 12:02:59,299 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 79c2ba3a9da041de935facdbbfad8329 2023-02-09 12:02:59,300 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/hbase/namespace/e958df22f036975dc576dac705f19f5e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-09 12:02:59,301 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675944169138.e958df22f036975dc576dac705f19f5e. 2023-02-09 12:02:59,301 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for e958df22f036975dc576dac705f19f5e: Waiting for close lock at 1675944179187Running coprocessor pre-close hooks at 1675944179187Disabling compacts and flushes for region at 1675944179187Disabling writes for close at 1675944179188 (+1 ms)Obtaining lock to block concurrent updates at 1675944179188Preparing flush snapshotting stores in e958df22f036975dc576dac705f19f5e at 1675944179188Finished memstore snapshotting hbase:namespace,,1675944169138.e958df22f036975dc576dac705f19f5e., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1675944179189 (+1 ms)Flushing stores of hbase:namespace,,1675944169138.e958df22f036975dc576dac705f19f5e. at 1675944179191 (+2 ms)Flushing e958df22f036975dc576dac705f19f5e/info: creating writer at 1675944179191Flushing e958df22f036975dc576dac705f19f5e/info: appending metadata at 1675944179194 (+3 ms)Flushing e958df22f036975dc576dac705f19f5e/info: closing flushed file at 1675944179195 (+1 ms)Flushing e958df22f036975dc576dac705f19f5e/info: reopening flushed file at 1675944179268 (+73 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for e958df22f036975dc576dac705f19f5e in 93ms, sequenceid=6, compaction requested=false at 1675944179282 (+14 ms)Writing region close event to WAL at 1675944179295 (+13 ms)Running coprocessor post-close hooks at 1675944179301 (+6 ms)Closed at 1675944179301 2023-02-09 12:02:59,302 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1675944169138.e958df22f036975dc576dac705f19f5e. 2023-02-09 12:02:59,322 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.24 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/hbase/meta/1588230740/.tmp/table/5c72296a08f242afb65c86812b84933d 2023-02-09 12:02:59,328 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5c72296a08f242afb65c86812b84933d 2023-02-09 12:02:59,329 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/hbase/meta/1588230740/.tmp/info/d2b3f3857ab8458089dd133a267dda8b as hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/hbase/meta/1588230740/info/d2b3f3857ab8458089dd133a267dda8b 2023-02-09 12:02:59,345 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d2b3f3857ab8458089dd133a267dda8b 2023-02-09 12:02:59,345 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/hbase/meta/1588230740/info/d2b3f3857ab8458089dd133a267dda8b, entries=30, sequenceid=57, filesize=7.9 K 2023-02-09 12:02:59,346 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/hbase/meta/1588230740/.tmp/rep_barrier/79c2ba3a9da041de935facdbbfad8329 as hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/hbase/meta/1588230740/rep_barrier/79c2ba3a9da041de935facdbbfad8329 2023-02-09 12:02:59,352 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 79c2ba3a9da041de935facdbbfad8329 2023-02-09 12:02:59,353 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/hbase/meta/1588230740/rep_barrier/79c2ba3a9da041de935facdbbfad8329, entries=10, sequenceid=57, filesize=5.9 K 2023-02-09 12:02:59,353 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/hbase/meta/1588230740/.tmp/table/5c72296a08f242afb65c86812b84933d as hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/hbase/meta/1588230740/table/5c72296a08f242afb65c86812b84933d 2023-02-09 12:02:59,361 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5c72296a08f242afb65c86812b84933d 2023-02-09 12:02:59,362 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/hbase/meta/1588230740/table/5c72296a08f242afb65c86812b84933d, entries=13, sequenceid=57, filesize=5.9 K 2023-02-09 12:02:59,363 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~24.29 KB/24876, heapSize ~40.16 KB/41120, currentSize=0 B/0 for 1588230740 in 174ms, sequenceid=57, compaction requested=false 2023-02-09 12:02:59,371 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-09 12:02:59,372 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-09 12:02:59,373 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-09 12:02:59,373 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675944179188Running coprocessor pre-close hooks at 1675944179188Disabling compacts and flushes for region at 1675944179188Disabling writes for close at 1675944179189 (+1 ms)Obtaining lock to block concurrent updates at 1675944179189Preparing flush snapshotting stores in 1588230740 at 1675944179189Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=24876, getHeapSize=41120, getOffHeapSize=0, getCellsCount=207 at 1675944179189Flushing stores of hbase:meta,,1.1588230740 at 1675944179192 (+3 ms)Flushing 1588230740/info: creating writer at 1675944179192Flushing 1588230740/info: appending metadata at 1675944179198 (+6 ms)Flushing 1588230740/info: closing flushed file at 1675944179198Flushing 1588230740/rep_barrier: creating writer at 1675944179267 (+69 ms)Flushing 1588230740/rep_barrier: appending metadata at 1675944179270 (+3 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1675944179270Flushing 1588230740/table: creating writer at 1675944179299 (+29 ms)Flushing 1588230740/table: appending metadata at 1675944179302 (+3 ms)Flushing 1588230740/table: closing flushed file at 1675944179302Flushing 1588230740/info: reopening flushed file at 1675944179330 (+28 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1675944179347 (+17 ms)Flushing 1588230740/table: reopening flushed file at 1675944179354 (+7 ms)Finished flush of dataSize ~24.29 KB/24876, heapSize ~40.16 KB/41120, currentSize=0 B/0 for 1588230740 in 174ms, sequenceid=57, compaction requested=false at 1675944179363 (+9 ms)Writing region close event to WAL at 1675944179368 (+5 ms)Running coprocessor post-close hooks at 1675944179372 (+4 ms)Closed at 1675944179373 (+1 ms) 2023-02-09 12:02:59,373 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-09 12:02:59,391 INFO [RS:0;jenkins-hbase4:43865] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,43865,1675944167040; all regions closed. 2023-02-09 12:02:59,391 INFO [RS:1;jenkins-hbase4:40063] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,40063,1675944167089; all regions closed. 2023-02-09 12:02:59,401 DEBUG [RS:0;jenkins-hbase4:43865] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/oldWALs 2023-02-09 12:02:59,401 INFO [RS:0;jenkins-hbase4:43865] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43865%2C1675944167040.meta:.meta(num 1675944168853) 2023-02-09 12:02:59,401 DEBUG [RS:1;jenkins-hbase4:40063] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/oldWALs 2023-02-09 12:02:59,401 INFO [RS:1;jenkins-hbase4:40063] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40063%2C1675944167089:(num 1675944169545) 2023-02-09 12:02:59,401 DEBUG [RS:1;jenkins-hbase4:40063] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 12:02:59,401 INFO [RS:1;jenkins-hbase4:40063] regionserver.LeaseManager(133): Closed leases 2023-02-09 12:02:59,402 INFO [RS:1;jenkins-hbase4:40063] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-09 12:02:59,403 INFO [RS:1;jenkins-hbase4:40063] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-09 12:02:59,403 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 12:02:59,403 INFO [RS:1;jenkins-hbase4:40063] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-09 12:02:59,403 INFO [RS:1;jenkins-hbase4:40063] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-09 12:02:59,404 INFO [RS:1;jenkins-hbase4:40063] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40063 2023-02-09 12:02:59,405 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/WALs/jenkins-hbase4.apache.org,43865,1675944167040/jenkins-hbase4.apache.org%2C43865%2C1675944167040.1675944169546 not finished, retry = 0 2023-02-09 12:02:59,412 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): regionserver:40063-0x10038f668060002, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40063,1675944167089 2023-02-09 12:02:59,412 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 12:02:59,412 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): regionserver:40063-0x10038f668060002, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 12:02:59,412 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): regionserver:43865-0x10038f668060001, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40063,1675944167089 2023-02-09 12:02:59,412 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): regionserver:43865-0x10038f668060001, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 12:02:59,412 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40063,1675944167089] 2023-02-09 12:02:59,412 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40063,1675944167089; numProcessing=1 2023-02-09 12:02:59,414 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40063,1675944167089 already deleted, retry=false 2023-02-09 12:02:59,414 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,40063,1675944167089 expired; onlineServers=1 2023-02-09 12:02:59,476 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-09 12:02:59,476 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-09 12:02:59,508 DEBUG [RS:0;jenkins-hbase4:43865] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/oldWALs 2023-02-09 12:02:59,508 INFO [RS:0;jenkins-hbase4:43865] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43865%2C1675944167040:(num 1675944169546) 2023-02-09 12:02:59,508 DEBUG [RS:0;jenkins-hbase4:43865] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 12:02:59,508 INFO [RS:0;jenkins-hbase4:43865] regionserver.LeaseManager(133): Closed leases 2023-02-09 12:02:59,509 INFO [RS:0;jenkins-hbase4:43865] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-09 12:02:59,509 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 12:02:59,510 INFO [RS:0;jenkins-hbase4:43865] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43865 2023-02-09 12:02:59,514 INFO [RS:1;jenkins-hbase4:40063] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,40063,1675944167089; zookeeper connection closed. 2023-02-09 12:02:59,514 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): regionserver:40063-0x10038f668060002, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 12:02:59,514 ERROR [Listener at localhost/43097-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@43ee90bc rejected from java.util.concurrent.ThreadPoolExecutor@47d10c19[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 12:02:59,515 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): regionserver:40063-0x10038f668060002, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 12:02:59,515 ERROR [Listener at localhost/43097-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4c7b79b rejected from java.util.concurrent.ThreadPoolExecutor@47d10c19[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 12:02:59,520 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1c379b69] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1c379b69 2023-02-09 12:02:59,520 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): regionserver:43865-0x10038f668060001, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43865,1675944167040 2023-02-09 12:02:59,520 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 12:02:59,520 ERROR [Listener at localhost/43097-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6bcd7ffd rejected from java.util.concurrent.ThreadPoolExecutor@6ff2e65c[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 12:02:59,524 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,43865,1675944167040] 2023-02-09 12:02:59,524 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,43865,1675944167040; numProcessing=2 2023-02-09 12:02:59,525 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,43865,1675944167040 already deleted, retry=false 2023-02-09 12:02:59,526 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,43865,1675944167040 expired; onlineServers=0 2023-02-09 12:02:59,526 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,32779,1675944165832' ***** 2023-02-09 12:02:59,526 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-09 12:02:59,526 DEBUG [M:0;jenkins-hbase4:32779] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@323bd5ad, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 12:02:59,526 INFO [M:0;jenkins-hbase4:32779] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,32779,1675944165832 2023-02-09 12:02:59,526 INFO [M:0;jenkins-hbase4:32779] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,32779,1675944165832; all regions closed. 2023-02-09 12:02:59,526 DEBUG [M:0;jenkins-hbase4:32779] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 12:02:59,526 DEBUG [M:0;jenkins-hbase4:32779] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-09 12:02:59,527 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-09 12:02:59,527 DEBUG [M:0;jenkins-hbase4:32779] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-09 12:02:59,527 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675944168280] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675944168280,5,FailOnTimeoutGroup] 2023-02-09 12:02:59,527 INFO [M:0;jenkins-hbase4:32779] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-09 12:02:59,527 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675944168283] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675944168283,5,FailOnTimeoutGroup] 2023-02-09 12:02:59,528 INFO [M:0;jenkins-hbase4:32779] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-09 12:02:59,528 INFO [M:0;jenkins-hbase4:32779] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-09 12:02:59,528 DEBUG [M:0;jenkins-hbase4:32779] master.HMaster(1502): Stopping service threads 2023-02-09 12:02:59,528 INFO [M:0;jenkins-hbase4:32779] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-09 12:02:59,529 ERROR [M:0;jenkins-hbase4:32779] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-1,5,PEWorkerGroup] Thread[HFileArchiver-2,5,PEWorkerGroup] Thread[HFileArchiver-3,5,PEWorkerGroup] Thread[HFileArchiver-4,5,PEWorkerGroup] Thread[HFileArchiver-5,5,PEWorkerGroup] Thread[HFileArchiver-6,5,PEWorkerGroup] Thread[HFileArchiver-7,5,PEWorkerGroup] Thread[HFileArchiver-8,5,PEWorkerGroup] 2023-02-09 12:02:59,529 INFO [M:0;jenkins-hbase4:32779] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-09 12:02:59,530 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-09 12:02:59,624 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): regionserver:43865-0x10038f668060001, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 12:02:59,625 ERROR [Listener at localhost/43097-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1ba2ee59 rejected from java.util.concurrent.ThreadPoolExecutor@6ff2e65c[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 12:02:59,625 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): regionserver:43865-0x10038f668060001, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 12:02:59,625 ERROR [Listener at localhost/43097-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@63a89d7f rejected from java.util.concurrent.ThreadPoolExecutor@6ff2e65c[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 12:02:59,625 INFO [RS:0;jenkins-hbase4:43865] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,43865,1675944167040; zookeeper connection closed. 2023-02-09 12:02:59,625 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@3d67f67f] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@3d67f67f 2023-02-09 12:02:59,626 INFO [Listener at localhost/43097] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-09 12:02:59,635 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-09 12:02:59,635 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 12:02:59,635 INFO [M:0;jenkins-hbase4:32779] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-09 12:02:59,635 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/master already deleted, retry=false 2023-02-09 12:02:59,636 DEBUG [RegionServerTracker-0] master.ActiveMasterManager(332): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Failed delete of our master address node; KeeperErrorCode = NoNode for /hbase/master 2023-02-09 12:02:59,636 INFO [M:0;jenkins-hbase4:32779] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-09 12:02:59,637 DEBUG [M:0;jenkins-hbase4:32779] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-09 12:02:59,637 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 12:02:59,637 INFO [M:0;jenkins-hbase4:32779] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 12:02:59,637 DEBUG [M:0;jenkins-hbase4:32779] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 12:02:59,637 DEBUG [M:0;jenkins-hbase4:32779] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-09 12:02:59,637 DEBUG [M:0;jenkins-hbase4:32779] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 12:02:59,638 INFO [M:0;jenkins-hbase4:32779] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=159.22 KB heapSize=192.14 KB 2023-02-09 12:02:59,687 INFO [M:0;jenkins-hbase4:32779] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=159.22 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/93b8809ab76f4c31a03ef10d38116123 2023-02-09 12:02:59,696 DEBUG [M:0;jenkins-hbase4:32779] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/93b8809ab76f4c31a03ef10d38116123 as hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/93b8809ab76f4c31a03ef10d38116123 2023-02-09 12:02:59,701 INFO [M:0;jenkins-hbase4:32779] regionserver.HStore(1080): Added hdfs://localhost:35113/user/jenkins/test-data/e7c60c14-8127-6021-9caa-90b8570d3eef/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/93b8809ab76f4c31a03ef10d38116123, entries=53, sequenceid=357, filesize=10.4 K 2023-02-09 12:02:59,703 INFO [M:0;jenkins-hbase4:32779] regionserver.HRegion(2947): Finished flush of dataSize ~159.22 KB/163044, heapSize ~192.13 KB/196736, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 66ms, sequenceid=357, compaction requested=false 2023-02-09 12:02:59,704 INFO [M:0;jenkins-hbase4:32779] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 12:02:59,704 DEBUG [M:0;jenkins-hbase4:32779] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675944179637Disabling compacts and flushes for region at 1675944179637Disabling writes for close at 1675944179637Obtaining lock to block concurrent updates at 1675944179638 (+1 ms)Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1675944179638Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=163044, getHeapSize=196736, getOffHeapSize=0, getCellsCount=442 at 1675944179638Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1675944179640 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1675944179640Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1675944179645 (+5 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1675944179645Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1675944179697 (+52 ms)Finished flush of dataSize ~159.22 KB/163044, heapSize ~192.13 KB/196736, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 66ms, sequenceid=357, compaction requested=false at 1675944179703 (+6 ms)Writing region close event to WAL at 1675944179704 (+1 ms)Closed at 1675944179704 2023-02-09 12:02:59,710 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 12:02:59,710 INFO [M:0;jenkins-hbase4:32779] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-09 12:02:59,711 INFO [M:0;jenkins-hbase4:32779] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:32779 2023-02-09 12:02:59,713 DEBUG [M:0;jenkins-hbase4:32779] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,32779,1675944165832 already deleted, retry=false 2023-02-09 12:02:59,821 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 12:02:59,821 INFO [M:0;jenkins-hbase4:32779] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,32779,1675944165832; zookeeper connection closed. 2023-02-09 12:02:59,821 ERROR [Listener at localhost/43097-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@78c619b6 rejected from java.util.concurrent.ThreadPoolExecutor@4fddff0e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 12:02:59,821 DEBUG [Listener at localhost/43097-EventThread] zookeeper.ZKWatcher(600): master:32779-0x10038f668060000, quorum=127.0.0.1:61812, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 12:02:59,821 ERROR [Listener at localhost/43097-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3c1f626b rejected from java.util.concurrent.ThreadPoolExecutor@4fddff0e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 12:02:59,824 WARN [Listener at localhost/43097] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-09 12:02:59,834 INFO [Listener at localhost/43097] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 12:02:59,842 WARN [BP-1253045442-172.31.14.131-1675944162316 heartbeating to localhost/127.0.0.1:35113] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-09 12:02:59,842 WARN [BP-1253045442-172.31.14.131-1675944162316 heartbeating to localhost/127.0.0.1:35113] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1253045442-172.31.14.131-1675944162316 (Datanode Uuid ca64a16a-0a5f-47a2-85c1-8f00887d03a5) service to localhost/127.0.0.1:35113 2023-02-09 12:02:59,844 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30ca3dca-f74a-9aa7-fe8b-05af2eaef0f9/cluster_3582c6ee-f89b-e892-7cd7-cc19fbe4515b/dfs/data/data3/current/BP-1253045442-172.31.14.131-1675944162316] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 12:02:59,844 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30ca3dca-f74a-9aa7-fe8b-05af2eaef0f9/cluster_3582c6ee-f89b-e892-7cd7-cc19fbe4515b/dfs/data/data4/current/BP-1253045442-172.31.14.131-1675944162316] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 12:02:59,847 WARN [Listener at localhost/43097] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-09 12:02:59,856 INFO [Listener at localhost/43097] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 12:02:59,866 WARN [BP-1253045442-172.31.14.131-1675944162316 heartbeating to localhost/127.0.0.1:35113] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-09 12:02:59,866 WARN [BP-1253045442-172.31.14.131-1675944162316 heartbeating to localhost/127.0.0.1:35113] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1253045442-172.31.14.131-1675944162316 (Datanode Uuid ce50577f-f86e-44ab-952c-63e6ea6e7622) service to localhost/127.0.0.1:35113 2023-02-09 12:02:59,867 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30ca3dca-f74a-9aa7-fe8b-05af2eaef0f9/cluster_3582c6ee-f89b-e892-7cd7-cc19fbe4515b/dfs/data/data1/current/BP-1253045442-172.31.14.131-1675944162316] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 12:02:59,868 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30ca3dca-f74a-9aa7-fe8b-05af2eaef0f9/cluster_3582c6ee-f89b-e892-7cd7-cc19fbe4515b/dfs/data/data2/current/BP-1253045442-172.31.14.131-1675944162316] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 12:02:59,913 INFO [Listener at localhost/43097] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 12:03:00,035 INFO [Listener at localhost/43097] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-09 12:03:00,107 INFO [Listener at localhost/43097] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-09 12:03:00,121 INFO [Listener at localhost/43097] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=103 (was 7) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:35113 from jenkins.hfs.1 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:35113 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,32779,1675944165832)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: regionserver/jenkins-hbase4:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/43097 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.0@localhost:35113 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.hdfs.PeerCache@7c71e727 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.PeerCache.run(PeerCache.java:253) org.apache.hadoop.hdfs.PeerCache.access$000(PeerCache.java:46) org.apache.hadoop.hdfs.PeerCache$1.run(PeerCache.java:124) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Monitor thread for TaskMonitor java.lang.Thread.sleep(Native Method) org.apache.hadoop.hbase.monitoring.TaskMonitor$MonitorRunnable.run(TaskMonitor.java:300) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Idle-Rpc-Conn-Sweeper-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.1@localhost:35113 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: ForkJoinPool-2-worker-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: RpcClient-timer-pool-0 java.lang.Thread.sleep(Native Method) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:600) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:496) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: ForkJoinPool-2-worker-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: RS-EventLoopGroup-3-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:35113 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ForkJoinPool-2-worker-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:35113 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-1 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase4:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SessionTracker java.lang.Thread.sleep(Native Method) org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:35113 from jenkins.hfs.0 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-4-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner java.lang.Object.wait(Native Method) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165) org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner.run(FileSystem.java:3693) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SnapshotHandlerChoreCleaner sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HBase-Metrics2-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=543 (was 242) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=250 (was 209) - SystemLoadAverage LEAK? -, ProcessCount=166 (was 166), AvailableMemoryMB=3695 (was 4916) 2023-02-09 12:03:00,131 INFO [Listener at localhost/43097] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=103, OpenFileDescriptor=543, MaxFileDescriptor=60000, SystemLoadAverage=250, ProcessCount=166, AvailableMemoryMB=3695 2023-02-09 12:03:00,142 INFO [Listener at localhost/43097] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30ca3dca-f74a-9aa7-fe8b-05af2eaef0f9/hadoop.log.dir so I do NOT create it in target/test-data/4f4a1677-b9c2-11c9-6e72-f44b3a4b8222 2023-02-09 12:03:00,142 WARN [Listener at localhost/43097] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30ca3dca-f74a-9aa7-fe8b-05af2eaef0f9/hadoop.log.dir Erasing configuration value by system value. 2023-02-09 12:03:00,142 INFO [Listener at localhost/43097] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30ca3dca-f74a-9aa7-fe8b-05af2eaef0f9/hadoop.tmp.dir so I do NOT create it in target/test-data/4f4a1677-b9c2-11c9-6e72-f44b3a4b8222 2023-02-09 12:03:00,142 WARN [Listener at localhost/43097] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30ca3dca-f74a-9aa7-fe8b-05af2eaef0f9/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-09 12:03:00,142 DEBUG [Listener at localhost/43097] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4f4a1677-b9c2-11c9-6e72-f44b3a4b8222 2023-02-09 12:03:00,142 INFO [Listener at localhost/43097] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-09 12:03:00,142 INFO [Listener at localhost/43097] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4f4a1677-b9c2-11c9-6e72-f44b3a4b8222/cluster_20755aa6-e4e8-8b03-8c63-3e3f85986b3c, deleteOnExit=true 2023-02-09 12:03:00,142 INFO [Listener at localhost/43097] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-09 12:03:00,142 INFO [Listener at localhost/43097] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4f4a1677-b9c2-11c9-6e72-f44b3a4b8222/test.cache.data in system properties and HBase conf 2023-02-09 12:03:00,143 INFO [Listener at localhost/43097] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4f4a1677-b9c2-11c9-6e72-f44b3a4b8222/hadoop.tmp.dir in system properties and HBase conf 2023-02-09 12:03:00,143 INFO [Listener at localhost/43097] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4f4a1677-b9c2-11c9-6e72-f44b3a4b8222/hadoop.log.dir in system properties and HBase conf 2023-02-09 12:03:00,143 INFO [Listener at localhost/43097] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4f4a1677-b9c2-11c9-6e72-f44b3a4b8222/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-09 12:03:00,143 INFO [Listener at localhost/43097] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4f4a1677-b9c2-11c9-6e72-f44b3a4b8222/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-09 12:03:00,143 INFO [Listener at localhost/43097] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-09 12:03:00,143 DEBUG [Listener at localhost/43097] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-09 12:03:00,143 INFO [Listener at localhost/43097] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4f4a1677-b9c2-11c9-6e72-f44b3a4b8222/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-09 12:03:00,143 INFO [Listener at localhost/43097] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4f4a1677-b9c2-11c9-6e72-f44b3a4b8222/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-09 12:03:00,143 INFO [Listener at localhost/43097] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4f4a1677-b9c2-11c9-6e72-f44b3a4b8222/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-09 12:03:00,143 INFO [Listener at localhost/43097] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4f4a1677-b9c2-11c9-6e72-f44b3a4b8222/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-09 12:03:00,144 INFO [Listener at localhost/43097] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4f4a1677-b9c2-11c9-6e72-f44b3a4b8222/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-09 12:03:00,144 INFO [Listener at localhost/43097] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4f4a1677-b9c2-11c9-6e72-f44b3a4b8222/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-09 12:03:00,144 INFO [Listener at localhost/43097] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4f4a1677-b9c2-11c9-6e72-f44b3a4b8222/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-09 12:03:00,144 INFO [Listener at localhost/43097] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4f4a1677-b9c2-11c9-6e72-f44b3a4b8222/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-09 12:03:00,144 INFO [Listener at localhost/43097] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4f4a1677-b9c2-11c9-6e72-f44b3a4b8222/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-09 12:03:00,144 INFO [Listener at localhost/43097] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4f4a1677-b9c2-11c9-6e72-f44b3a4b8222/nfs.dump.dir in system properties and HBase conf 2023-02-09 12:03:00,144 INFO [Listener at localhost/43097] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4f4a1677-b9c2-11c9-6e72-f44b3a4b8222/java.io.tmpdir in system properties and HBase conf 2023-02-09 12:03:00,144 INFO [Listener at localhost/43097] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4f4a1677-b9c2-11c9-6e72-f44b3a4b8222/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-09 12:03:00,144 INFO [Listener at localhost/43097] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4f4a1677-b9c2-11c9-6e72-f44b3a4b8222/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-09 12:03:00,144 INFO [Listener at localhost/43097] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4f4a1677-b9c2-11c9-6e72-f44b3a4b8222/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-09 12:03:00,149 WARN [Listener at localhost/43097] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-09 12:03:00,149 WARN [Listener at localhost/43097] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-09 12:03:00,201 WARN [Listener at localhost/43097] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 12:03:00,203 INFO [Listener at localhost/43097] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 12:03:00,208 INFO [Listener at localhost/43097] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4f4a1677-b9c2-11c9-6e72-f44b3a4b8222/java.io.tmpdir/Jetty_localhost_41819_hdfs____xvq4bx/webapp 2023-02-09 12:03:00,315 INFO [Listener at localhost/43097] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41819 2023-02-09 12:03:00,319 WARN [Listener at localhost/43097] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-09 12:03:00,319 WARN [Listener at localhost/43097] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-09 12:03:00,370 WARN [Listener at localhost/35677] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 12:03:00,382 WARN [Listener at localhost/35677] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-09 12:03:00,384 WARN [Listener at localhost/35677] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 12:03:00,385 INFO [Listener at localhost/35677] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 12:03:00,392 INFO [Listener at localhost/35677] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4f4a1677-b9c2-11c9-6e72-f44b3a4b8222/java.io.tmpdir/Jetty_localhost_36699_datanode____.t88kcm/webapp 2023-02-09 12:03:00,494 INFO [Listener at localhost/35677] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36699 2023-02-09 12:03:00,502 WARN [Listener at localhost/36439] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 12:03:00,518 WARN [Listener at localhost/36439] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-09 12:03:00,520 WARN [Listener at localhost/36439] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 12:03:00,522 INFO [Listener at localhost/36439] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 12:03:00,531 INFO [Listener at localhost/36439] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4f4a1677-b9c2-11c9-6e72-f44b3a4b8222/java.io.tmpdir/Jetty_localhost_37233_datanode____cwrtp1/webapp 2023-02-09 12:03:00,611 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd4870139211591b0: Processing first storage report for DS-43da0d8a-143f-4c83-b68f-8cadcf0dc9b6 from datanode eef49c46-bea1-4163-a4f4-3f56bcfccd25 2023-02-09 12:03:00,612 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd4870139211591b0: from storage DS-43da0d8a-143f-4c83-b68f-8cadcf0dc9b6 node DatanodeRegistration(127.0.0.1:46349, datanodeUuid=eef49c46-bea1-4163-a4f4-3f56bcfccd25, infoPort=42491, infoSecurePort=0, ipcPort=36439, storageInfo=lv=-57;cid=testClusterID;nsid=1784838964;c=1675944180151), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 12:03:00,612 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd4870139211591b0: Processing first storage report for DS-9c7ef79e-ce4c-40a2-92f4-b5931f56235b from datanode eef49c46-bea1-4163-a4f4-3f56bcfccd25 2023-02-09 12:03:00,612 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd4870139211591b0: from storage DS-9c7ef79e-ce4c-40a2-92f4-b5931f56235b node DatanodeRegistration(127.0.0.1:46349, datanodeUuid=eef49c46-bea1-4163-a4f4-3f56bcfccd25, infoPort=42491, infoSecurePort=0, ipcPort=36439, storageInfo=lv=-57;cid=testClusterID;nsid=1784838964;c=1675944180151), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 12:03:00,639 INFO [Listener at localhost/36439] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37233 2023-02-09 12:03:00,649 WARN [Listener at localhost/36513] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 12:03:00,749 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x62a8f5bfa5eba4dd: Processing first storage report for DS-86bc2540-dbd3-4182-a231-07f0e0b5bbc8 from datanode 82ff60a2-e703-4695-bd78-2998491c23c1 2023-02-09 12:03:00,749 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x62a8f5bfa5eba4dd: from storage DS-86bc2540-dbd3-4182-a231-07f0e0b5bbc8 node DatanodeRegistration(127.0.0.1:33633, datanodeUuid=82ff60a2-e703-4695-bd78-2998491c23c1, infoPort=36665, infoSecurePort=0, ipcPort=36513, storageInfo=lv=-57;cid=testClusterID;nsid=1784838964;c=1675944180151), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 12:03:00,749 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x62a8f5bfa5eba4dd: Processing first storage report for DS-58c40961-20f8-4d80-8951-dc65d24e1536 from datanode 82ff60a2-e703-4695-bd78-2998491c23c1 2023-02-09 12:03:00,749 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x62a8f5bfa5eba4dd: from storage DS-58c40961-20f8-4d80-8951-dc65d24e1536 node DatanodeRegistration(127.0.0.1:33633, datanodeUuid=82ff60a2-e703-4695-bd78-2998491c23c1, infoPort=36665, infoSecurePort=0, ipcPort=36513, storageInfo=lv=-57;cid=testClusterID;nsid=1784838964;c=1675944180151), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 12:03:00,762 DEBUG [Listener at localhost/36513] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4f4a1677-b9c2-11c9-6e72-f44b3a4b8222 2023-02-09 12:03:00,766 INFO [Listener at localhost/36513] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4f4a1677-b9c2-11c9-6e72-f44b3a4b8222/cluster_20755aa6-e4e8-8b03-8c63-3e3f85986b3c/zookeeper_0, clientPort=63665, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4f4a1677-b9c2-11c9-6e72-f44b3a4b8222/cluster_20755aa6-e4e8-8b03-8c63-3e3f85986b3c/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4f4a1677-b9c2-11c9-6e72-f44b3a4b8222/cluster_20755aa6-e4e8-8b03-8c63-3e3f85986b3c/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-09 12:03:00,767 INFO [Listener at localhost/36513] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=63665 2023-02-09 12:03:00,767 INFO [Listener at localhost/36513] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 12:03:00,769 INFO [Listener at localhost/36513] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 12:03:00,791 INFO [Listener at localhost/36513] util.FSUtils(479): Created version file at hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6 with version=8 2023-02-09 12:03:00,791 INFO [Listener at localhost/36513] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 12:03:00,792 INFO [Listener at localhost/36513] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 12:03:00,794 INFO [Listener at localhost/36513] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:35677/user/jenkins/test-data/070b1f80-84b1-c9f1-7e89-c401c182e07a/hbase-staging 2023-02-09 12:03:00,795 INFO [Listener at localhost/36513] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 12:03:00,795 INFO [Listener at localhost/36513] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 12:03:00,796 INFO [Listener at localhost/36513] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 12:03:00,796 INFO [Listener at localhost/36513] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 12:03:00,796 INFO [Listener at localhost/36513] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 12:03:00,796 INFO [Listener at localhost/36513] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 12:03:00,796 INFO [Listener at localhost/36513] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 12:03:00,797 INFO [Listener at localhost/36513] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37615 2023-02-09 12:03:00,798 INFO [Listener at localhost/36513] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 12:03:00,799 INFO [Listener at localhost/36513] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 12:03:00,800 INFO [Listener at localhost/36513] zookeeper.RecoverableZooKeeper(93): Process identifier=master:37615 connecting to ZooKeeper ensemble=127.0.0.1:63665 2023-02-09 12:03:00,812 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): master:376150x0, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 12:03:00,813 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:37615-0x10038f6a5e10000 connected 2023-02-09 12:03:00,833 DEBUG [Listener at localhost/36513] zookeeper.ZKUtil(164): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 12:03:00,834 DEBUG [Listener at localhost/36513] zookeeper.ZKUtil(164): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 12:03:00,834 DEBUG [Listener at localhost/36513] zookeeper.ZKUtil(164): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 12:03:00,840 DEBUG [Listener at localhost/36513] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37615 2023-02-09 12:03:00,844 DEBUG [Listener at localhost/36513] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37615 2023-02-09 12:03:00,844 DEBUG [Listener at localhost/36513] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37615 2023-02-09 12:03:00,844 DEBUG [Listener at localhost/36513] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37615 2023-02-09 12:03:00,845 DEBUG [Listener at localhost/36513] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37615 2023-02-09 12:03:00,845 INFO [Listener at localhost/36513] master.HMaster(439): hbase.rootdir=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6, hbase.cluster.distributed=false 2023-02-09 12:03:00,860 INFO [Listener at localhost/36513] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 12:03:00,860 INFO [Listener at localhost/36513] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 12:03:00,860 INFO [Listener at localhost/36513] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 12:03:00,860 INFO [Listener at localhost/36513] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 12:03:00,860 INFO [Listener at localhost/36513] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 12:03:00,860 INFO [Listener at localhost/36513] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 12:03:00,860 INFO [Listener at localhost/36513] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 12:03:00,863 INFO [Listener at localhost/36513] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35455 2023-02-09 12:03:00,864 INFO [Listener at localhost/36513] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-09 12:03:00,867 DEBUG [Listener at localhost/36513] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 12:03:00,868 INFO [Listener at localhost/36513] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 12:03:00,869 INFO [Listener at localhost/36513] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 12:03:00,870 INFO [Listener at localhost/36513] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35455 connecting to ZooKeeper ensemble=127.0.0.1:63665 2023-02-09 12:03:00,875 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): regionserver:354550x0, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 12:03:00,876 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:35455-0x10038f6a5e10001 connected 2023-02-09 12:03:00,876 DEBUG [Listener at localhost/36513] zookeeper.ZKUtil(164): regionserver:35455-0x10038f6a5e10001, quorum=127.0.0.1:63665, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 12:03:00,876 DEBUG [Listener at localhost/36513] zookeeper.ZKUtil(164): regionserver:35455-0x10038f6a5e10001, quorum=127.0.0.1:63665, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 12:03:00,877 DEBUG [Listener at localhost/36513] zookeeper.ZKUtil(164): regionserver:35455-0x10038f6a5e10001, quorum=127.0.0.1:63665, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 12:03:00,880 DEBUG [Listener at localhost/36513] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35455 2023-02-09 12:03:00,880 DEBUG [Listener at localhost/36513] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35455 2023-02-09 12:03:00,884 DEBUG [Listener at localhost/36513] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35455 2023-02-09 12:03:00,884 DEBUG [Listener at localhost/36513] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35455 2023-02-09 12:03:00,887 DEBUG [Listener at localhost/36513] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35455 2023-02-09 12:03:00,899 INFO [Listener at localhost/36513] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 12:03:00,899 INFO [Listener at localhost/36513] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 12:03:00,900 INFO [Listener at localhost/36513] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 12:03:00,900 INFO [Listener at localhost/36513] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 12:03:00,900 INFO [Listener at localhost/36513] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 12:03:00,900 INFO [Listener at localhost/36513] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 12:03:00,900 INFO [Listener at localhost/36513] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 12:03:00,902 INFO [Listener at localhost/36513] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43189 2023-02-09 12:03:00,902 INFO [Listener at localhost/36513] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-09 12:03:00,908 DEBUG [Listener at localhost/36513] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 12:03:00,908 INFO [Listener at localhost/36513] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 12:03:00,910 INFO [Listener at localhost/36513] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 12:03:00,911 INFO [Listener at localhost/36513] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43189 connecting to ZooKeeper ensemble=127.0.0.1:63665 2023-02-09 12:03:00,915 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): regionserver:431890x0, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 12:03:00,916 DEBUG [Listener at localhost/36513] zookeeper.ZKUtil(164): regionserver:431890x0, quorum=127.0.0.1:63665, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 12:03:00,917 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:43189-0x10038f6a5e10002 connected 2023-02-09 12:03:00,917 DEBUG [Listener at localhost/36513] zookeeper.ZKUtil(164): regionserver:43189-0x10038f6a5e10002, quorum=127.0.0.1:63665, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 12:03:00,918 DEBUG [Listener at localhost/36513] zookeeper.ZKUtil(164): regionserver:43189-0x10038f6a5e10002, quorum=127.0.0.1:63665, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 12:03:00,920 DEBUG [Listener at localhost/36513] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43189 2023-02-09 12:03:00,923 DEBUG [Listener at localhost/36513] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43189 2023-02-09 12:03:00,924 DEBUG [Listener at localhost/36513] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43189 2023-02-09 12:03:00,927 DEBUG [Listener at localhost/36513] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43189 2023-02-09 12:03:00,927 DEBUG [Listener at localhost/36513] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43189 2023-02-09 12:03:00,933 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,37615,1675944180795 2023-02-09 12:03:00,935 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-09 12:03:00,935 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,37615,1675944180795 2023-02-09 12:03:00,938 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): regionserver:35455-0x10038f6a5e10001, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 12:03:00,938 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 12:03:00,938 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): regionserver:43189-0x10038f6a5e10002, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 12:03:00,939 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 12:03:00,940 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-09 12:03:00,941 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,37615,1675944180795 from backup master directory 2023-02-09 12:03:00,941 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-09 12:03:00,942 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,37615,1675944180795 2023-02-09 12:03:00,943 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-09 12:03:00,943 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 12:03:00,943 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,37615,1675944180795 2023-02-09 12:03:00,965 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/hbase.id with ID: 23444615-c739-4c80-9284-8907f84707af 2023-02-09 12:03:00,979 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 12:03:00,982 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 12:03:00,996 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x1d876702 to 127.0.0.1:63665 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 12:03:01,000 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6da62c1c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 12:03:01,000 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-09 12:03:01,001 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-09 12:03:01,001 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 12:03:01,003 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/MasterData/data/master/store-tmp 2023-02-09 12:03:01,018 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:01,018 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-09 12:03:01,018 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 12:03:01,018 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 12:03:01,018 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-09 12:03:01,019 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 12:03:01,019 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 12:03:01,019 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675944181018Disabling compacts and flushes for region at 1675944181018Disabling writes for close at 1675944181019 (+1 ms)Writing region close event to WAL at 1675944181019Closed at 1675944181019 2023-02-09 12:03:01,019 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/MasterData/WALs/jenkins-hbase4.apache.org,37615,1675944180795 2023-02-09 12:03:01,022 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37615%2C1675944180795, suffix=, logDir=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/MasterData/WALs/jenkins-hbase4.apache.org,37615,1675944180795, archiveDir=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/MasterData/oldWALs, maxLogs=10 2023-02-09 12:03:01,044 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46349,DS-43da0d8a-143f-4c83-b68f-8cadcf0dc9b6,DISK] 2023-02-09 12:03:01,044 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33633,DS-86bc2540-dbd3-4182-a231-07f0e0b5bbc8,DISK] 2023-02-09 12:03:01,048 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/MasterData/WALs/jenkins-hbase4.apache.org,37615,1675944180795/jenkins-hbase4.apache.org%2C37615%2C1675944180795.1675944181022 2023-02-09 12:03:01,048 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46349,DS-43da0d8a-143f-4c83-b68f-8cadcf0dc9b6,DISK], DatanodeInfoWithStorage[127.0.0.1:33633,DS-86bc2540-dbd3-4182-a231-07f0e0b5bbc8,DISK]] 2023-02-09 12:03:01,048 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-09 12:03:01,049 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:01,049 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 12:03:01,049 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 12:03:01,052 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-09 12:03:01,053 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-09 12:03:01,054 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-09 12:03:01,055 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:01,056 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-09 12:03:01,056 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-09 12:03:01,059 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 12:03:01,062 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 12:03:01,062 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64969207, jitterRate=-0.031883373856544495}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 12:03:01,062 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1675944181049Initializing all the Stores at 1675944181049Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944181050 (+1 ms)Cleaning up temporary data from old regions at 1675944181057 (+7 ms)Cleaning up detritus from prior splits at 1675944181057Region opened successfully at 1675944181062 (+5 ms) 2023-02-09 12:03:01,063 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-09 12:03:01,065 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-09 12:03:01,065 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-09 12:03:01,065 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-09 12:03:01,065 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-09 12:03:01,066 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-09 12:03:01,066 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-09 12:03:01,066 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-09 12:03:01,067 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-09 12:03:01,084 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-09 12:03:01,084 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-09 12:03:01,085 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-09 12:03:01,085 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-09 12:03:01,085 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-09 12:03:01,089 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 12:03:01,089 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-09 12:03:01,090 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-09 12:03:01,090 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-09 12:03:01,092 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): regionserver:35455-0x10038f6a5e10001, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 12:03:01,092 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): regionserver:43189-0x10038f6a5e10002, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 12:03:01,092 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 12:03:01,092 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 12:03:01,092 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,37615,1675944180795, sessionid=0x10038f6a5e10000, setting cluster-up flag (Was=false) 2023-02-09 12:03:01,097 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 12:03:01,102 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-09 12:03:01,102 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,37615,1675944180795 2023-02-09 12:03:01,106 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 12:03:01,110 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-09 12:03:01,111 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,37615,1675944180795 2023-02-09 12:03:01,111 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/.hbase-snapshot/.tmp 2023-02-09 12:03:01,113 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-09 12:03:01,114 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 12:03:01,114 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 12:03:01,114 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 12:03:01,114 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 12:03:01,114 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-09 12:03:01,114 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:01,114 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 12:03:01,114 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:01,118 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1675944211118 2023-02-09 12:03:01,118 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-09 12:03:01,118 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-09 12:03:01,118 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-09 12:03:01,118 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-09 12:03:01,119 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-09 12:03:01,119 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-09 12:03:01,119 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-09 12:03:01,119 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:01,119 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-09 12:03:01,120 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-09 12:03:01,121 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-09 12:03:01,121 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-09 12:03:01,121 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-09 12:03:01,122 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-09 12:03:01,122 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-09 12:03:01,122 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675944181122,5,FailOnTimeoutGroup] 2023-02-09 12:03:01,124 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675944181122,5,FailOnTimeoutGroup] 2023-02-09 12:03:01,124 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:01,127 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-09 12:03:01,127 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:01,127 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:01,134 INFO [RS:0;jenkins-hbase4:35455] regionserver.HRegionServer(952): ClusterId : 23444615-c739-4c80-9284-8907f84707af 2023-02-09 12:03:01,134 DEBUG [RS:0;jenkins-hbase4:35455] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-09 12:03:01,134 INFO [RS:1;jenkins-hbase4:43189] regionserver.HRegionServer(952): ClusterId : 23444615-c739-4c80-9284-8907f84707af 2023-02-09 12:03:01,134 DEBUG [RS:1;jenkins-hbase4:43189] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-09 12:03:01,135 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-09 12:03:01,135 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-09 12:03:01,135 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6 2023-02-09 12:03:01,141 DEBUG [RS:0;jenkins-hbase4:35455] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-09 12:03:01,141 DEBUG [RS:0;jenkins-hbase4:35455] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-09 12:03:01,141 DEBUG [RS:1;jenkins-hbase4:43189] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-09 12:03:01,141 DEBUG [RS:1;jenkins-hbase4:43189] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-09 12:03:01,143 DEBUG [RS:0;jenkins-hbase4:35455] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-09 12:03:01,143 DEBUG [RS:1;jenkins-hbase4:43189] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-09 12:03:01,146 DEBUG [RS:0;jenkins-hbase4:35455] zookeeper.ReadOnlyZKClient(139): Connect 0x68fc165c to 127.0.0.1:63665 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 12:03:01,146 DEBUG [RS:1;jenkins-hbase4:43189] zookeeper.ReadOnlyZKClient(139): Connect 0x51ccd630 to 127.0.0.1:63665 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 12:03:01,148 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:01,153 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-09 12:03:01,155 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/hbase/meta/1588230740/info 2023-02-09 12:03:01,155 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-09 12:03:01,156 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:01,156 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-09 12:03:01,157 DEBUG [RS:0;jenkins-hbase4:35455] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@663bf533, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 12:03:01,157 DEBUG [RS:1;jenkins-hbase4:43189] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5f0b3279, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 12:03:01,157 DEBUG [RS:0;jenkins-hbase4:35455] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@62047d2c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 12:03:01,157 DEBUG [RS:1;jenkins-hbase4:43189] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5b34bd40, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 12:03:01,158 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/hbase/meta/1588230740/rep_barrier 2023-02-09 12:03:01,158 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-09 12:03:01,159 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:01,159 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-09 12:03:01,161 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/hbase/meta/1588230740/table 2023-02-09 12:03:01,161 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-09 12:03:01,162 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:01,163 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/hbase/meta/1588230740 2023-02-09 12:03:01,163 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/hbase/meta/1588230740 2023-02-09 12:03:01,166 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-09 12:03:01,167 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-09 12:03:01,167 DEBUG [RS:0;jenkins-hbase4:35455] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:35455 2023-02-09 12:03:01,168 INFO [RS:0;jenkins-hbase4:35455] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-09 12:03:01,168 INFO [RS:0;jenkins-hbase4:35455] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-09 12:03:01,168 DEBUG [RS:0;jenkins-hbase4:35455] regionserver.HRegionServer(1023): About to register with Master. 2023-02-09 12:03:01,168 INFO [RS:0;jenkins-hbase4:35455] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,37615,1675944180795 with isa=jenkins-hbase4.apache.org/172.31.14.131:35455, startcode=1675944180859 2023-02-09 12:03:01,169 DEBUG [RS:0;jenkins-hbase4:35455] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-09 12:03:01,169 DEBUG [RS:1;jenkins-hbase4:43189] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:43189 2023-02-09 12:03:01,169 INFO [RS:1;jenkins-hbase4:43189] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-09 12:03:01,169 INFO [RS:1;jenkins-hbase4:43189] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-09 12:03:01,169 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 12:03:01,169 DEBUG [RS:1;jenkins-hbase4:43189] regionserver.HRegionServer(1023): About to register with Master. 2023-02-09 12:03:01,170 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61223048, jitterRate=-0.08770549297332764}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-09 12:03:01,170 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1675944181148Initializing all the Stores at 1675944181150 (+2 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675944181150Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944181152 (+2 ms)Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675944181152Cleaning up temporary data from old regions at 1675944181164 (+12 ms)Cleaning up detritus from prior splits at 1675944181165 (+1 ms)Region opened successfully at 1675944181170 (+5 ms) 2023-02-09 12:03:01,170 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-09 12:03:01,170 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-09 12:03:01,170 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-09 12:03:01,170 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-09 12:03:01,170 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-09 12:03:01,170 INFO [RS:1;jenkins-hbase4:43189] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,37615,1675944180795 with isa=jenkins-hbase4.apache.org/172.31.14.131:43189, startcode=1675944180899 2023-02-09 12:03:01,171 DEBUG [RS:1;jenkins-hbase4:43189] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-09 12:03:01,177 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-09 12:03:01,177 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675944181170Disabling compacts and flushes for region at 1675944181170Disabling writes for close at 1675944181170Writing region close event to WAL at 1675944181177 (+7 ms)Closed at 1675944181177 2023-02-09 12:03:01,179 INFO [RS-EventLoopGroup-6-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60533, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-02-09 12:03:01,179 INFO [RS-EventLoopGroup-6-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36003, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.3 (auth:SIMPLE), service=RegionServerStatusService 2023-02-09 12:03:01,180 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37615] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,35455,1675944180859 2023-02-09 12:03:01,181 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-09 12:03:01,181 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-09 12:03:01,181 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37615] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,43189,1675944180899 2023-02-09 12:03:01,181 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-09 12:03:01,182 DEBUG [RS:0;jenkins-hbase4:35455] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6 2023-02-09 12:03:01,182 DEBUG [RS:0;jenkins-hbase4:35455] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:35677 2023-02-09 12:03:01,182 DEBUG [RS:0;jenkins-hbase4:35455] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-09 12:03:01,182 DEBUG [RS:1;jenkins-hbase4:43189] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6 2023-02-09 12:03:01,182 DEBUG [RS:1;jenkins-hbase4:43189] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:35677 2023-02-09 12:03:01,182 DEBUG [RS:1;jenkins-hbase4:43189] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-09 12:03:01,183 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 12:03:01,186 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-09 12:03:01,191 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-09 12:03:01,192 DEBUG [RS:0;jenkins-hbase4:35455] zookeeper.ZKUtil(162): regionserver:35455-0x10038f6a5e10001, quorum=127.0.0.1:63665, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35455,1675944180859 2023-02-09 12:03:01,192 WARN [RS:0;jenkins-hbase4:35455] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 12:03:01,192 INFO [RS:0;jenkins-hbase4:35455] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 12:03:01,192 DEBUG [RS:0;jenkins-hbase4:35455] regionserver.HRegionServer(1947): logDir=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/WALs/jenkins-hbase4.apache.org,35455,1675944180859 2023-02-09 12:03:01,193 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,35455,1675944180859] 2023-02-09 12:03:01,193 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,43189,1675944180899] 2023-02-09 12:03:01,194 DEBUG [RS:1;jenkins-hbase4:43189] zookeeper.ZKUtil(162): regionserver:43189-0x10038f6a5e10002, quorum=127.0.0.1:63665, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43189,1675944180899 2023-02-09 12:03:01,194 WARN [RS:1;jenkins-hbase4:43189] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 12:03:01,194 INFO [RS:1;jenkins-hbase4:43189] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 12:03:01,194 DEBUG [RS:1;jenkins-hbase4:43189] regionserver.HRegionServer(1947): logDir=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/WALs/jenkins-hbase4.apache.org,43189,1675944180899 2023-02-09 12:03:01,198 DEBUG [RS:0;jenkins-hbase4:35455] zookeeper.ZKUtil(162): regionserver:35455-0x10038f6a5e10001, quorum=127.0.0.1:63665, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35455,1675944180859 2023-02-09 12:03:01,199 DEBUG [RS:0;jenkins-hbase4:35455] zookeeper.ZKUtil(162): regionserver:35455-0x10038f6a5e10001, quorum=127.0.0.1:63665, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43189,1675944180899 2023-02-09 12:03:01,199 DEBUG [RS:1;jenkins-hbase4:43189] zookeeper.ZKUtil(162): regionserver:43189-0x10038f6a5e10002, quorum=127.0.0.1:63665, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35455,1675944180859 2023-02-09 12:03:01,200 DEBUG [RS:1;jenkins-hbase4:43189] zookeeper.ZKUtil(162): regionserver:43189-0x10038f6a5e10002, quorum=127.0.0.1:63665, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43189,1675944180899 2023-02-09 12:03:01,200 DEBUG [RS:0;jenkins-hbase4:35455] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-09 12:03:01,200 INFO [RS:0;jenkins-hbase4:35455] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-09 12:03:01,201 DEBUG [RS:1;jenkins-hbase4:43189] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-09 12:03:01,202 INFO [RS:1;jenkins-hbase4:43189] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-09 12:03:01,202 INFO [RS:0;jenkins-hbase4:35455] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-09 12:03:01,204 INFO [RS:0;jenkins-hbase4:35455] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 12:03:01,204 INFO [RS:0;jenkins-hbase4:35455] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:01,206 INFO [RS:1;jenkins-hbase4:43189] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-09 12:03:01,206 INFO [RS:0;jenkins-hbase4:35455] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-09 12:03:01,207 INFO [RS:1;jenkins-hbase4:43189] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 12:03:01,207 INFO [RS:1;jenkins-hbase4:43189] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:01,208 INFO [RS:1;jenkins-hbase4:43189] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-09 12:03:01,209 INFO [RS:0;jenkins-hbase4:35455] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:01,209 DEBUG [RS:0;jenkins-hbase4:35455] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:01,209 INFO [RS:1;jenkins-hbase4:43189] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:01,209 DEBUG [RS:0;jenkins-hbase4:35455] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:01,209 DEBUG [RS:1;jenkins-hbase4:43189] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:01,209 DEBUG [RS:0;jenkins-hbase4:35455] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:01,209 DEBUG [RS:1;jenkins-hbase4:43189] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:01,209 DEBUG [RS:0;jenkins-hbase4:35455] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:01,209 DEBUG [RS:1;jenkins-hbase4:43189] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:01,209 DEBUG [RS:0;jenkins-hbase4:35455] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:01,210 DEBUG [RS:1;jenkins-hbase4:43189] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:01,210 DEBUG [RS:0;jenkins-hbase4:35455] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 12:03:01,210 DEBUG [RS:1;jenkins-hbase4:43189] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:01,210 DEBUG [RS:0;jenkins-hbase4:35455] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:01,210 DEBUG [RS:1;jenkins-hbase4:43189] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 12:03:01,210 DEBUG [RS:0;jenkins-hbase4:35455] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:01,210 DEBUG [RS:1;jenkins-hbase4:43189] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:01,210 DEBUG [RS:0;jenkins-hbase4:35455] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:01,210 DEBUG [RS:1;jenkins-hbase4:43189] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:01,210 DEBUG [RS:0;jenkins-hbase4:35455] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:01,210 DEBUG [RS:1;jenkins-hbase4:43189] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:01,210 DEBUG [RS:1;jenkins-hbase4:43189] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:01,217 INFO [RS:0;jenkins-hbase4:35455] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:01,217 INFO [RS:0;jenkins-hbase4:35455] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:01,217 INFO [RS:0;jenkins-hbase4:35455] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:01,220 INFO [RS:1;jenkins-hbase4:43189] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:01,220 INFO [RS:1;jenkins-hbase4:43189] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:01,220 INFO [RS:1;jenkins-hbase4:43189] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:01,232 INFO [RS:0;jenkins-hbase4:35455] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-09 12:03:01,232 INFO [RS:0;jenkins-hbase4:35455] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35455,1675944180859-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:01,235 INFO [RS:1;jenkins-hbase4:43189] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-09 12:03:01,235 INFO [RS:1;jenkins-hbase4:43189] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43189,1675944180899-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:01,247 INFO [RS:0;jenkins-hbase4:35455] regionserver.Replication(203): jenkins-hbase4.apache.org,35455,1675944180859 started 2023-02-09 12:03:01,248 INFO [RS:0;jenkins-hbase4:35455] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,35455,1675944180859, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:35455, sessionid=0x10038f6a5e10001 2023-02-09 12:03:01,248 DEBUG [RS:0;jenkins-hbase4:35455] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-09 12:03:01,248 DEBUG [RS:0;jenkins-hbase4:35455] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,35455,1675944180859 2023-02-09 12:03:01,248 DEBUG [RS:0;jenkins-hbase4:35455] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35455,1675944180859' 2023-02-09 12:03:01,248 DEBUG [RS:0;jenkins-hbase4:35455] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 12:03:01,248 DEBUG [RS:0;jenkins-hbase4:35455] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 12:03:01,249 DEBUG [RS:0;jenkins-hbase4:35455] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-09 12:03:01,249 DEBUG [RS:0;jenkins-hbase4:35455] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-09 12:03:01,249 DEBUG [RS:0;jenkins-hbase4:35455] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,35455,1675944180859 2023-02-09 12:03:01,249 DEBUG [RS:0;jenkins-hbase4:35455] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35455,1675944180859' 2023-02-09 12:03:01,249 DEBUG [RS:0;jenkins-hbase4:35455] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 12:03:01,249 DEBUG [RS:0;jenkins-hbase4:35455] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 12:03:01,249 INFO [RS:1;jenkins-hbase4:43189] regionserver.Replication(203): jenkins-hbase4.apache.org,43189,1675944180899 started 2023-02-09 12:03:01,250 INFO [RS:1;jenkins-hbase4:43189] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,43189,1675944180899, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:43189, sessionid=0x10038f6a5e10002 2023-02-09 12:03:01,250 DEBUG [RS:0;jenkins-hbase4:35455] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-09 12:03:01,250 DEBUG [RS:1;jenkins-hbase4:43189] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-09 12:03:01,250 DEBUG [RS:1;jenkins-hbase4:43189] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,43189,1675944180899 2023-02-09 12:03:01,250 INFO [RS:0;jenkins-hbase4:35455] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-09 12:03:01,250 INFO [RS:0;jenkins-hbase4:35455] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-09 12:03:01,250 DEBUG [RS:1;jenkins-hbase4:43189] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43189,1675944180899' 2023-02-09 12:03:01,250 DEBUG [RS:1;jenkins-hbase4:43189] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 12:03:01,250 DEBUG [RS:1;jenkins-hbase4:43189] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 12:03:01,251 DEBUG [RS:1;jenkins-hbase4:43189] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-09 12:03:01,251 DEBUG [RS:1;jenkins-hbase4:43189] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-09 12:03:01,251 DEBUG [RS:1;jenkins-hbase4:43189] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,43189,1675944180899 2023-02-09 12:03:01,251 DEBUG [RS:1;jenkins-hbase4:43189] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43189,1675944180899' 2023-02-09 12:03:01,251 DEBUG [RS:1;jenkins-hbase4:43189] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 12:03:01,251 DEBUG [RS:1;jenkins-hbase4:43189] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 12:03:01,251 DEBUG [RS:1;jenkins-hbase4:43189] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-09 12:03:01,251 INFO [RS:1;jenkins-hbase4:43189] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-09 12:03:01,251 INFO [RS:1;jenkins-hbase4:43189] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-09 12:03:01,341 DEBUG [jenkins-hbase4:37615] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-09 12:03:01,342 DEBUG [jenkins-hbase4:37615] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 12:03:01,344 DEBUG [jenkins-hbase4:37615] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 12:03:01,344 DEBUG [jenkins-hbase4:37615] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 12:03:01,344 DEBUG [jenkins-hbase4:37615] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 12:03:01,345 INFO [PEWorker-2] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,35455,1675944180859, state=OPENING 2023-02-09 12:03:01,346 DEBUG [PEWorker-2] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-09 12:03:01,348 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 12:03:01,348 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-09 12:03:01,348 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,35455,1675944180859}] 2023-02-09 12:03:01,503 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,35455,1675944180859 2023-02-09 12:03:01,503 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-09 12:03:01,506 INFO [RS-EventLoopGroup-7-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48618, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-09 12:03:01,510 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-09 12:03:01,510 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 12:03:01,512 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35455%2C1675944180859.meta, suffix=.meta, logDir=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/WALs/jenkins-hbase4.apache.org,35455,1675944180859, archiveDir=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/oldWALs, maxLogs=32 2023-02-09 12:03:01,533 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33633,DS-86bc2540-dbd3-4182-a231-07f0e0b5bbc8,DISK] 2023-02-09 12:03:01,534 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46349,DS-43da0d8a-143f-4c83-b68f-8cadcf0dc9b6,DISK] 2023-02-09 12:03:01,536 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/WALs/jenkins-hbase4.apache.org,35455,1675944180859/jenkins-hbase4.apache.org%2C35455%2C1675944180859.meta.1675944181514.meta 2023-02-09 12:03:01,536 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33633,DS-86bc2540-dbd3-4182-a231-07f0e0b5bbc8,DISK], DatanodeInfoWithStorage[127.0.0.1:46349,DS-43da0d8a-143f-4c83-b68f-8cadcf0dc9b6,DISK]] 2023-02-09 12:03:01,536 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-09 12:03:01,536 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-09 12:03:01,537 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-09 12:03:01,537 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-09 12:03:01,538 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-09 12:03:01,538 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:01,538 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-09 12:03:01,538 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-09 12:03:01,539 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-09 12:03:01,541 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/hbase/meta/1588230740/info 2023-02-09 12:03:01,541 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/hbase/meta/1588230740/info 2023-02-09 12:03:01,541 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-09 12:03:01,542 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:01,542 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-09 12:03:01,543 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/hbase/meta/1588230740/rep_barrier 2023-02-09 12:03:01,543 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/hbase/meta/1588230740/rep_barrier 2023-02-09 12:03:01,544 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-09 12:03:01,545 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:01,545 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-09 12:03:01,546 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/hbase/meta/1588230740/table 2023-02-09 12:03:01,546 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/hbase/meta/1588230740/table 2023-02-09 12:03:01,546 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-09 12:03:01,547 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:01,547 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/hbase/meta/1588230740 2023-02-09 12:03:01,549 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/hbase/meta/1588230740 2023-02-09 12:03:01,551 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-09 12:03:01,552 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-09 12:03:01,553 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62941261, jitterRate=-0.062102124094963074}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-09 12:03:01,553 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1675944181538Writing region info on filesystem at 1675944181538Initializing all the Stores at 1675944181539 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675944181539Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944181539Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675944181539Cleaning up temporary data from old regions at 1675944181550 (+11 ms)Cleaning up detritus from prior splits at 1675944181550Running coprocessor post-open hooks at 1675944181553 (+3 ms)Region opened successfully at 1675944181553 2023-02-09 12:03:01,554 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1675944181503 2023-02-09 12:03:01,559 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-09 12:03:01,559 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-09 12:03:01,560 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,35455,1675944180859, state=OPEN 2023-02-09 12:03:01,564 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-09 12:03:01,564 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-09 12:03:01,567 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-09 12:03:01,567 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,35455,1675944180859 in 216 msec 2023-02-09 12:03:01,569 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-09 12:03:01,569 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 386 msec 2023-02-09 12:03:01,571 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 458 msec 2023-02-09 12:03:01,572 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1675944180935, completionTime=-1 2023-02-09 12:03:01,572 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-09 12:03:01,572 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-09 12:03:01,575 DEBUG [hconnection-0x5e4a8ddf-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 12:03:01,578 INFO [RS-EventLoopGroup-7-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48628, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 12:03:01,584 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-09 12:03:01,584 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1675944241584 2023-02-09 12:03:01,584 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1675944301584 2023-02-09 12:03:01,584 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 12 msec 2023-02-09 12:03:01,598 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37615,1675944180795-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:01,598 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37615,1675944180795-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:01,599 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37615,1675944180795-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:01,599 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:37615, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:01,599 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:01,599 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-09 12:03:01,599 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-09 12:03:01,600 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-09 12:03:01,602 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-09 12:03:01,604 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 12:03:01,605 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 12:03:01,607 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/.tmp/data/hbase/namespace/e1dd793ac803300b286ce0e5bfa795cc 2023-02-09 12:03:01,608 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/.tmp/data/hbase/namespace/e1dd793ac803300b286ce0e5bfa795cc empty. 2023-02-09 12:03:01,609 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/.tmp/data/hbase/namespace/e1dd793ac803300b286ce0e5bfa795cc 2023-02-09 12:03:01,609 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-09 12:03:01,624 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-09 12:03:01,625 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => e1dd793ac803300b286ce0e5bfa795cc, NAME => 'hbase:namespace,,1675944181599.e1dd793ac803300b286ce0e5bfa795cc.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/.tmp 2023-02-09 12:03:01,636 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675944181599.e1dd793ac803300b286ce0e5bfa795cc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:01,636 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing e1dd793ac803300b286ce0e5bfa795cc, disabling compactions & flushes 2023-02-09 12:03:01,636 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675944181599.e1dd793ac803300b286ce0e5bfa795cc. 2023-02-09 12:03:01,636 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675944181599.e1dd793ac803300b286ce0e5bfa795cc. 2023-02-09 12:03:01,636 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675944181599.e1dd793ac803300b286ce0e5bfa795cc. after waiting 0 ms 2023-02-09 12:03:01,636 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675944181599.e1dd793ac803300b286ce0e5bfa795cc. 2023-02-09 12:03:01,636 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675944181599.e1dd793ac803300b286ce0e5bfa795cc. 2023-02-09 12:03:01,636 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for e1dd793ac803300b286ce0e5bfa795cc: Waiting for close lock at 1675944181636Disabling compacts and flushes for region at 1675944181636Disabling writes for close at 1675944181636Writing region close event to WAL at 1675944181636Closed at 1675944181636 2023-02-09 12:03:01,639 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 12:03:01,640 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1675944181599.e1dd793ac803300b286ce0e5bfa795cc.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675944181640"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675944181640"}]},"ts":"1675944181640"} 2023-02-09 12:03:01,643 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-09 12:03:01,644 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 12:03:01,645 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675944181644"}]},"ts":"1675944181644"} 2023-02-09 12:03:01,646 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-09 12:03:01,650 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 12:03:01,651 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 12:03:01,651 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 12:03:01,651 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 12:03:01,651 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=e1dd793ac803300b286ce0e5bfa795cc, ASSIGN}] 2023-02-09 12:03:01,654 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=e1dd793ac803300b286ce0e5bfa795cc, ASSIGN 2023-02-09 12:03:01,655 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=e1dd793ac803300b286ce0e5bfa795cc, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35455,1675944180859; forceNewPlan=false, retain=false 2023-02-09 12:03:01,805 INFO [jenkins-hbase4:37615] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-09 12:03:01,806 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=e1dd793ac803300b286ce0e5bfa795cc, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35455,1675944180859 2023-02-09 12:03:01,806 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1675944181599.e1dd793ac803300b286ce0e5bfa795cc.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675944181806"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675944181806"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675944181806"}]},"ts":"1675944181806"} 2023-02-09 12:03:01,809 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure e1dd793ac803300b286ce0e5bfa795cc, server=jenkins-hbase4.apache.org,35455,1675944180859}] 2023-02-09 12:03:01,965 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1675944181599.e1dd793ac803300b286ce0e5bfa795cc. 2023-02-09 12:03:01,967 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35455%2C1675944180859, suffix=, logDir=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/WALs/jenkins-hbase4.apache.org,35455,1675944180859, archiveDir=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/oldWALs, maxLogs=32 2023-02-09 12:03:01,983 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33633,DS-86bc2540-dbd3-4182-a231-07f0e0b5bbc8,DISK] 2023-02-09 12:03:01,985 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46349,DS-43da0d8a-143f-4c83-b68f-8cadcf0dc9b6,DISK] 2023-02-09 12:03:01,987 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/WALs/jenkins-hbase4.apache.org,35455,1675944180859/jenkins-hbase4.apache.org%2C35455%2C1675944180859.1675944181967 2023-02-09 12:03:01,987 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33633,DS-86bc2540-dbd3-4182-a231-07f0e0b5bbc8,DISK], DatanodeInfoWithStorage[127.0.0.1:46349,DS-43da0d8a-143f-4c83-b68f-8cadcf0dc9b6,DISK]] 2023-02-09 12:03:01,987 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e1dd793ac803300b286ce0e5bfa795cc, NAME => 'hbase:namespace,,1675944181599.e1dd793ac803300b286ce0e5bfa795cc.', STARTKEY => '', ENDKEY => ''} 2023-02-09 12:03:01,987 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace e1dd793ac803300b286ce0e5bfa795cc 2023-02-09 12:03:01,987 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675944181599.e1dd793ac803300b286ce0e5bfa795cc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:01,987 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for e1dd793ac803300b286ce0e5bfa795cc 2023-02-09 12:03:01,987 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for e1dd793ac803300b286ce0e5bfa795cc 2023-02-09 12:03:01,989 INFO [StoreOpener-e1dd793ac803300b286ce0e5bfa795cc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region e1dd793ac803300b286ce0e5bfa795cc 2023-02-09 12:03:01,990 DEBUG [StoreOpener-e1dd793ac803300b286ce0e5bfa795cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/hbase/namespace/e1dd793ac803300b286ce0e5bfa795cc/info 2023-02-09 12:03:01,990 DEBUG [StoreOpener-e1dd793ac803300b286ce0e5bfa795cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/hbase/namespace/e1dd793ac803300b286ce0e5bfa795cc/info 2023-02-09 12:03:01,990 INFO [StoreOpener-e1dd793ac803300b286ce0e5bfa795cc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e1dd793ac803300b286ce0e5bfa795cc columnFamilyName info 2023-02-09 12:03:01,991 INFO [StoreOpener-e1dd793ac803300b286ce0e5bfa795cc-1] regionserver.HStore(310): Store=e1dd793ac803300b286ce0e5bfa795cc/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:01,992 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/hbase/namespace/e1dd793ac803300b286ce0e5bfa795cc 2023-02-09 12:03:01,992 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/hbase/namespace/e1dd793ac803300b286ce0e5bfa795cc 2023-02-09 12:03:01,994 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for e1dd793ac803300b286ce0e5bfa795cc 2023-02-09 12:03:01,996 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/hbase/namespace/e1dd793ac803300b286ce0e5bfa795cc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 12:03:01,997 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened e1dd793ac803300b286ce0e5bfa795cc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71070921, jitterRate=0.05903925001621246}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 12:03:01,997 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for e1dd793ac803300b286ce0e5bfa795cc: Running coprocessor pre-open hook at 1675944181988Writing region info on filesystem at 1675944181988Initializing all the Stores at 1675944181988Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675944181988Cleaning up temporary data from old regions at 1675944181992 (+4 ms)Cleaning up detritus from prior splits at 1675944181993 (+1 ms)Running coprocessor post-open hooks at 1675944181997 (+4 ms)Region opened successfully at 1675944181997 2023-02-09 12:03:01,998 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1675944181599.e1dd793ac803300b286ce0e5bfa795cc., pid=6, masterSystemTime=1675944181961 2023-02-09 12:03:02,001 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1675944181599.e1dd793ac803300b286ce0e5bfa795cc. 2023-02-09 12:03:02,001 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1675944181599.e1dd793ac803300b286ce0e5bfa795cc. 2023-02-09 12:03:02,001 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=e1dd793ac803300b286ce0e5bfa795cc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35455,1675944180859 2023-02-09 12:03:02,001 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1675944181599.e1dd793ac803300b286ce0e5bfa795cc.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675944182001"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675944182001"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675944182001"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675944182001"}]},"ts":"1675944182001"} 2023-02-09 12:03:02,005 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-09 12:03:02,005 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure e1dd793ac803300b286ce0e5bfa795cc, server=jenkins-hbase4.apache.org,35455,1675944180859 in 194 msec 2023-02-09 12:03:02,007 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-09 12:03:02,007 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=e1dd793ac803300b286ce0e5bfa795cc, ASSIGN in 354 msec 2023-02-09 12:03:02,008 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 12:03:02,008 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675944182008"}]},"ts":"1675944182008"} 2023-02-09 12:03:02,009 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-09 12:03:02,012 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 12:03:02,013 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 413 msec 2023-02-09 12:03:02,102 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-09 12:03:02,103 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-09 12:03:02,103 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 12:03:02,109 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-09 12:03:02,116 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-09 12:03:02,122 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 13 msec 2023-02-09 12:03:02,131 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-09 12:03:02,139 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-09 12:03:02,144 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 12 msec 2023-02-09 12:03:02,157 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-09 12:03:02,160 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-09 12:03:02,160 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 1.217sec 2023-02-09 12:03:02,167 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-09 12:03:02,167 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-09 12:03:02,167 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-09 12:03:02,167 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37615,1675944180795-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-09 12:03:02,167 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37615,1675944180795-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-09 12:03:02,170 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-09 12:03:02,234 DEBUG [Listener at localhost/36513] zookeeper.ReadOnlyZKClient(139): Connect 0x3e7f48a8 to 127.0.0.1:63665 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 12:03:02,240 DEBUG [Listener at localhost/36513] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@539bc584, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 12:03:02,242 DEBUG [hconnection-0xe13a120-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 12:03:02,244 INFO [RS-EventLoopGroup-7-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48632, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 12:03:02,246 INFO [Listener at localhost/36513] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,37615,1675944180795 2023-02-09 12:03:02,246 DEBUG [Listener at localhost/36513] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-09 12:03:02,246 INFO [Listener at localhost/36513] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:02,247 INFO [Listener at localhost/36513] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:02,249 DEBUG [Listener at localhost/36513] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-09 12:03:02,254 INFO [RS-EventLoopGroup-6-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40944, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-09 12:03:02,254 INFO [Listener at localhost/36513] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-09 12:03:02,255 INFO [RS:1;jenkins-hbase4:43189] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43189%2C1675944180899, suffix=, logDir=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/WALs/jenkins-hbase4.apache.org,43189,1675944180899, archiveDir=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/oldWALs, maxLogs=32 2023-02-09 12:03:02,255 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37615] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-09 12:03:02,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37615] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-09 12:03:02,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37615] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 76 connection: 172.31.14.131:40944 deadline: 1675944242255, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-09 12:03:02,256 INFO [Listener at localhost/36513] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-09 12:03:02,257 INFO [Listener at localhost/36513] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:02,257 INFO [Listener at localhost/36513] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:02,259 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37615] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-09 12:03:02,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37615] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-09 12:03:02,264 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 12:03:02,264 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37615] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-09 12:03:02,265 INFO [Listener at localhost/36513] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:02,265 INFO [Listener at localhost/36513] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:02,265 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 12:03:02,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 12:03:02,278 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33633,DS-86bc2540-dbd3-4182-a231-07f0e0b5bbc8,DISK] 2023-02-09 12:03:02,279 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46349,DS-43da0d8a-143f-4c83-b68f-8cadcf0dc9b6,DISK] 2023-02-09 12:03:02,280 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/.tmp/data/default/testWithMapReduce/08fa7b5b79fbcbb53ed767bc07fed909 2023-02-09 12:03:02,280 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/.tmp/data/default/testWithMapReduce/b9bd8844b5681299737e0a2f071b03f3 2023-02-09 12:03:02,280 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/.tmp/data/default/testWithMapReduce/266cae67ac0efcfe59291a310a667874 2023-02-09 12:03:02,280 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/.tmp/data/default/testWithMapReduce/57c7ac6814f18d2541df5c154c377d70 2023-02-09 12:03:02,281 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/.tmp/data/default/testWithMapReduce/148e52758718776d49fecdf247dc20da 2023-02-09 12:03:02,281 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/.tmp/data/default/testWithMapReduce/546fab1946eca3d1b91f4645b19fe169 2023-02-09 12:03:02,281 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/.tmp/data/default/testWithMapReduce/fc52dac117cb96590c6edd7ac65df056 2023-02-09 12:03:02,281 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/.tmp/data/default/testWithMapReduce/f8b958d29e440ca92af212e18425d242 2023-02-09 12:03:02,281 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/.tmp/data/default/testWithMapReduce/08fa7b5b79fbcbb53ed767bc07fed909 empty. 2023-02-09 12:03:02,281 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/.tmp/data/default/testWithMapReduce/546fab1946eca3d1b91f4645b19fe169 empty. 2023-02-09 12:03:02,282 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/.tmp/data/default/testWithMapReduce/08fa7b5b79fbcbb53ed767bc07fed909 2023-02-09 12:03:02,282 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/.tmp/data/default/testWithMapReduce/24db9ec6cca428b56e442ed464c75a7f 2023-02-09 12:03:02,282 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/.tmp/data/default/testWithMapReduce/57c7ac6814f18d2541df5c154c377d70 empty. 2023-02-09 12:03:02,282 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/.tmp/data/default/testWithMapReduce/148e52758718776d49fecdf247dc20da empty. 2023-02-09 12:03:02,282 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/.tmp/data/default/testWithMapReduce/266cae67ac0efcfe59291a310a667874 empty. 2023-02-09 12:03:02,282 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/.tmp/data/default/testWithMapReduce/148e52758718776d49fecdf247dc20da 2023-02-09 12:03:02,282 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/.tmp/data/default/testWithMapReduce/57c7ac6814f18d2541df5c154c377d70 2023-02-09 12:03:02,282 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/.tmp/data/default/testWithMapReduce/24db9ec6cca428b56e442ed464c75a7f empty. 2023-02-09 12:03:02,282 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/.tmp/data/default/testWithMapReduce/e361e7c32d779b70cb86f6640113527e 2023-02-09 12:03:02,283 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/.tmp/data/default/testWithMapReduce/b9bd8844b5681299737e0a2f071b03f3 empty. 2023-02-09 12:03:02,283 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/.tmp/data/default/testWithMapReduce/24db9ec6cca428b56e442ed464c75a7f 2023-02-09 12:03:02,283 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/.tmp/data/default/testWithMapReduce/e361e7c32d779b70cb86f6640113527e empty. 2023-02-09 12:03:02,283 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/.tmp/data/default/testWithMapReduce/266cae67ac0efcfe59291a310a667874 2023-02-09 12:03:02,283 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/.tmp/data/default/testWithMapReduce/546fab1946eca3d1b91f4645b19fe169 2023-02-09 12:03:02,284 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/.tmp/data/default/testWithMapReduce/f8b958d29e440ca92af212e18425d242 empty. 2023-02-09 12:03:02,284 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/.tmp/data/default/testWithMapReduce/e361e7c32d779b70cb86f6640113527e 2023-02-09 12:03:02,284 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/.tmp/data/default/testWithMapReduce/b9bd8844b5681299737e0a2f071b03f3 2023-02-09 12:03:02,284 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/.tmp/data/default/testWithMapReduce/fc52dac117cb96590c6edd7ac65df056 empty. 2023-02-09 12:03:02,284 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/.tmp/data/default/testWithMapReduce/f8b958d29e440ca92af212e18425d242 2023-02-09 12:03:02,284 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/.tmp/data/default/testWithMapReduce/fc52dac117cb96590c6edd7ac65df056 2023-02-09 12:03:02,285 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-09 12:03:02,288 INFO [RS:1;jenkins-hbase4:43189] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/WALs/jenkins-hbase4.apache.org,43189,1675944180899/jenkins-hbase4.apache.org%2C43189%2C1675944180899.1675944182255 2023-02-09 12:03:02,289 DEBUG [RS:1;jenkins-hbase4:43189] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33633,DS-86bc2540-dbd3-4182-a231-07f0e0b5bbc8,DISK], DatanodeInfoWithStorage[127.0.0.1:46349,DS-43da0d8a-143f-4c83-b68f-8cadcf0dc9b6,DISK]] 2023-02-09 12:03:02,299 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-09 12:03:02,301 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => b9bd8844b5681299737e0a2f071b03f3, NAME => 'testWithMapReduce,aaa,1675944182259.b9bd8844b5681299737e0a2f071b03f3.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/.tmp 2023-02-09 12:03:02,301 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 08fa7b5b79fbcbb53ed767bc07fed909, NAME => 'testWithMapReduce,,1675944182259.08fa7b5b79fbcbb53ed767bc07fed909.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/.tmp 2023-02-09 12:03:02,305 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 266cae67ac0efcfe59291a310a667874, NAME => 'testWithMapReduce,d\x84\x84,1675944182259.266cae67ac0efcfe59291a310a667874.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/.tmp 2023-02-09 12:03:02,324 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1675944182259.b9bd8844b5681299737e0a2f071b03f3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:02,324 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing b9bd8844b5681299737e0a2f071b03f3, disabling compactions & flushes 2023-02-09 12:03:02,325 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1675944182259.b9bd8844b5681299737e0a2f071b03f3. 2023-02-09 12:03:02,325 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1675944182259.b9bd8844b5681299737e0a2f071b03f3. 2023-02-09 12:03:02,325 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1675944182259.b9bd8844b5681299737e0a2f071b03f3. after waiting 0 ms 2023-02-09 12:03:02,325 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675944182259.08fa7b5b79fbcbb53ed767bc07fed909.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:02,325 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1675944182259.b9bd8844b5681299737e0a2f071b03f3. 2023-02-09 12:03:02,325 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1675944182259.b9bd8844b5681299737e0a2f071b03f3. 2023-02-09 12:03:02,325 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for b9bd8844b5681299737e0a2f071b03f3: Waiting for close lock at 1675944182324Disabling compacts and flushes for region at 1675944182324Disabling writes for close at 1675944182325 (+1 ms)Writing region close event to WAL at 1675944182325Closed at 1675944182325 2023-02-09 12:03:02,325 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 08fa7b5b79fbcbb53ed767bc07fed909, disabling compactions & flushes 2023-02-09 12:03:02,326 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675944182259.08fa7b5b79fbcbb53ed767bc07fed909. 2023-02-09 12:03:02,326 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 57c7ac6814f18d2541df5c154c377d70, NAME => 'testWithMapReduce,g\xA7\xA7,1675944182259.57c7ac6814f18d2541df5c154c377d70.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/.tmp 2023-02-09 12:03:02,326 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675944182259.08fa7b5b79fbcbb53ed767bc07fed909. 2023-02-09 12:03:02,326 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675944182259.08fa7b5b79fbcbb53ed767bc07fed909. after waiting 0 ms 2023-02-09 12:03:02,326 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675944182259.08fa7b5b79fbcbb53ed767bc07fed909. 2023-02-09 12:03:02,326 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675944182259.08fa7b5b79fbcbb53ed767bc07fed909. 2023-02-09 12:03:02,326 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 08fa7b5b79fbcbb53ed767bc07fed909: Waiting for close lock at 1675944182325Disabling compacts and flushes for region at 1675944182325Disabling writes for close at 1675944182326 (+1 ms)Writing region close event to WAL at 1675944182326Closed at 1675944182326 2023-02-09 12:03:02,326 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 148e52758718776d49fecdf247dc20da, NAME => 'testWithMapReduce,j\xCA\xCA,1675944182259.148e52758718776d49fecdf247dc20da.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/.tmp 2023-02-09 12:03:02,340 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1675944182259.266cae67ac0efcfe59291a310a667874.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:02,340 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 266cae67ac0efcfe59291a310a667874, disabling compactions & flushes 2023-02-09 12:03:02,340 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1675944182259.266cae67ac0efcfe59291a310a667874. 2023-02-09 12:03:02,341 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1675944182259.266cae67ac0efcfe59291a310a667874. 2023-02-09 12:03:02,341 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1675944182259.266cae67ac0efcfe59291a310a667874. after waiting 0 ms 2023-02-09 12:03:02,341 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1675944182259.266cae67ac0efcfe59291a310a667874. 2023-02-09 12:03:02,341 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1675944182259.266cae67ac0efcfe59291a310a667874. 2023-02-09 12:03:02,341 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 266cae67ac0efcfe59291a310a667874: Waiting for close lock at 1675944182340Disabling compacts and flushes for region at 1675944182340Disabling writes for close at 1675944182341 (+1 ms)Writing region close event to WAL at 1675944182341Closed at 1675944182341 2023-02-09 12:03:02,341 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 546fab1946eca3d1b91f4645b19fe169, NAME => 'testWithMapReduce,m\xED\xED,1675944182259.546fab1946eca3d1b91f4645b19fe169.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/.tmp 2023-02-09 12:03:02,356 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1675944182259.57c7ac6814f18d2541df5c154c377d70.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:02,356 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 57c7ac6814f18d2541df5c154c377d70, disabling compactions & flushes 2023-02-09 12:03:02,356 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1675944182259.57c7ac6814f18d2541df5c154c377d70. 2023-02-09 12:03:02,356 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1675944182259.57c7ac6814f18d2541df5c154c377d70. 2023-02-09 12:03:02,356 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1675944182259.57c7ac6814f18d2541df5c154c377d70. after waiting 0 ms 2023-02-09 12:03:02,356 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1675944182259.57c7ac6814f18d2541df5c154c377d70. 2023-02-09 12:03:02,356 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1675944182259.57c7ac6814f18d2541df5c154c377d70. 2023-02-09 12:03:02,356 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 57c7ac6814f18d2541df5c154c377d70: Waiting for close lock at 1675944182356Disabling compacts and flushes for region at 1675944182356Disabling writes for close at 1675944182356Writing region close event to WAL at 1675944182356Closed at 1675944182356 2023-02-09 12:03:02,356 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1675944182259.148e52758718776d49fecdf247dc20da.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:02,357 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 148e52758718776d49fecdf247dc20da, disabling compactions & flushes 2023-02-09 12:03:02,357 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1675944182259.148e52758718776d49fecdf247dc20da. 2023-02-09 12:03:02,357 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1675944182259.148e52758718776d49fecdf247dc20da. 2023-02-09 12:03:02,357 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1675944182259.148e52758718776d49fecdf247dc20da. after waiting 0 ms 2023-02-09 12:03:02,357 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1675944182259.148e52758718776d49fecdf247dc20da. 2023-02-09 12:03:02,357 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1675944182259.148e52758718776d49fecdf247dc20da. 2023-02-09 12:03:02,357 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 148e52758718776d49fecdf247dc20da: Waiting for close lock at 1675944182357Disabling compacts and flushes for region at 1675944182357Disabling writes for close at 1675944182357Writing region close event to WAL at 1675944182357Closed at 1675944182357 2023-02-09 12:03:02,357 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => fc52dac117cb96590c6edd7ac65df056, NAME => 'testWithMapReduce,t43,1675944182259.fc52dac117cb96590c6edd7ac65df056.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/.tmp 2023-02-09 12:03:02,357 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => f8b958d29e440ca92af212e18425d242, NAME => 'testWithMapReduce,q\x11\x10,1675944182259.f8b958d29e440ca92af212e18425d242.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/.tmp 2023-02-09 12:03:02,368 INFO [Listener at localhost/36513] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:02,368 INFO [Listener at localhost/36513] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:02,368 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1675944182259.546fab1946eca3d1b91f4645b19fe169.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:02,369 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 546fab1946eca3d1b91f4645b19fe169, disabling compactions & flushes 2023-02-09 12:03:02,369 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1675944182259.546fab1946eca3d1b91f4645b19fe169. 2023-02-09 12:03:02,369 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1675944182259.546fab1946eca3d1b91f4645b19fe169. 2023-02-09 12:03:02,369 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1675944182259.546fab1946eca3d1b91f4645b19fe169. after waiting 0 ms 2023-02-09 12:03:02,369 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1675944182259.546fab1946eca3d1b91f4645b19fe169. 2023-02-09 12:03:02,369 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1675944182259.546fab1946eca3d1b91f4645b19fe169. 2023-02-09 12:03:02,369 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 546fab1946eca3d1b91f4645b19fe169: Waiting for close lock at 1675944182369Disabling compacts and flushes for region at 1675944182369Disabling writes for close at 1675944182369Writing region close event to WAL at 1675944182369Closed at 1675944182369 2023-02-09 12:03:02,369 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 24db9ec6cca428b56e442ed464c75a7f, NAME => 'testWithMapReduce,wWV,1675944182259.24db9ec6cca428b56e442ed464c75a7f.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/.tmp 2023-02-09 12:03:02,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 12:03:02,382 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1675944182259.f8b958d29e440ca92af212e18425d242.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:02,382 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing f8b958d29e440ca92af212e18425d242, disabling compactions & flushes 2023-02-09 12:03:02,382 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1675944182259.f8b958d29e440ca92af212e18425d242. 2023-02-09 12:03:02,382 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1675944182259.f8b958d29e440ca92af212e18425d242. 2023-02-09 12:03:02,382 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1675944182259.f8b958d29e440ca92af212e18425d242. after waiting 0 ms 2023-02-09 12:03:02,382 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1675944182259.f8b958d29e440ca92af212e18425d242. 2023-02-09 12:03:02,382 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1675944182259.f8b958d29e440ca92af212e18425d242. 2023-02-09 12:03:02,382 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for f8b958d29e440ca92af212e18425d242: Waiting for close lock at 1675944182382Disabling compacts and flushes for region at 1675944182382Disabling writes for close at 1675944182382Writing region close event to WAL at 1675944182382Closed at 1675944182382 2023-02-09 12:03:02,383 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => e361e7c32d779b70cb86f6640113527e, NAME => 'testWithMapReduce,zz{,1675944182259.e361e7c32d779b70cb86f6640113527e.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/.tmp 2023-02-09 12:03:02,383 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1675944182259.fc52dac117cb96590c6edd7ac65df056.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:02,383 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing fc52dac117cb96590c6edd7ac65df056, disabling compactions & flushes 2023-02-09 12:03:02,383 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1675944182259.fc52dac117cb96590c6edd7ac65df056. 2023-02-09 12:03:02,383 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1675944182259.fc52dac117cb96590c6edd7ac65df056. 2023-02-09 12:03:02,383 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1675944182259.fc52dac117cb96590c6edd7ac65df056. after waiting 0 ms 2023-02-09 12:03:02,383 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1675944182259.fc52dac117cb96590c6edd7ac65df056. 2023-02-09 12:03:02,383 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1675944182259.fc52dac117cb96590c6edd7ac65df056. 2023-02-09 12:03:02,383 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for fc52dac117cb96590c6edd7ac65df056: Waiting for close lock at 1675944182383Disabling compacts and flushes for region at 1675944182383Disabling writes for close at 1675944182383Writing region close event to WAL at 1675944182383Closed at 1675944182383 2023-02-09 12:03:02,388 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1675944182259.24db9ec6cca428b56e442ed464c75a7f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:02,388 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 24db9ec6cca428b56e442ed464c75a7f, disabling compactions & flushes 2023-02-09 12:03:02,388 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1675944182259.24db9ec6cca428b56e442ed464c75a7f. 2023-02-09 12:03:02,388 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1675944182259.24db9ec6cca428b56e442ed464c75a7f. 2023-02-09 12:03:02,389 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1675944182259.24db9ec6cca428b56e442ed464c75a7f. after waiting 0 ms 2023-02-09 12:03:02,389 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1675944182259.24db9ec6cca428b56e442ed464c75a7f. 2023-02-09 12:03:02,389 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1675944182259.24db9ec6cca428b56e442ed464c75a7f. 2023-02-09 12:03:02,389 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 24db9ec6cca428b56e442ed464c75a7f: Waiting for close lock at 1675944182388Disabling compacts and flushes for region at 1675944182388Disabling writes for close at 1675944182389 (+1 ms)Writing region close event to WAL at 1675944182389Closed at 1675944182389 2023-02-09 12:03:02,392 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1675944182259.e361e7c32d779b70cb86f6640113527e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:02,392 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing e361e7c32d779b70cb86f6640113527e, disabling compactions & flushes 2023-02-09 12:03:02,393 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1675944182259.e361e7c32d779b70cb86f6640113527e. 2023-02-09 12:03:02,393 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1675944182259.e361e7c32d779b70cb86f6640113527e. 2023-02-09 12:03:02,393 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1675944182259.e361e7c32d779b70cb86f6640113527e. after waiting 0 ms 2023-02-09 12:03:02,393 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1675944182259.e361e7c32d779b70cb86f6640113527e. 2023-02-09 12:03:02,393 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1675944182259.e361e7c32d779b70cb86f6640113527e. 2023-02-09 12:03:02,393 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for e361e7c32d779b70cb86f6640113527e: Waiting for close lock at 1675944182392Disabling compacts and flushes for region at 1675944182392Disabling writes for close at 1675944182393 (+1 ms)Writing region close event to WAL at 1675944182393Closed at 1675944182393 2023-02-09 12:03:02,396 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 12:03:02,397 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1675944182259.b9bd8844b5681299737e0a2f071b03f3.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675944182397"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675944182397"}]},"ts":"1675944182397"} 2023-02-09 12:03:02,397 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1675944182259.08fa7b5b79fbcbb53ed767bc07fed909.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675944182397"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675944182397"}]},"ts":"1675944182397"} 2023-02-09 12:03:02,397 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1675944182259.266cae67ac0efcfe59291a310a667874.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675944182397"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675944182397"}]},"ts":"1675944182397"} 2023-02-09 12:03:02,397 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1675944182259.57c7ac6814f18d2541df5c154c377d70.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675944182397"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675944182397"}]},"ts":"1675944182397"} 2023-02-09 12:03:02,397 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1675944182259.148e52758718776d49fecdf247dc20da.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675944182397"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675944182397"}]},"ts":"1675944182397"} 2023-02-09 12:03:02,398 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1675944182259.546fab1946eca3d1b91f4645b19fe169.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675944182397"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675944182397"}]},"ts":"1675944182397"} 2023-02-09 12:03:02,398 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1675944182259.f8b958d29e440ca92af212e18425d242.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675944182397"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675944182397"}]},"ts":"1675944182397"} 2023-02-09 12:03:02,398 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1675944182259.fc52dac117cb96590c6edd7ac65df056.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675944182397"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675944182397"}]},"ts":"1675944182397"} 2023-02-09 12:03:02,398 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1675944182259.24db9ec6cca428b56e442ed464c75a7f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675944182397"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675944182397"}]},"ts":"1675944182397"} 2023-02-09 12:03:02,398 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1675944182259.e361e7c32d779b70cb86f6640113527e.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675944182397"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675944182397"}]},"ts":"1675944182397"} 2023-02-09 12:03:02,404 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-09 12:03:02,405 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 12:03:02,406 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675944182405"}]},"ts":"1675944182405"} 2023-02-09 12:03:02,407 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-09 12:03:02,414 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 12:03:02,423 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 12:03:02,423 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 12:03:02,423 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 12:03:02,423 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=08fa7b5b79fbcbb53ed767bc07fed909, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=b9bd8844b5681299737e0a2f071b03f3, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=266cae67ac0efcfe59291a310a667874, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=57c7ac6814f18d2541df5c154c377d70, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=148e52758718776d49fecdf247dc20da, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=546fab1946eca3d1b91f4645b19fe169, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=f8b958d29e440ca92af212e18425d242, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=fc52dac117cb96590c6edd7ac65df056, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=24db9ec6cca428b56e442ed464c75a7f, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e361e7c32d779b70cb86f6640113527e, ASSIGN}] 2023-02-09 12:03:02,426 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=b9bd8844b5681299737e0a2f071b03f3, ASSIGN 2023-02-09 12:03:02,426 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=266cae67ac0efcfe59291a310a667874, ASSIGN 2023-02-09 12:03:02,426 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=57c7ac6814f18d2541df5c154c377d70, ASSIGN 2023-02-09 12:03:02,427 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=08fa7b5b79fbcbb53ed767bc07fed909, ASSIGN 2023-02-09 12:03:02,427 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=b9bd8844b5681299737e0a2f071b03f3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35455,1675944180859; forceNewPlan=false, retain=false 2023-02-09 12:03:02,427 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=266cae67ac0efcfe59291a310a667874, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35455,1675944180859; forceNewPlan=false, retain=false 2023-02-09 12:03:02,427 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=57c7ac6814f18d2541df5c154c377d70, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43189,1675944180899; forceNewPlan=false, retain=false 2023-02-09 12:03:02,428 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=08fa7b5b79fbcbb53ed767bc07fed909, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43189,1675944180899; forceNewPlan=false, retain=false 2023-02-09 12:03:02,428 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e361e7c32d779b70cb86f6640113527e, ASSIGN 2023-02-09 12:03:02,428 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=24db9ec6cca428b56e442ed464c75a7f, ASSIGN 2023-02-09 12:03:02,429 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=fc52dac117cb96590c6edd7ac65df056, ASSIGN 2023-02-09 12:03:02,429 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=f8b958d29e440ca92af212e18425d242, ASSIGN 2023-02-09 12:03:02,430 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=546fab1946eca3d1b91f4645b19fe169, ASSIGN 2023-02-09 12:03:02,430 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=e361e7c32d779b70cb86f6640113527e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43189,1675944180899; forceNewPlan=false, retain=false 2023-02-09 12:03:02,430 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=24db9ec6cca428b56e442ed464c75a7f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35455,1675944180859; forceNewPlan=false, retain=false 2023-02-09 12:03:02,430 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=fc52dac117cb96590c6edd7ac65df056, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43189,1675944180899; forceNewPlan=false, retain=false 2023-02-09 12:03:02,430 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=f8b958d29e440ca92af212e18425d242, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35455,1675944180859; forceNewPlan=false, retain=false 2023-02-09 12:03:02,431 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=546fab1946eca3d1b91f4645b19fe169, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43189,1675944180899; forceNewPlan=false, retain=false 2023-02-09 12:03:02,431 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=148e52758718776d49fecdf247dc20da, ASSIGN 2023-02-09 12:03:02,432 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=148e52758718776d49fecdf247dc20da, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35455,1675944180859; forceNewPlan=false, retain=false 2023-02-09 12:03:02,570 INFO [Listener at localhost/36513] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:02,571 INFO [Listener at localhost/36513] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:02,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 12:03:02,577 INFO [jenkins-hbase4:37615] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-09 12:03:02,583 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=08fa7b5b79fbcbb53ed767bc07fed909, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43189,1675944180899 2023-02-09 12:03:02,583 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1675944182259.08fa7b5b79fbcbb53ed767bc07fed909.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675944182583"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675944182583"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675944182583"}]},"ts":"1675944182583"} 2023-02-09 12:03:02,583 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=57c7ac6814f18d2541df5c154c377d70, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43189,1675944180899 2023-02-09 12:03:02,583 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1675944182259.57c7ac6814f18d2541df5c154c377d70.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675944182583"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675944182583"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675944182583"}]},"ts":"1675944182583"} 2023-02-09 12:03:02,590 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=546fab1946eca3d1b91f4645b19fe169, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43189,1675944180899 2023-02-09 12:03:02,590 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=fc52dac117cb96590c6edd7ac65df056, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43189,1675944180899 2023-02-09 12:03:02,590 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1675944182259.fc52dac117cb96590c6edd7ac65df056.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675944182590"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675944182590"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675944182590"}]},"ts":"1675944182590"} 2023-02-09 12:03:02,591 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1675944182259.546fab1946eca3d1b91f4645b19fe169.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675944182590"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675944182590"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675944182590"}]},"ts":"1675944182590"} 2023-02-09 12:03:02,591 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=11, state=RUNNABLE; OpenRegionProcedure 08fa7b5b79fbcbb53ed767bc07fed909, server=jenkins-hbase4.apache.org,43189,1675944180899}] 2023-02-09 12:03:02,592 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=14, state=RUNNABLE; OpenRegionProcedure 57c7ac6814f18d2541df5c154c377d70, server=jenkins-hbase4.apache.org,43189,1675944180899}] 2023-02-09 12:03:02,594 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=18, state=RUNNABLE; OpenRegionProcedure fc52dac117cb96590c6edd7ac65df056, server=jenkins-hbase4.apache.org,43189,1675944180899}] 2023-02-09 12:03:02,595 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=e361e7c32d779b70cb86f6640113527e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43189,1675944180899 2023-02-09 12:03:02,595 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1675944182259.e361e7c32d779b70cb86f6640113527e.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675944182594"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675944182594"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675944182594"}]},"ts":"1675944182594"} 2023-02-09 12:03:02,595 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=16, state=RUNNABLE; OpenRegionProcedure 546fab1946eca3d1b91f4645b19fe169, server=jenkins-hbase4.apache.org,43189,1675944180899}] 2023-02-09 12:03:02,597 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=20, state=RUNNABLE; OpenRegionProcedure e361e7c32d779b70cb86f6640113527e, server=jenkins-hbase4.apache.org,43189,1675944180899}] 2023-02-09 12:03:02,609 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=24db9ec6cca428b56e442ed464c75a7f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35455,1675944180859 2023-02-09 12:03:02,609 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1675944182259.24db9ec6cca428b56e442ed464c75a7f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675944182609"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675944182609"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675944182609"}]},"ts":"1675944182609"} 2023-02-09 12:03:02,610 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=148e52758718776d49fecdf247dc20da, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35455,1675944180859 2023-02-09 12:03:02,610 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1675944182259.148e52758718776d49fecdf247dc20da.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675944182610"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675944182610"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675944182610"}]},"ts":"1675944182610"} 2023-02-09 12:03:02,610 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=266cae67ac0efcfe59291a310a667874, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35455,1675944180859 2023-02-09 12:03:02,611 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1675944182259.266cae67ac0efcfe59291a310a667874.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675944182610"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675944182610"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675944182610"}]},"ts":"1675944182610"} 2023-02-09 12:03:02,611 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=f8b958d29e440ca92af212e18425d242, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35455,1675944180859 2023-02-09 12:03:02,611 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1675944182259.f8b958d29e440ca92af212e18425d242.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675944182611"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675944182611"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675944182611"}]},"ts":"1675944182611"} 2023-02-09 12:03:02,613 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=19, state=RUNNABLE; OpenRegionProcedure 24db9ec6cca428b56e442ed464c75a7f, server=jenkins-hbase4.apache.org,35455,1675944180859}] 2023-02-09 12:03:02,613 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=b9bd8844b5681299737e0a2f071b03f3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35455,1675944180859 2023-02-09 12:03:02,614 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1675944182259.b9bd8844b5681299737e0a2f071b03f3.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675944182613"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675944182613"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675944182613"}]},"ts":"1675944182613"} 2023-02-09 12:03:02,616 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=13, state=RUNNABLE; OpenRegionProcedure 266cae67ac0efcfe59291a310a667874, server=jenkins-hbase4.apache.org,35455,1675944180859}] 2023-02-09 12:03:02,616 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=15, state=RUNNABLE; OpenRegionProcedure 148e52758718776d49fecdf247dc20da, server=jenkins-hbase4.apache.org,35455,1675944180859}] 2023-02-09 12:03:02,617 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=17, state=RUNNABLE; OpenRegionProcedure f8b958d29e440ca92af212e18425d242, server=jenkins-hbase4.apache.org,35455,1675944180859}] 2023-02-09 12:03:02,617 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=12, state=RUNNABLE; OpenRegionProcedure b9bd8844b5681299737e0a2f071b03f3, server=jenkins-hbase4.apache.org,35455,1675944180859}] 2023-02-09 12:03:02,755 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,43189,1675944180899 2023-02-09 12:03:02,756 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-09 12:03:02,759 INFO [RS-EventLoopGroup-8-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51084, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-09 12:03:02,763 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1675944182259.57c7ac6814f18d2541df5c154c377d70. 2023-02-09 12:03:02,763 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 57c7ac6814f18d2541df5c154c377d70, NAME => 'testWithMapReduce,g\xA7\xA7,1675944182259.57c7ac6814f18d2541df5c154c377d70.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-09 12:03:02,763 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 57c7ac6814f18d2541df5c154c377d70 2023-02-09 12:03:02,763 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1675944182259.57c7ac6814f18d2541df5c154c377d70.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:02,763 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 57c7ac6814f18d2541df5c154c377d70 2023-02-09 12:03:02,763 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 57c7ac6814f18d2541df5c154c377d70 2023-02-09 12:03:02,765 INFO [StoreOpener-57c7ac6814f18d2541df5c154c377d70-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 57c7ac6814f18d2541df5c154c377d70 2023-02-09 12:03:02,766 DEBUG [StoreOpener-57c7ac6814f18d2541df5c154c377d70-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/57c7ac6814f18d2541df5c154c377d70/f1 2023-02-09 12:03:02,766 DEBUG [StoreOpener-57c7ac6814f18d2541df5c154c377d70-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/57c7ac6814f18d2541df5c154c377d70/f1 2023-02-09 12:03:02,767 INFO [StoreOpener-57c7ac6814f18d2541df5c154c377d70-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 57c7ac6814f18d2541df5c154c377d70 columnFamilyName f1 2023-02-09 12:03:02,767 INFO [StoreOpener-57c7ac6814f18d2541df5c154c377d70-1] regionserver.HStore(310): Store=57c7ac6814f18d2541df5c154c377d70/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:02,767 INFO [StoreOpener-57c7ac6814f18d2541df5c154c377d70-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 57c7ac6814f18d2541df5c154c377d70 2023-02-09 12:03:02,768 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1675944182259.f8b958d29e440ca92af212e18425d242. 2023-02-09 12:03:02,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => f8b958d29e440ca92af212e18425d242, NAME => 'testWithMapReduce,q\x11\x10,1675944182259.f8b958d29e440ca92af212e18425d242.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-09 12:03:02,769 DEBUG [StoreOpener-57c7ac6814f18d2541df5c154c377d70-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/57c7ac6814f18d2541df5c154c377d70/f2 2023-02-09 12:03:02,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce f8b958d29e440ca92af212e18425d242 2023-02-09 12:03:02,769 DEBUG [StoreOpener-57c7ac6814f18d2541df5c154c377d70-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/57c7ac6814f18d2541df5c154c377d70/f2 2023-02-09 12:03:02,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1675944182259.f8b958d29e440ca92af212e18425d242.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:02,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for f8b958d29e440ca92af212e18425d242 2023-02-09 12:03:02,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for f8b958d29e440ca92af212e18425d242 2023-02-09 12:03:02,769 INFO [StoreOpener-57c7ac6814f18d2541df5c154c377d70-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 57c7ac6814f18d2541df5c154c377d70 columnFamilyName f2 2023-02-09 12:03:02,770 INFO [StoreOpener-57c7ac6814f18d2541df5c154c377d70-1] regionserver.HStore(310): Store=57c7ac6814f18d2541df5c154c377d70/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:02,770 INFO [StoreOpener-f8b958d29e440ca92af212e18425d242-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f8b958d29e440ca92af212e18425d242 2023-02-09 12:03:02,771 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/57c7ac6814f18d2541df5c154c377d70 2023-02-09 12:03:02,771 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/57c7ac6814f18d2541df5c154c377d70 2023-02-09 12:03:02,771 DEBUG [StoreOpener-f8b958d29e440ca92af212e18425d242-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/f8b958d29e440ca92af212e18425d242/f1 2023-02-09 12:03:02,771 DEBUG [StoreOpener-f8b958d29e440ca92af212e18425d242-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/f8b958d29e440ca92af212e18425d242/f1 2023-02-09 12:03:02,772 INFO [StoreOpener-f8b958d29e440ca92af212e18425d242-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f8b958d29e440ca92af212e18425d242 columnFamilyName f1 2023-02-09 12:03:02,772 INFO [StoreOpener-f8b958d29e440ca92af212e18425d242-1] regionserver.HStore(310): Store=f8b958d29e440ca92af212e18425d242/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:02,772 INFO [StoreOpener-f8b958d29e440ca92af212e18425d242-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f8b958d29e440ca92af212e18425d242 2023-02-09 12:03:02,773 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 12:03:02,774 DEBUG [StoreOpener-f8b958d29e440ca92af212e18425d242-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/f8b958d29e440ca92af212e18425d242/f2 2023-02-09 12:03:02,774 DEBUG [StoreOpener-f8b958d29e440ca92af212e18425d242-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/f8b958d29e440ca92af212e18425d242/f2 2023-02-09 12:03:02,774 INFO [StoreOpener-f8b958d29e440ca92af212e18425d242-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f8b958d29e440ca92af212e18425d242 columnFamilyName f2 2023-02-09 12:03:02,774 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 57c7ac6814f18d2541df5c154c377d70 2023-02-09 12:03:02,775 INFO [StoreOpener-f8b958d29e440ca92af212e18425d242-1] regionserver.HStore(310): Store=f8b958d29e440ca92af212e18425d242/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:02,776 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/f8b958d29e440ca92af212e18425d242 2023-02-09 12:03:02,777 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/f8b958d29e440ca92af212e18425d242 2023-02-09 12:03:02,777 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/57c7ac6814f18d2541df5c154c377d70/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 12:03:02,778 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 57c7ac6814f18d2541df5c154c377d70; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59439722, jitterRate=-0.1142791211605072}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 12:03:02,778 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 57c7ac6814f18d2541df5c154c377d70: Running coprocessor pre-open hook at 1675944182764Writing region info on filesystem at 1675944182764Initializing all the Stores at 1675944182764Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944182764Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944182765 (+1 ms)Cleaning up temporary data from old regions at 1675944182772 (+7 ms)Cleaning up detritus from prior splits at 1675944182772Running coprocessor post-open hooks at 1675944182778 (+6 ms)Region opened successfully at 1675944182778 2023-02-09 12:03:02,779 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1675944182259.57c7ac6814f18d2541df5c154c377d70., pid=22, masterSystemTime=1675944182755 2023-02-09 12:03:02,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 12:03:02,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1675944182259.57c7ac6814f18d2541df5c154c377d70. 2023-02-09 12:03:02,783 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for f8b958d29e440ca92af212e18425d242 2023-02-09 12:03:02,783 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1675944182259.57c7ac6814f18d2541df5c154c377d70. 2023-02-09 12:03:02,783 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1675944182259.fc52dac117cb96590c6edd7ac65df056. 2023-02-09 12:03:02,783 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=57c7ac6814f18d2541df5c154c377d70, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43189,1675944180899 2023-02-09 12:03:02,784 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => fc52dac117cb96590c6edd7ac65df056, NAME => 'testWithMapReduce,t43,1675944182259.fc52dac117cb96590c6edd7ac65df056.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-09 12:03:02,784 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1675944182259.57c7ac6814f18d2541df5c154c377d70.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675944182783"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675944182783"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675944182783"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675944182783"}]},"ts":"1675944182783"} 2023-02-09 12:03:02,784 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce fc52dac117cb96590c6edd7ac65df056 2023-02-09 12:03:02,784 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1675944182259.fc52dac117cb96590c6edd7ac65df056.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:02,784 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for fc52dac117cb96590c6edd7ac65df056 2023-02-09 12:03:02,784 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for fc52dac117cb96590c6edd7ac65df056 2023-02-09 12:03:02,786 INFO [StoreOpener-fc52dac117cb96590c6edd7ac65df056-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region fc52dac117cb96590c6edd7ac65df056 2023-02-09 12:03:02,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/f8b958d29e440ca92af212e18425d242/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 12:03:02,787 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened f8b958d29e440ca92af212e18425d242; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72725001, jitterRate=0.083686962723732}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 12:03:02,787 DEBUG [StoreOpener-fc52dac117cb96590c6edd7ac65df056-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/fc52dac117cb96590c6edd7ac65df056/f1 2023-02-09 12:03:02,787 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for f8b958d29e440ca92af212e18425d242: Running coprocessor pre-open hook at 1675944182769Writing region info on filesystem at 1675944182769Initializing all the Stores at 1675944182770 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944182770Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944182770Cleaning up temporary data from old regions at 1675944182778 (+8 ms)Cleaning up detritus from prior splits at 1675944182779 (+1 ms)Running coprocessor post-open hooks at 1675944182787 (+8 ms)Region opened successfully at 1675944182787 2023-02-09 12:03:02,787 DEBUG [StoreOpener-fc52dac117cb96590c6edd7ac65df056-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/fc52dac117cb96590c6edd7ac65df056/f1 2023-02-09 12:03:02,788 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=14 2023-02-09 12:03:02,788 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=14, state=SUCCESS; OpenRegionProcedure 57c7ac6814f18d2541df5c154c377d70, server=jenkins-hbase4.apache.org,43189,1675944180899 in 193 msec 2023-02-09 12:03:02,788 INFO [StoreOpener-fc52dac117cb96590c6edd7ac65df056-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fc52dac117cb96590c6edd7ac65df056 columnFamilyName f1 2023-02-09 12:03:02,788 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1675944182259.f8b958d29e440ca92af212e18425d242., pid=29, masterSystemTime=1675944182765 2023-02-09 12:03:02,789 INFO [StoreOpener-fc52dac117cb96590c6edd7ac65df056-1] regionserver.HStore(310): Store=fc52dac117cb96590c6edd7ac65df056/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:02,789 INFO [StoreOpener-fc52dac117cb96590c6edd7ac65df056-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region fc52dac117cb96590c6edd7ac65df056 2023-02-09 12:03:02,790 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=57c7ac6814f18d2541df5c154c377d70, ASSIGN in 365 msec 2023-02-09 12:03:02,790 DEBUG [StoreOpener-fc52dac117cb96590c6edd7ac65df056-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/fc52dac117cb96590c6edd7ac65df056/f2 2023-02-09 12:03:02,791 DEBUG [StoreOpener-fc52dac117cb96590c6edd7ac65df056-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/fc52dac117cb96590c6edd7ac65df056/f2 2023-02-09 12:03:02,791 INFO [StoreOpener-fc52dac117cb96590c6edd7ac65df056-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fc52dac117cb96590c6edd7ac65df056 columnFamilyName f2 2023-02-09 12:03:02,791 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=f8b958d29e440ca92af212e18425d242, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35455,1675944180859 2023-02-09 12:03:02,792 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1675944182259.f8b958d29e440ca92af212e18425d242.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675944182791"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675944182791"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675944182791"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675944182791"}]},"ts":"1675944182791"} 2023-02-09 12:03:02,792 INFO [StoreOpener-fc52dac117cb96590c6edd7ac65df056-1] regionserver.HStore(310): Store=fc52dac117cb96590c6edd7ac65df056/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:02,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/fc52dac117cb96590c6edd7ac65df056 2023-02-09 12:03:02,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/fc52dac117cb96590c6edd7ac65df056 2023-02-09 12:03:02,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1675944182259.f8b958d29e440ca92af212e18425d242. 2023-02-09 12:03:02,793 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1675944182259.f8b958d29e440ca92af212e18425d242. 2023-02-09 12:03:02,793 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1675944182259.266cae67ac0efcfe59291a310a667874. 2023-02-09 12:03:02,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 266cae67ac0efcfe59291a310a667874, NAME => 'testWithMapReduce,d\x84\x84,1675944182259.266cae67ac0efcfe59291a310a667874.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-09 12:03:02,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 266cae67ac0efcfe59291a310a667874 2023-02-09 12:03:02,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1675944182259.266cae67ac0efcfe59291a310a667874.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:02,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 266cae67ac0efcfe59291a310a667874 2023-02-09 12:03:02,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 266cae67ac0efcfe59291a310a667874 2023-02-09 12:03:02,795 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 12:03:02,796 INFO [StoreOpener-266cae67ac0efcfe59291a310a667874-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 266cae67ac0efcfe59291a310a667874 2023-02-09 12:03:02,796 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=17 2023-02-09 12:03:02,796 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=17, state=SUCCESS; OpenRegionProcedure f8b958d29e440ca92af212e18425d242, server=jenkins-hbase4.apache.org,35455,1675944180859 in 177 msec 2023-02-09 12:03:02,797 DEBUG [StoreOpener-266cae67ac0efcfe59291a310a667874-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/266cae67ac0efcfe59291a310a667874/f1 2023-02-09 12:03:02,797 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for fc52dac117cb96590c6edd7ac65df056 2023-02-09 12:03:02,797 DEBUG [StoreOpener-266cae67ac0efcfe59291a310a667874-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/266cae67ac0efcfe59291a310a667874/f1 2023-02-09 12:03:02,798 INFO [StoreOpener-266cae67ac0efcfe59291a310a667874-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 266cae67ac0efcfe59291a310a667874 columnFamilyName f1 2023-02-09 12:03:02,798 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=f8b958d29e440ca92af212e18425d242, ASSIGN in 373 msec 2023-02-09 12:03:02,798 INFO [StoreOpener-266cae67ac0efcfe59291a310a667874-1] regionserver.HStore(310): Store=266cae67ac0efcfe59291a310a667874/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:02,798 INFO [StoreOpener-266cae67ac0efcfe59291a310a667874-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 266cae67ac0efcfe59291a310a667874 2023-02-09 12:03:02,799 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/fc52dac117cb96590c6edd7ac65df056/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 12:03:02,800 DEBUG [StoreOpener-266cae67ac0efcfe59291a310a667874-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/266cae67ac0efcfe59291a310a667874/f2 2023-02-09 12:03:02,800 DEBUG [StoreOpener-266cae67ac0efcfe59291a310a667874-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/266cae67ac0efcfe59291a310a667874/f2 2023-02-09 12:03:02,800 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened fc52dac117cb96590c6edd7ac65df056; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67466668, jitterRate=0.005331695079803467}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 12:03:02,800 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for fc52dac117cb96590c6edd7ac65df056: Running coprocessor pre-open hook at 1675944182784Writing region info on filesystem at 1675944182784Initializing all the Stores at 1675944182785 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944182785Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944182786 (+1 ms)Cleaning up temporary data from old regions at 1675944182794 (+8 ms)Cleaning up detritus from prior splits at 1675944182795 (+1 ms)Running coprocessor post-open hooks at 1675944182800 (+5 ms)Region opened successfully at 1675944182800 2023-02-09 12:03:02,800 INFO [StoreOpener-266cae67ac0efcfe59291a310a667874-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 266cae67ac0efcfe59291a310a667874 columnFamilyName f2 2023-02-09 12:03:02,801 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1675944182259.fc52dac117cb96590c6edd7ac65df056., pid=23, masterSystemTime=1675944182755 2023-02-09 12:03:02,801 INFO [StoreOpener-266cae67ac0efcfe59291a310a667874-1] regionserver.HStore(310): Store=266cae67ac0efcfe59291a310a667874/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:02,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/266cae67ac0efcfe59291a310a667874 2023-02-09 12:03:02,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/266cae67ac0efcfe59291a310a667874 2023-02-09 12:03:02,803 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=fc52dac117cb96590c6edd7ac65df056, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43189,1675944180899 2023-02-09 12:03:02,803 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1675944182259.fc52dac117cb96590c6edd7ac65df056. 2023-02-09 12:03:02,803 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1675944182259.fc52dac117cb96590c6edd7ac65df056. 2023-02-09 12:03:02,803 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1675944182259.08fa7b5b79fbcbb53ed767bc07fed909. 2023-02-09 12:03:02,803 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1675944182259.fc52dac117cb96590c6edd7ac65df056.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675944182803"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675944182803"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675944182803"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675944182803"}]},"ts":"1675944182803"} 2023-02-09 12:03:02,803 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 08fa7b5b79fbcbb53ed767bc07fed909, NAME => 'testWithMapReduce,,1675944182259.08fa7b5b79fbcbb53ed767bc07fed909.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-09 12:03:02,803 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 08fa7b5b79fbcbb53ed767bc07fed909 2023-02-09 12:03:02,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675944182259.08fa7b5b79fbcbb53ed767bc07fed909.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:02,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 08fa7b5b79fbcbb53ed767bc07fed909 2023-02-09 12:03:02,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 08fa7b5b79fbcbb53ed767bc07fed909 2023-02-09 12:03:02,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 12:03:02,805 INFO [StoreOpener-08fa7b5b79fbcbb53ed767bc07fed909-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 08fa7b5b79fbcbb53ed767bc07fed909 2023-02-09 12:03:02,806 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 266cae67ac0efcfe59291a310a667874 2023-02-09 12:03:02,807 DEBUG [StoreOpener-08fa7b5b79fbcbb53ed767bc07fed909-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/08fa7b5b79fbcbb53ed767bc07fed909/f1 2023-02-09 12:03:02,807 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=18 2023-02-09 12:03:02,807 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=18, state=SUCCESS; OpenRegionProcedure fc52dac117cb96590c6edd7ac65df056, server=jenkins-hbase4.apache.org,43189,1675944180899 in 211 msec 2023-02-09 12:03:02,807 DEBUG [StoreOpener-08fa7b5b79fbcbb53ed767bc07fed909-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/08fa7b5b79fbcbb53ed767bc07fed909/f1 2023-02-09 12:03:02,808 INFO [StoreOpener-08fa7b5b79fbcbb53ed767bc07fed909-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 08fa7b5b79fbcbb53ed767bc07fed909 columnFamilyName f1 2023-02-09 12:03:02,808 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=fc52dac117cb96590c6edd7ac65df056, ASSIGN in 384 msec 2023-02-09 12:03:02,809 INFO [StoreOpener-08fa7b5b79fbcbb53ed767bc07fed909-1] regionserver.HStore(310): Store=08fa7b5b79fbcbb53ed767bc07fed909/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:02,809 INFO [StoreOpener-08fa7b5b79fbcbb53ed767bc07fed909-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 08fa7b5b79fbcbb53ed767bc07fed909 2023-02-09 12:03:02,809 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/266cae67ac0efcfe59291a310a667874/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 12:03:02,810 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 266cae67ac0efcfe59291a310a667874; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75463744, jitterRate=0.1244974136352539}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 12:03:02,810 DEBUG [StoreOpener-08fa7b5b79fbcbb53ed767bc07fed909-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/08fa7b5b79fbcbb53ed767bc07fed909/f2 2023-02-09 12:03:02,810 DEBUG [StoreOpener-08fa7b5b79fbcbb53ed767bc07fed909-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/08fa7b5b79fbcbb53ed767bc07fed909/f2 2023-02-09 12:03:02,810 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 266cae67ac0efcfe59291a310a667874: Running coprocessor pre-open hook at 1675944182794Writing region info on filesystem at 1675944182794Initializing all the Stores at 1675944182795 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944182795Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944182795Cleaning up temporary data from old regions at 1675944182803 (+8 ms)Cleaning up detritus from prior splits at 1675944182803Running coprocessor post-open hooks at 1675944182810 (+7 ms)Region opened successfully at 1675944182810 2023-02-09 12:03:02,810 INFO [StoreOpener-08fa7b5b79fbcbb53ed767bc07fed909-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 08fa7b5b79fbcbb53ed767bc07fed909 columnFamilyName f2 2023-02-09 12:03:02,811 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1675944182259.266cae67ac0efcfe59291a310a667874., pid=27, masterSystemTime=1675944182765 2023-02-09 12:03:02,811 INFO [StoreOpener-08fa7b5b79fbcbb53ed767bc07fed909-1] regionserver.HStore(310): Store=08fa7b5b79fbcbb53ed767bc07fed909/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:02,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/08fa7b5b79fbcbb53ed767bc07fed909 2023-02-09 12:03:02,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1675944182259.266cae67ac0efcfe59291a310a667874. 2023-02-09 12:03:02,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/08fa7b5b79fbcbb53ed767bc07fed909 2023-02-09 12:03:02,812 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1675944182259.266cae67ac0efcfe59291a310a667874. 2023-02-09 12:03:02,813 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1675944182259.b9bd8844b5681299737e0a2f071b03f3. 2023-02-09 12:03:02,813 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => b9bd8844b5681299737e0a2f071b03f3, NAME => 'testWithMapReduce,aaa,1675944182259.b9bd8844b5681299737e0a2f071b03f3.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-09 12:03:02,813 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=266cae67ac0efcfe59291a310a667874, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35455,1675944180859 2023-02-09 12:03:02,813 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce b9bd8844b5681299737e0a2f071b03f3 2023-02-09 12:03:02,813 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1675944182259.266cae67ac0efcfe59291a310a667874.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675944182813"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675944182813"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675944182813"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675944182813"}]},"ts":"1675944182813"} 2023-02-09 12:03:02,813 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1675944182259.b9bd8844b5681299737e0a2f071b03f3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:02,813 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for b9bd8844b5681299737e0a2f071b03f3 2023-02-09 12:03:02,813 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for b9bd8844b5681299737e0a2f071b03f3 2023-02-09 12:03:02,815 INFO [StoreOpener-b9bd8844b5681299737e0a2f071b03f3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b9bd8844b5681299737e0a2f071b03f3 2023-02-09 12:03:02,815 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 12:03:02,816 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 08fa7b5b79fbcbb53ed767bc07fed909 2023-02-09 12:03:02,817 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=13 2023-02-09 12:03:02,817 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=13, state=SUCCESS; OpenRegionProcedure 266cae67ac0efcfe59291a310a667874, server=jenkins-hbase4.apache.org,35455,1675944180859 in 200 msec 2023-02-09 12:03:02,818 DEBUG [StoreOpener-b9bd8844b5681299737e0a2f071b03f3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/b9bd8844b5681299737e0a2f071b03f3/f1 2023-02-09 12:03:02,818 DEBUG [StoreOpener-b9bd8844b5681299737e0a2f071b03f3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/b9bd8844b5681299737e0a2f071b03f3/f1 2023-02-09 12:03:02,818 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=266cae67ac0efcfe59291a310a667874, ASSIGN in 394 msec 2023-02-09 12:03:02,819 INFO [StoreOpener-b9bd8844b5681299737e0a2f071b03f3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b9bd8844b5681299737e0a2f071b03f3 columnFamilyName f1 2023-02-09 12:03:02,819 INFO [StoreOpener-b9bd8844b5681299737e0a2f071b03f3-1] regionserver.HStore(310): Store=b9bd8844b5681299737e0a2f071b03f3/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:02,820 INFO [StoreOpener-b9bd8844b5681299737e0a2f071b03f3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b9bd8844b5681299737e0a2f071b03f3 2023-02-09 12:03:02,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/08fa7b5b79fbcbb53ed767bc07fed909/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 12:03:02,821 DEBUG [StoreOpener-b9bd8844b5681299737e0a2f071b03f3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/b9bd8844b5681299737e0a2f071b03f3/f2 2023-02-09 12:03:02,821 DEBUG [StoreOpener-b9bd8844b5681299737e0a2f071b03f3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/b9bd8844b5681299737e0a2f071b03f3/f2 2023-02-09 12:03:02,821 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 08fa7b5b79fbcbb53ed767bc07fed909; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59928952, jitterRate=-0.10698902606964111}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 12:03:02,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 08fa7b5b79fbcbb53ed767bc07fed909: Running coprocessor pre-open hook at 1675944182804Writing region info on filesystem at 1675944182804Initializing all the Stores at 1675944182805 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944182805Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944182805Cleaning up temporary data from old regions at 1675944182813 (+8 ms)Cleaning up detritus from prior splits at 1675944182814 (+1 ms)Running coprocessor post-open hooks at 1675944182821 (+7 ms)Region opened successfully at 1675944182821 2023-02-09 12:03:02,821 INFO [StoreOpener-b9bd8844b5681299737e0a2f071b03f3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b9bd8844b5681299737e0a2f071b03f3 columnFamilyName f2 2023-02-09 12:03:02,822 INFO [StoreOpener-b9bd8844b5681299737e0a2f071b03f3-1] regionserver.HStore(310): Store=b9bd8844b5681299737e0a2f071b03f3/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:02,822 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1675944182259.08fa7b5b79fbcbb53ed767bc07fed909., pid=21, masterSystemTime=1675944182755 2023-02-09 12:03:02,823 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/b9bd8844b5681299737e0a2f071b03f3 2023-02-09 12:03:02,823 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/b9bd8844b5681299737e0a2f071b03f3 2023-02-09 12:03:02,824 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1675944182259.08fa7b5b79fbcbb53ed767bc07fed909. 2023-02-09 12:03:02,824 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1675944182259.08fa7b5b79fbcbb53ed767bc07fed909. 2023-02-09 12:03:02,824 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1675944182259.546fab1946eca3d1b91f4645b19fe169. 2023-02-09 12:03:02,824 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 546fab1946eca3d1b91f4645b19fe169, NAME => 'testWithMapReduce,m\xED\xED,1675944182259.546fab1946eca3d1b91f4645b19fe169.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-09 12:03:02,825 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=08fa7b5b79fbcbb53ed767bc07fed909, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43189,1675944180899 2023-02-09 12:03:02,825 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 546fab1946eca3d1b91f4645b19fe169 2023-02-09 12:03:02,825 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1675944182259.08fa7b5b79fbcbb53ed767bc07fed909.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675944182825"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675944182825"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675944182825"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675944182825"}]},"ts":"1675944182825"} 2023-02-09 12:03:02,825 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1675944182259.546fab1946eca3d1b91f4645b19fe169.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:02,825 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 546fab1946eca3d1b91f4645b19fe169 2023-02-09 12:03:02,825 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 546fab1946eca3d1b91f4645b19fe169 2023-02-09 12:03:02,825 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 12:03:02,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for b9bd8844b5681299737e0a2f071b03f3 2023-02-09 12:03:02,828 INFO [StoreOpener-546fab1946eca3d1b91f4645b19fe169-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 546fab1946eca3d1b91f4645b19fe169 2023-02-09 12:03:02,829 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=11 2023-02-09 12:03:02,829 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=11, state=SUCCESS; OpenRegionProcedure 08fa7b5b79fbcbb53ed767bc07fed909, server=jenkins-hbase4.apache.org,43189,1675944180899 in 236 msec 2023-02-09 12:03:02,829 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/b9bd8844b5681299737e0a2f071b03f3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 12:03:02,830 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened b9bd8844b5681299737e0a2f071b03f3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61431487, jitterRate=-0.08459950983524323}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 12:03:02,830 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for b9bd8844b5681299737e0a2f071b03f3: Running coprocessor pre-open hook at 1675944182813Writing region info on filesystem at 1675944182814 (+1 ms)Initializing all the Stores at 1675944182814Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944182814Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944182815 (+1 ms)Cleaning up temporary data from old regions at 1675944182824 (+9 ms)Cleaning up detritus from prior splits at 1675944182824Running coprocessor post-open hooks at 1675944182830 (+6 ms)Region opened successfully at 1675944182830 2023-02-09 12:03:02,830 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=08fa7b5b79fbcbb53ed767bc07fed909, ASSIGN in 406 msec 2023-02-09 12:03:02,831 DEBUG [StoreOpener-546fab1946eca3d1b91f4645b19fe169-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/546fab1946eca3d1b91f4645b19fe169/f1 2023-02-09 12:03:02,831 DEBUG [StoreOpener-546fab1946eca3d1b91f4645b19fe169-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/546fab1946eca3d1b91f4645b19fe169/f1 2023-02-09 12:03:02,831 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1675944182259.b9bd8844b5681299737e0a2f071b03f3., pid=30, masterSystemTime=1675944182765 2023-02-09 12:03:02,831 INFO [StoreOpener-546fab1946eca3d1b91f4645b19fe169-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 546fab1946eca3d1b91f4645b19fe169 columnFamilyName f1 2023-02-09 12:03:02,832 INFO [StoreOpener-546fab1946eca3d1b91f4645b19fe169-1] regionserver.HStore(310): Store=546fab1946eca3d1b91f4645b19fe169/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:02,832 INFO [StoreOpener-546fab1946eca3d1b91f4645b19fe169-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 546fab1946eca3d1b91f4645b19fe169 2023-02-09 12:03:02,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1675944182259.b9bd8844b5681299737e0a2f071b03f3. 2023-02-09 12:03:02,833 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1675944182259.b9bd8844b5681299737e0a2f071b03f3. 2023-02-09 12:03:02,833 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1675944182259.24db9ec6cca428b56e442ed464c75a7f. 2023-02-09 12:03:02,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 24db9ec6cca428b56e442ed464c75a7f, NAME => 'testWithMapReduce,wWV,1675944182259.24db9ec6cca428b56e442ed464c75a7f.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-09 12:03:02,833 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=b9bd8844b5681299737e0a2f071b03f3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35455,1675944180859 2023-02-09 12:03:02,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 24db9ec6cca428b56e442ed464c75a7f 2023-02-09 12:03:02,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1675944182259.24db9ec6cca428b56e442ed464c75a7f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:02,833 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1675944182259.b9bd8844b5681299737e0a2f071b03f3.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675944182833"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675944182833"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675944182833"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675944182833"}]},"ts":"1675944182833"} 2023-02-09 12:03:02,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 24db9ec6cca428b56e442ed464c75a7f 2023-02-09 12:03:02,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 24db9ec6cca428b56e442ed464c75a7f 2023-02-09 12:03:02,835 DEBUG [StoreOpener-546fab1946eca3d1b91f4645b19fe169-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/546fab1946eca3d1b91f4645b19fe169/f2 2023-02-09 12:03:02,835 DEBUG [StoreOpener-546fab1946eca3d1b91f4645b19fe169-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/546fab1946eca3d1b91f4645b19fe169/f2 2023-02-09 12:03:02,836 INFO [StoreOpener-546fab1946eca3d1b91f4645b19fe169-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 546fab1946eca3d1b91f4645b19fe169 columnFamilyName f2 2023-02-09 12:03:02,837 INFO [StoreOpener-546fab1946eca3d1b91f4645b19fe169-1] regionserver.HStore(310): Store=546fab1946eca3d1b91f4645b19fe169/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:02,838 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=12 2023-02-09 12:03:02,838 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=12, state=SUCCESS; OpenRegionProcedure b9bd8844b5681299737e0a2f071b03f3, server=jenkins-hbase4.apache.org,35455,1675944180859 in 219 msec 2023-02-09 12:03:02,839 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=b9bd8844b5681299737e0a2f071b03f3, ASSIGN in 415 msec 2023-02-09 12:03:02,840 INFO [StoreOpener-24db9ec6cca428b56e442ed464c75a7f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 24db9ec6cca428b56e442ed464c75a7f 2023-02-09 12:03:02,840 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/546fab1946eca3d1b91f4645b19fe169 2023-02-09 12:03:02,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/546fab1946eca3d1b91f4645b19fe169 2023-02-09 12:03:02,841 DEBUG [StoreOpener-24db9ec6cca428b56e442ed464c75a7f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/24db9ec6cca428b56e442ed464c75a7f/f1 2023-02-09 12:03:02,841 DEBUG [StoreOpener-24db9ec6cca428b56e442ed464c75a7f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/24db9ec6cca428b56e442ed464c75a7f/f1 2023-02-09 12:03:02,842 INFO [StoreOpener-24db9ec6cca428b56e442ed464c75a7f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 24db9ec6cca428b56e442ed464c75a7f columnFamilyName f1 2023-02-09 12:03:02,842 INFO [StoreOpener-24db9ec6cca428b56e442ed464c75a7f-1] regionserver.HStore(310): Store=24db9ec6cca428b56e442ed464c75a7f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:02,842 INFO [StoreOpener-24db9ec6cca428b56e442ed464c75a7f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 24db9ec6cca428b56e442ed464c75a7f 2023-02-09 12:03:02,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 12:03:02,844 DEBUG [StoreOpener-24db9ec6cca428b56e442ed464c75a7f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/24db9ec6cca428b56e442ed464c75a7f/f2 2023-02-09 12:03:02,844 DEBUG [StoreOpener-24db9ec6cca428b56e442ed464c75a7f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/24db9ec6cca428b56e442ed464c75a7f/f2 2023-02-09 12:03:02,844 INFO [StoreOpener-24db9ec6cca428b56e442ed464c75a7f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 24db9ec6cca428b56e442ed464c75a7f columnFamilyName f2 2023-02-09 12:03:02,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 546fab1946eca3d1b91f4645b19fe169 2023-02-09 12:03:02,845 INFO [StoreOpener-24db9ec6cca428b56e442ed464c75a7f-1] regionserver.HStore(310): Store=24db9ec6cca428b56e442ed464c75a7f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:02,846 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/24db9ec6cca428b56e442ed464c75a7f 2023-02-09 12:03:02,846 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/24db9ec6cca428b56e442ed464c75a7f 2023-02-09 12:03:02,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/546fab1946eca3d1b91f4645b19fe169/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 12:03:02,848 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 546fab1946eca3d1b91f4645b19fe169; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58847121, jitterRate=-0.12310956418514252}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 12:03:02,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 546fab1946eca3d1b91f4645b19fe169: Running coprocessor pre-open hook at 1675944182825Writing region info on filesystem at 1675944182825Initializing all the Stores at 1675944182828 (+3 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944182828Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944182828Cleaning up temporary data from old regions at 1675944182842 (+14 ms)Cleaning up detritus from prior splits at 1675944182842Running coprocessor post-open hooks at 1675944182848 (+6 ms)Region opened successfully at 1675944182848 2023-02-09 12:03:02,849 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1675944182259.546fab1946eca3d1b91f4645b19fe169., pid=24, masterSystemTime=1675944182755 2023-02-09 12:03:02,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 12:03:02,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1675944182259.546fab1946eca3d1b91f4645b19fe169. 2023-02-09 12:03:02,851 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1675944182259.546fab1946eca3d1b91f4645b19fe169. 2023-02-09 12:03:02,851 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1675944182259.e361e7c32d779b70cb86f6640113527e. 2023-02-09 12:03:02,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e361e7c32d779b70cb86f6640113527e, NAME => 'testWithMapReduce,zz{,1675944182259.e361e7c32d779b70cb86f6640113527e.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-09 12:03:02,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce e361e7c32d779b70cb86f6640113527e 2023-02-09 12:03:02,851 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=546fab1946eca3d1b91f4645b19fe169, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43189,1675944180899 2023-02-09 12:03:02,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1675944182259.e361e7c32d779b70cb86f6640113527e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:02,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for e361e7c32d779b70cb86f6640113527e 2023-02-09 12:03:02,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 24db9ec6cca428b56e442ed464c75a7f 2023-02-09 12:03:02,851 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1675944182259.546fab1946eca3d1b91f4645b19fe169.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675944182851"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675944182851"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675944182851"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675944182851"}]},"ts":"1675944182851"} 2023-02-09 12:03:02,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for e361e7c32d779b70cb86f6640113527e 2023-02-09 12:03:02,854 INFO [StoreOpener-e361e7c32d779b70cb86f6640113527e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e361e7c32d779b70cb86f6640113527e 2023-02-09 12:03:02,856 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=16 2023-02-09 12:03:02,856 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=16, state=SUCCESS; OpenRegionProcedure 546fab1946eca3d1b91f4645b19fe169, server=jenkins-hbase4.apache.org,43189,1675944180899 in 259 msec 2023-02-09 12:03:02,857 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/24db9ec6cca428b56e442ed464c75a7f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 12:03:02,857 DEBUG [StoreOpener-e361e7c32d779b70cb86f6640113527e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/e361e7c32d779b70cb86f6640113527e/f1 2023-02-09 12:03:02,857 DEBUG [StoreOpener-e361e7c32d779b70cb86f6640113527e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/e361e7c32d779b70cb86f6640113527e/f1 2023-02-09 12:03:02,857 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 24db9ec6cca428b56e442ed464c75a7f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75337168, jitterRate=0.12261128425598145}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 12:03:02,857 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 24db9ec6cca428b56e442ed464c75a7f: Running coprocessor pre-open hook at 1675944182834Writing region info on filesystem at 1675944182834Initializing all the Stores at 1675944182836 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944182836Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944182840 (+4 ms)Cleaning up temporary data from old regions at 1675944182847 (+7 ms)Cleaning up detritus from prior splits at 1675944182848 (+1 ms)Running coprocessor post-open hooks at 1675944182857 (+9 ms)Region opened successfully at 1675944182857 2023-02-09 12:03:02,857 INFO [StoreOpener-e361e7c32d779b70cb86f6640113527e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e361e7c32d779b70cb86f6640113527e columnFamilyName f1 2023-02-09 12:03:02,858 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=546fab1946eca3d1b91f4645b19fe169, ASSIGN in 433 msec 2023-02-09 12:03:02,858 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1675944182259.24db9ec6cca428b56e442ed464c75a7f., pid=26, masterSystemTime=1675944182765 2023-02-09 12:03:02,858 INFO [StoreOpener-e361e7c32d779b70cb86f6640113527e-1] regionserver.HStore(310): Store=e361e7c32d779b70cb86f6640113527e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:02,858 INFO [StoreOpener-e361e7c32d779b70cb86f6640113527e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e361e7c32d779b70cb86f6640113527e 2023-02-09 12:03:02,859 DEBUG [StoreOpener-e361e7c32d779b70cb86f6640113527e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/e361e7c32d779b70cb86f6640113527e/f2 2023-02-09 12:03:02,860 DEBUG [StoreOpener-e361e7c32d779b70cb86f6640113527e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/e361e7c32d779b70cb86f6640113527e/f2 2023-02-09 12:03:02,860 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1675944182259.24db9ec6cca428b56e442ed464c75a7f. 2023-02-09 12:03:02,860 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1675944182259.24db9ec6cca428b56e442ed464c75a7f. 2023-02-09 12:03:02,860 INFO [StoreOpener-e361e7c32d779b70cb86f6640113527e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e361e7c32d779b70cb86f6640113527e columnFamilyName f2 2023-02-09 12:03:02,860 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1675944182259.148e52758718776d49fecdf247dc20da. 2023-02-09 12:03:02,860 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=24db9ec6cca428b56e442ed464c75a7f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35455,1675944180859 2023-02-09 12:03:02,860 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 148e52758718776d49fecdf247dc20da, NAME => 'testWithMapReduce,j\xCA\xCA,1675944182259.148e52758718776d49fecdf247dc20da.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-09 12:03:02,860 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1675944182259.24db9ec6cca428b56e442ed464c75a7f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675944182860"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675944182860"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675944182860"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675944182860"}]},"ts":"1675944182860"} 2023-02-09 12:03:02,860 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 148e52758718776d49fecdf247dc20da 2023-02-09 12:03:02,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1675944182259.148e52758718776d49fecdf247dc20da.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:02,861 INFO [StoreOpener-e361e7c32d779b70cb86f6640113527e-1] regionserver.HStore(310): Store=e361e7c32d779b70cb86f6640113527e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:02,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 148e52758718776d49fecdf247dc20da 2023-02-09 12:03:02,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 148e52758718776d49fecdf247dc20da 2023-02-09 12:03:02,862 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/e361e7c32d779b70cb86f6640113527e 2023-02-09 12:03:02,862 INFO [StoreOpener-148e52758718776d49fecdf247dc20da-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 148e52758718776d49fecdf247dc20da 2023-02-09 12:03:02,862 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/e361e7c32d779b70cb86f6640113527e 2023-02-09 12:03:02,864 DEBUG [StoreOpener-148e52758718776d49fecdf247dc20da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/148e52758718776d49fecdf247dc20da/f1 2023-02-09 12:03:02,864 DEBUG [StoreOpener-148e52758718776d49fecdf247dc20da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/148e52758718776d49fecdf247dc20da/f1 2023-02-09 12:03:02,864 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=19 2023-02-09 12:03:02,864 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=19, state=SUCCESS; OpenRegionProcedure 24db9ec6cca428b56e442ed464c75a7f, server=jenkins-hbase4.apache.org,35455,1675944180859 in 251 msec 2023-02-09 12:03:02,864 INFO [StoreOpener-148e52758718776d49fecdf247dc20da-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 148e52758718776d49fecdf247dc20da columnFamilyName f1 2023-02-09 12:03:02,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 12:03:02,866 INFO [StoreOpener-148e52758718776d49fecdf247dc20da-1] regionserver.HStore(310): Store=148e52758718776d49fecdf247dc20da/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:02,866 INFO [StoreOpener-148e52758718776d49fecdf247dc20da-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 148e52758718776d49fecdf247dc20da 2023-02-09 12:03:02,866 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=24db9ec6cca428b56e442ed464c75a7f, ASSIGN in 441 msec 2023-02-09 12:03:02,867 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for e361e7c32d779b70cb86f6640113527e 2023-02-09 12:03:02,868 DEBUG [StoreOpener-148e52758718776d49fecdf247dc20da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/148e52758718776d49fecdf247dc20da/f2 2023-02-09 12:03:02,868 DEBUG [StoreOpener-148e52758718776d49fecdf247dc20da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/148e52758718776d49fecdf247dc20da/f2 2023-02-09 12:03:02,868 INFO [StoreOpener-148e52758718776d49fecdf247dc20da-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 148e52758718776d49fecdf247dc20da columnFamilyName f2 2023-02-09 12:03:02,869 INFO [StoreOpener-148e52758718776d49fecdf247dc20da-1] regionserver.HStore(310): Store=148e52758718776d49fecdf247dc20da/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:02,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/e361e7c32d779b70cb86f6640113527e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 12:03:02,870 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/148e52758718776d49fecdf247dc20da 2023-02-09 12:03:02,870 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened e361e7c32d779b70cb86f6640113527e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66895302, jitterRate=-0.003182321786880493}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 12:03:02,870 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for e361e7c32d779b70cb86f6640113527e: Running coprocessor pre-open hook at 1675944182852Writing region info on filesystem at 1675944182852Initializing all the Stores at 1675944182853 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944182854 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944182854Cleaning up temporary data from old regions at 1675944182863 (+9 ms)Cleaning up detritus from prior splits at 1675944182864 (+1 ms)Running coprocessor post-open hooks at 1675944182870 (+6 ms)Region opened successfully at 1675944182870 2023-02-09 12:03:02,870 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/148e52758718776d49fecdf247dc20da 2023-02-09 12:03:02,871 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1675944182259.e361e7c32d779b70cb86f6640113527e., pid=25, masterSystemTime=1675944182755 2023-02-09 12:03:02,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 12:03:02,873 INFO [Listener at localhost/36513] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:02,873 INFO [Listener at localhost/36513] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:02,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1675944182259.e361e7c32d779b70cb86f6640113527e. 2023-02-09 12:03:02,873 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1675944182259.e361e7c32d779b70cb86f6640113527e. 2023-02-09 12:03:02,873 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=e361e7c32d779b70cb86f6640113527e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43189,1675944180899 2023-02-09 12:03:02,874 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1675944182259.e361e7c32d779b70cb86f6640113527e.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675944182873"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675944182873"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675944182873"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675944182873"}]},"ts":"1675944182873"} 2023-02-09 12:03:02,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 12:03:02,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 148e52758718776d49fecdf247dc20da 2023-02-09 12:03:02,877 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/148e52758718776d49fecdf247dc20da/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 12:03:02,877 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=20 2023-02-09 12:03:02,877 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=20, state=SUCCESS; OpenRegionProcedure e361e7c32d779b70cb86f6640113527e, server=jenkins-hbase4.apache.org,43189,1675944180899 in 280 msec 2023-02-09 12:03:02,877 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 148e52758718776d49fecdf247dc20da; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59628305, jitterRate=-0.11146901547908783}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 12:03:02,878 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 148e52758718776d49fecdf247dc20da: Running coprocessor pre-open hook at 1675944182861Writing region info on filesystem at 1675944182861Initializing all the Stores at 1675944182862 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944182862Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944182862Cleaning up temporary data from old regions at 1675944182871 (+9 ms)Cleaning up detritus from prior splits at 1675944182872 (+1 ms)Running coprocessor post-open hooks at 1675944182878 (+6 ms)Region opened successfully at 1675944182878 2023-02-09 12:03:02,878 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1675944182259.148e52758718776d49fecdf247dc20da., pid=28, masterSystemTime=1675944182765 2023-02-09 12:03:02,878 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=e361e7c32d779b70cb86f6640113527e, ASSIGN in 454 msec 2023-02-09 12:03:02,880 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1675944182259.148e52758718776d49fecdf247dc20da. 2023-02-09 12:03:02,880 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1675944182259.148e52758718776d49fecdf247dc20da. 2023-02-09 12:03:02,880 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=148e52758718776d49fecdf247dc20da, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35455,1675944180859 2023-02-09 12:03:02,880 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1675944182259.148e52758718776d49fecdf247dc20da.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675944182880"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675944182880"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675944182880"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675944182880"}]},"ts":"1675944182880"} 2023-02-09 12:03:02,884 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=15 2023-02-09 12:03:02,884 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=15, state=SUCCESS; OpenRegionProcedure 148e52758718776d49fecdf247dc20da, server=jenkins-hbase4.apache.org,35455,1675944180859 in 266 msec 2023-02-09 12:03:02,886 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=10 2023-02-09 12:03:02,886 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=148e52758718776d49fecdf247dc20da, ASSIGN in 461 msec 2023-02-09 12:03:02,887 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 12:03:02,887 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675944182887"}]},"ts":"1675944182887"} 2023-02-09 12:03:02,889 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-09 12:03:02,891 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 12:03:02,894 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 633 msec 2023-02-09 12:03:03,375 INFO [Listener at localhost/36513] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:03,375 INFO [Listener at localhost/36513] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:03,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 12:03:03,377 INFO [Listener at localhost/36513] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-09 12:03:03,377 DEBUG [Listener at localhost/36513] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-09 12:03:03,377 INFO [Listener at localhost/36513] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-09 12:03:03,382 INFO [Listener at localhost/36513] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-09 12:03:03,382 INFO [Listener at localhost/36513] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-09 12:03:03,382 INFO [Listener at localhost/36513] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-09 12:03:03,382 INFO [Listener at localhost/36513] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-09 12:03:03,427 DEBUG [hconnection-0xe13a120-shared-pool-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 12:03:03,449 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54152, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 12:03:03,456 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43189] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6084 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,g\xA7\xA7,1675944182259.57c7ac6814f18d2541df5c154c377d70. 2023-02-09 12:03:03,465 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 11492 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1675944182259.b9bd8844b5681299737e0a2f071b03f3. 2023-02-09 12:03:03,582 INFO [Listener at localhost/36513] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-09 12:03:03,583 INFO [Listener at localhost/36513] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-09 12:03:03,583 INFO [Listener at localhost/36513] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:03,583 INFO [Listener at localhost/36513] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:03,584 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37615] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-09 12:03:03,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37615] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1675944183584 (current time:1675944183584). 2023-02-09 12:03:03,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37615] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-09 12:03:03,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37615] zookeeper.ReadOnlyZKClient(139): Connect 0x03e118d8 to 127.0.0.1:63665 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 12:03:03,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37615] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1613943f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 12:03:03,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37615] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 12:03:03,603 INFO [RS-EventLoopGroup-7-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44940, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 12:03:03,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37615] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x03e118d8 to 127.0.0.1:63665 2023-02-09 12:03:03,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37615] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 12:03:03,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37615] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-09 12:03:03,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37615] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-09 12:03:03,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37615] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-09 12:03:03,610 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-09 12:03:03,612 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1675944783612 2023-02-09 12:03:03,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37615] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-09 12:03:03,612 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-09 12:03:03,613 DEBUG [Listener at localhost/36513] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-09 12:03:03,613 DEBUG [Listener at localhost/36513] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-09 12:03:03,613 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-09 12:03:03,620 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-09 12:03:03,621 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 13 msec 2023-02-09 12:03:03,622 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-09 12:03:03,622 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1675944783622 2023-02-09 12:03:03,643 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:03,643 INFO [(jenkins-hbase4.apache.org,37615,1675944180795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' 2023-02-09 12:03:03,643 DEBUG [(jenkins-hbase4.apache.org,37615,1675944180795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 12:03:03,648 DEBUG [(jenkins-hbase4.apache.org,37615,1675944180795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' 2023-02-09 12:03:03,648 DEBUG [(jenkins-hbase4.apache.org,37615,1675944180795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion', kicking off acquire phase on members. 2023-02-09 12:03:03,648 DEBUG [(jenkins-hbase4.apache.org,37615,1675944180795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:03,648 DEBUG [(jenkins-hbase4.apache.org,37615,1675944180795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:03,650 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): regionserver:35455-0x10038f6a5e10001, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 12:03:03,650 DEBUG [(jenkins-hbase4.apache.org,37615,1675944180795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35455,1675944180859 2023-02-09 12:03:03,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 12:03:03,650 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): regionserver:43189-0x10038f6a5e10002, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 12:03:03,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 12:03:03,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 12:03:03,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 12:03:03,650 DEBUG [(jenkins-hbase4.apache.org,37615,1675944180795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35455,1675944180859 2023-02-09 12:03:03,650 DEBUG [(jenkins-hbase4.apache.org,37615,1675944180795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,43189,1675944180899 2023-02-09 12:03:03,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:03,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:03,651 DEBUG [(jenkins-hbase4.apache.org,37615,1675944180795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,43189,1675944180899 2023-02-09 12:03:03,651 DEBUG [(jenkins-hbase4.apache.org,37615,1675944180795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 12:03:03,651 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43189-0x10038f6a5e10002, quorum=127.0.0.1:63665, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:03,651 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35455-0x10038f6a5e10001, quorum=127.0.0.1:63665, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:03,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-09 12:03:03,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-09 12:03:03,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:03,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:03,651 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-09 12:03:03,651 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-09 12:03:03,652 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:03,652 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:03,656 DEBUG [member: 'jenkins-hbase4.apache.org,35455,1675944180859' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-09 12:03:03,656 DEBUG [member: 'jenkins-hbase4.apache.org,35455,1675944180859' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 12:03:03,657 DEBUG [member: 'jenkins-hbase4.apache.org,35455,1675944180859' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-09 12:03:03,657 DEBUG [member: 'jenkins-hbase4.apache.org,43189,1675944180899' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-09 12:03:03,657 DEBUG [member: 'jenkins-hbase4.apache.org,43189,1675944180899' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 12:03:03,657 DEBUG [member: 'jenkins-hbase4.apache.org,35455,1675944180859' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-09 12:03:03,657 DEBUG [member: 'jenkins-hbase4.apache.org,35455,1675944180859' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35455,1675944180859' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-09 12:03:03,657 DEBUG [member: 'jenkins-hbase4.apache.org,43189,1675944180899' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-09 12:03:03,657 DEBUG [member: 'jenkins-hbase4.apache.org,43189,1675944180899' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-09 12:03:03,657 DEBUG [member: 'jenkins-hbase4.apache.org,43189,1675944180899' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43189,1675944180899' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-09 12:03:03,659 DEBUG [member: 'jenkins-hbase4.apache.org,35455,1675944180859' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:03,659 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35455,1675944180859 2023-02-09 12:03:03,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35455,1675944180859 2023-02-09 12:03:03,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 12:03:03,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 12:03:03,659 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,43189,1675944180899 2023-02-09 12:03:03,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 12:03:03,660 DEBUG [member: 'jenkins-hbase4.apache.org,35455,1675944180859' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35455-0x10038f6a5e10001, quorum=127.0.0.1:63665, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:03,660 DEBUG [member: 'jenkins-hbase4.apache.org,35455,1675944180859' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 12:03:03,660 DEBUG [member: 'jenkins-hbase4.apache.org,43189,1675944180899' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:03,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 12:03:03,660 DEBUG [member: 'jenkins-hbase4.apache.org,43189,1675944180899' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43189-0x10038f6a5e10002, quorum=127.0.0.1:63665, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:03,660 DEBUG [member: 'jenkins-hbase4.apache.org,43189,1675944180899' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 12:03:03,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:03,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35455,1675944180859 2023-02-09 12:03:03,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43189,1675944180899 2023-02-09 12:03:03,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 12:03:03,662 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35455,1675944180859' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-09 12:03:03,662 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@9625b2e[Count = 1] remaining members to acquire global barrier 2023-02-09 12:03:03,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,43189,1675944180899 2023-02-09 12:03:03,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 12:03:03,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 12:03:03,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 12:03:03,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 12:03:03,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:03,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35455,1675944180859 2023-02-09 12:03:03,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43189,1675944180899 2023-02-09 12:03:03,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 12:03:03,665 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43189,1675944180899' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-09 12:03:03,665 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@9625b2e[Count = 0] remaining members to acquire global barrier 2023-02-09 12:03:03,665 DEBUG [(jenkins-hbase4.apache.org,37615,1675944180795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'in-barrier' execution. 2023-02-09 12:03:03,665 DEBUG [(jenkins-hbase4.apache.org,37615,1675944180795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:03,668 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): regionserver:43189-0x10038f6a5e10002, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:03,668 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): regionserver:35455-0x10038f6a5e10001, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:03,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:03,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:03,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:03,668 DEBUG [member: 'jenkins-hbase4.apache.org,43189,1675944180899' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-09 12:03:03,668 DEBUG [(jenkins-hbase4.apache.org,37615,1675944180795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35455,1675944180859 2023-02-09 12:03:03,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:03,668 DEBUG [member: 'jenkins-hbase4.apache.org,35455,1675944180859' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-09 12:03:03,668 DEBUG [(jenkins-hbase4.apache.org,37615,1675944180795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,43189,1675944180899 2023-02-09 12:03:03,668 DEBUG [(jenkins-hbase4.apache.org,37615,1675944180795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 12:03:03,668 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1675944182259.08fa7b5b79fbcbb53ed767bc07fed909. 2023-02-09 12:03:03,669 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1675944182259.08fa7b5b79fbcbb53ed767bc07fed909. started... 2023-02-09 12:03:03,669 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1675944182259.e361e7c32d779b70cb86f6640113527e. 2023-02-09 12:03:03,669 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1675944182259.e361e7c32d779b70cb86f6640113527e. started... 2023-02-09 12:03:03,669 DEBUG [member: 'jenkins-hbase4.apache.org,43189,1675944180899' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-09 12:03:03,673 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1675944182259.b9bd8844b5681299737e0a2f071b03f3. 2023-02-09 12:03:03,673 DEBUG [member: 'jenkins-hbase4.apache.org,35455,1675944180859' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-09 12:03:03,676 DEBUG [member: 'jenkins-hbase4.apache.org,35455,1675944180859' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-09 12:03:03,672 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1675944182259.f8b958d29e440ca92af212e18425d242. 2023-02-09 12:03:03,672 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1675944182259.546fab1946eca3d1b91f4645b19fe169. 2023-02-09 12:03:03,676 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1675944182259.546fab1946eca3d1b91f4645b19fe169. started... 2023-02-09 12:03:03,672 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1675944182259.266cae67ac0efcfe59291a310a667874. 2023-02-09 12:03:03,677 INFO [rs(jenkins-hbase4.apache.org,43189,1675944180899)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 546fab1946eca3d1b91f4645b19fe169 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-09 12:03:03,670 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 08fa7b5b79fbcbb53ed767bc07fed909: 2023-02-09 12:03:03,670 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for e361e7c32d779b70cb86f6640113527e: 2023-02-09 12:03:03,677 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1675944182259.08fa7b5b79fbcbb53ed767bc07fed909.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:03,677 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 12:03:03,678 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1675944182259.e361e7c32d779b70cb86f6640113527e.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:03,678 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 12:03:03,678 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-09 12:03:03,678 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-09 12:03:03,677 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1675944182259.266cae67ac0efcfe59291a310a667874. started... 2023-02-09 12:03:03,676 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1675944182259.f8b958d29e440ca92af212e18425d242. started... 2023-02-09 12:03:03,676 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1675944182259.b9bd8844b5681299737e0a2f071b03f3. started... 2023-02-09 12:03:03,676 DEBUG [member: 'jenkins-hbase4.apache.org,43189,1675944180899' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-09 12:03:03,680 INFO [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-1] regionserver.HRegion(2744): Flushing f8b958d29e440ca92af212e18425d242 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-09 12:03:03,678 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-09 12:03:03,680 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-09 12:03:03,680 INFO [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 266cae67ac0efcfe59291a310a667874 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-09 12:03:03,680 INFO [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-2] regionserver.HRegion(2744): Flushing b9bd8844b5681299737e0a2f071b03f3 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-09 12:03:03,713 DEBUG [Listener at localhost/36513] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 12:03:03,714 INFO [Listener at localhost/36513] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:03,714 INFO [Listener at localhost/36513] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:03,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37615] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-09 12:03:03,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37615] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-09 12:03:03,716 DEBUG [Listener at localhost/36513] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-09 12:03:03,780 INFO [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/f8b958d29e440ca92af212e18425d242/.tmp/f1/1bbc7bca84244b22bbdd2af8de18c7c0 2023-02-09 12:03:03,796 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1675944182259.08fa7b5b79fbcbb53ed767bc07fed909. completed. 2023-02-09 12:03:03,796 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1675944182259.08fa7b5b79fbcbb53ed767bc07fed909. 2023-02-09 12:03:03,796 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1675944182259.fc52dac117cb96590c6edd7ac65df056. 2023-02-09 12:03:03,796 DEBUG [member: 'jenkins-hbase4.apache.org,43189,1675944180899' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-09 12:03:03,796 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1675944182259.fc52dac117cb96590c6edd7ac65df056. started... 2023-02-09 12:03:03,822 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1675944182259.e361e7c32d779b70cb86f6640113527e. completed. 2023-02-09 12:03:03,822 INFO [rs(jenkins-hbase4.apache.org,43189,1675944180899)-snapshot-pool-0] regionserver.HRegion(2744): Flushing fc52dac117cb96590c6edd7ac65df056 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-09 12:03:03,822 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1675944182259.e361e7c32d779b70cb86f6640113527e. 2023-02-09 12:03:03,824 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1675944182259.57c7ac6814f18d2541df5c154c377d70. 2023-02-09 12:03:03,824 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1675944182259.57c7ac6814f18d2541df5c154c377d70. started... 2023-02-09 12:03:03,824 INFO [rs(jenkins-hbase4.apache.org,43189,1675944180899)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 57c7ac6814f18d2541df5c154c377d70 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-09 12:03:03,824 DEBUG [member: 'jenkins-hbase4.apache.org,43189,1675944180899' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-09 12:03:03,832 INFO [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/b9bd8844b5681299737e0a2f071b03f3/.tmp/f1/e1fc333643cf4ce6aa6a40f51341db4c 2023-02-09 12:03:03,860 INFO [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/266cae67ac0efcfe59291a310a667874/.tmp/f1/a0f8d136afa24c7ea95f8333ec8d6392 2023-02-09 12:03:03,888 INFO [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/f8b958d29e440ca92af212e18425d242/.tmp/f2/bbc6e5e0672b4c0a9fb7e25f54f64ad1 2023-02-09 12:03:03,895 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/f8b958d29e440ca92af212e18425d242/.tmp/f1/1bbc7bca84244b22bbdd2af8de18c7c0 as hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/f8b958d29e440ca92af212e18425d242/f1/1bbc7bca84244b22bbdd2af8de18c7c0 2023-02-09 12:03:03,900 INFO [rs(jenkins-hbase4.apache.org,43189,1675944180899)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/546fab1946eca3d1b91f4645b19fe169/.tmp/f1/e135ace1984d4bb49f6c24fa4b95ea2f 2023-02-09 12:03:03,904 INFO [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/f8b958d29e440ca92af212e18425d242/f1/1bbc7bca84244b22bbdd2af8de18c7c0, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 12:03:03,911 INFO [rs(jenkins-hbase4.apache.org,43189,1675944180899)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/fc52dac117cb96590c6edd7ac65df056/.tmp/f1/ee422794f0314247ae6e9d11d6af55ea 2023-02-09 12:03:03,912 INFO [rs(jenkins-hbase4.apache.org,43189,1675944180899)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/57c7ac6814f18d2541df5c154c377d70/.tmp/f1/754811ab88a54f2896d954293fcd4083 2023-02-09 12:03:03,912 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/f8b958d29e440ca92af212e18425d242/.tmp/f2/bbc6e5e0672b4c0a9fb7e25f54f64ad1 as hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/f8b958d29e440ca92af212e18425d242/f2/bbc6e5e0672b4c0a9fb7e25f54f64ad1 2023-02-09 12:03:03,920 DEBUG [Listener at localhost/36513] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 12:03:03,920 INFO [Listener at localhost/36513] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:03,920 INFO [Listener at localhost/36513] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:03,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37615] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-09 12:03:03,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37615] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-09 12:03:03,922 DEBUG [Listener at localhost/36513] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-09 12:03:03,924 INFO [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/f8b958d29e440ca92af212e18425d242/f2/bbc6e5e0672b4c0a9fb7e25f54f64ad1, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 12:03:03,925 INFO [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for f8b958d29e440ca92af212e18425d242 in 246ms, sequenceid=5, compaction requested=false 2023-02-09 12:03:03,925 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-09 12:03:03,926 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for f8b958d29e440ca92af212e18425d242: 2023-02-09 12:03:03,926 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1675944182259.f8b958d29e440ca92af212e18425d242.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:03,926 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 12:03:03,926 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/f8b958d29e440ca92af212e18425d242/f1/1bbc7bca84244b22bbdd2af8de18c7c0] hfiles 2023-02-09 12:03:03,926 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/f8b958d29e440ca92af212e18425d242/f1/1bbc7bca84244b22bbdd2af8de18c7c0 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:03,926 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/f8b958d29e440ca92af212e18425d242/f2/bbc6e5e0672b4c0a9fb7e25f54f64ad1] hfiles 2023-02-09 12:03:03,926 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/f8b958d29e440ca92af212e18425d242/f2/bbc6e5e0672b4c0a9fb7e25f54f64ad1 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:03,948 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-09 12:03:03,952 INFO [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/266cae67ac0efcfe59291a310a667874/.tmp/f2/75248938aef14ef7a960142f0b49797e 2023-02-09 12:03:03,959 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/266cae67ac0efcfe59291a310a667874/.tmp/f1/a0f8d136afa24c7ea95f8333ec8d6392 as hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/266cae67ac0efcfe59291a310a667874/f1/a0f8d136afa24c7ea95f8333ec8d6392 2023-02-09 12:03:03,965 INFO [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/266cae67ac0efcfe59291a310a667874/f1/a0f8d136afa24c7ea95f8333ec8d6392, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 12:03:03,966 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/266cae67ac0efcfe59291a310a667874/.tmp/f2/75248938aef14ef7a960142f0b49797e as hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/266cae67ac0efcfe59291a310a667874/f2/75248938aef14ef7a960142f0b49797e 2023-02-09 12:03:03,972 INFO [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/266cae67ac0efcfe59291a310a667874/f2/75248938aef14ef7a960142f0b49797e, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 12:03:03,973 INFO [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 266cae67ac0efcfe59291a310a667874 in 293ms, sequenceid=5, compaction requested=false 2023-02-09 12:03:03,981 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 266cae67ac0efcfe59291a310a667874: 2023-02-09 12:03:03,981 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1675944182259.266cae67ac0efcfe59291a310a667874.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:03,982 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 12:03:03,982 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/266cae67ac0efcfe59291a310a667874/f1/a0f8d136afa24c7ea95f8333ec8d6392] hfiles 2023-02-09 12:03:03,982 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/266cae67ac0efcfe59291a310a667874/f1/a0f8d136afa24c7ea95f8333ec8d6392 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:03,982 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/266cae67ac0efcfe59291a310a667874/f2/75248938aef14ef7a960142f0b49797e] hfiles 2023-02-09 12:03:03,982 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/266cae67ac0efcfe59291a310a667874/f2/75248938aef14ef7a960142f0b49797e for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:04,049 INFO [rs(jenkins-hbase4.apache.org,43189,1675944180899)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/546fab1946eca3d1b91f4645b19fe169/.tmp/f2/fab535d80a0e4a058e6e8559d4bf6705 2023-02-09 12:03:04,055 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/546fab1946eca3d1b91f4645b19fe169/.tmp/f1/e135ace1984d4bb49f6c24fa4b95ea2f as hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/546fab1946eca3d1b91f4645b19fe169/f1/e135ace1984d4bb49f6c24fa4b95ea2f 2023-02-09 12:03:04,062 INFO [rs(jenkins-hbase4.apache.org,43189,1675944180899)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/546fab1946eca3d1b91f4645b19fe169/f1/e135ace1984d4bb49f6c24fa4b95ea2f, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 12:03:04,063 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/546fab1946eca3d1b91f4645b19fe169/.tmp/f2/fab535d80a0e4a058e6e8559d4bf6705 as hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/546fab1946eca3d1b91f4645b19fe169/f2/fab535d80a0e4a058e6e8559d4bf6705 2023-02-09 12:03:04,076 INFO [rs(jenkins-hbase4.apache.org,43189,1675944180899)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/57c7ac6814f18d2541df5c154c377d70/.tmp/f2/f8e42f68fbce432bb90cfb80554dbae6 2023-02-09 12:03:04,077 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1675944182259.266cae67ac0efcfe59291a310a667874. completed. 2023-02-09 12:03:04,077 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1675944182259.266cae67ac0efcfe59291a310a667874. 2023-02-09 12:03:04,077 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1675944182259.24db9ec6cca428b56e442ed464c75a7f. 2023-02-09 12:03:04,077 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1675944182259.24db9ec6cca428b56e442ed464c75a7f. started... 2023-02-09 12:03:04,078 INFO [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 24db9ec6cca428b56e442ed464c75a7f 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-09 12:03:04,078 DEBUG [member: 'jenkins-hbase4.apache.org,35455,1675944180859' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-09 12:03:04,084 INFO [rs(jenkins-hbase4.apache.org,43189,1675944180899)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/546fab1946eca3d1b91f4645b19fe169/f2/fab535d80a0e4a058e6e8559d4bf6705, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 12:03:04,085 INFO [rs(jenkins-hbase4.apache.org,43189,1675944180899)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 546fab1946eca3d1b91f4645b19fe169 in 408ms, sequenceid=5, compaction requested=false 2023-02-09 12:03:04,085 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 546fab1946eca3d1b91f4645b19fe169: 2023-02-09 12:03:04,086 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1675944182259.546fab1946eca3d1b91f4645b19fe169.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:04,086 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 12:03:04,086 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/546fab1946eca3d1b91f4645b19fe169/f1/e135ace1984d4bb49f6c24fa4b95ea2f] hfiles 2023-02-09 12:03:04,086 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/546fab1946eca3d1b91f4645b19fe169/f1/e135ace1984d4bb49f6c24fa4b95ea2f for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:04,086 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/546fab1946eca3d1b91f4645b19fe169/f2/fab535d80a0e4a058e6e8559d4bf6705] hfiles 2023-02-09 12:03:04,086 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/546fab1946eca3d1b91f4645b19fe169/f2/fab535d80a0e4a058e6e8559d4bf6705 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:04,103 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/57c7ac6814f18d2541df5c154c377d70/.tmp/f1/754811ab88a54f2896d954293fcd4083 as hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/57c7ac6814f18d2541df5c154c377d70/f1/754811ab88a54f2896d954293fcd4083 2023-02-09 12:03:04,109 INFO [rs(jenkins-hbase4.apache.org,43189,1675944180899)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/57c7ac6814f18d2541df5c154c377d70/f1/754811ab88a54f2896d954293fcd4083, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 12:03:04,110 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/57c7ac6814f18d2541df5c154c377d70/.tmp/f2/f8e42f68fbce432bb90cfb80554dbae6 as hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/57c7ac6814f18d2541df5c154c377d70/f2/f8e42f68fbce432bb90cfb80554dbae6 2023-02-09 12:03:04,115 INFO [rs(jenkins-hbase4.apache.org,43189,1675944180899)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/57c7ac6814f18d2541df5c154c377d70/f2/f8e42f68fbce432bb90cfb80554dbae6, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 12:03:04,116 INFO [rs(jenkins-hbase4.apache.org,43189,1675944180899)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 57c7ac6814f18d2541df5c154c377d70 in 292ms, sequenceid=5, compaction requested=false 2023-02-09 12:03:04,116 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 57c7ac6814f18d2541df5c154c377d70: 2023-02-09 12:03:04,116 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1675944182259.57c7ac6814f18d2541df5c154c377d70.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:04,116 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 12:03:04,116 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/57c7ac6814f18d2541df5c154c377d70/f1/754811ab88a54f2896d954293fcd4083] hfiles 2023-02-09 12:03:04,117 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/57c7ac6814f18d2541df5c154c377d70/f1/754811ab88a54f2896d954293fcd4083 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:04,117 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/57c7ac6814f18d2541df5c154c377d70/f2/f8e42f68fbce432bb90cfb80554dbae6] hfiles 2023-02-09 12:03:04,117 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/57c7ac6814f18d2541df5c154c377d70/f2/f8e42f68fbce432bb90cfb80554dbae6 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:04,140 INFO [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/24db9ec6cca428b56e442ed464c75a7f/.tmp/f1/94887c71c44e47069a66db037589a3b1 2023-02-09 12:03:04,141 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1675944182259.546fab1946eca3d1b91f4645b19fe169. completed. 2023-02-09 12:03:04,141 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1675944182259.546fab1946eca3d1b91f4645b19fe169. 2023-02-09 12:03:04,141 DEBUG [member: 'jenkins-hbase4.apache.org,43189,1675944180899' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-09 12:03:04,153 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1675944182259.57c7ac6814f18d2541df5c154c377d70. completed. 2023-02-09 12:03:04,153 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1675944182259.57c7ac6814f18d2541df5c154c377d70. 2023-02-09 12:03:04,153 DEBUG [member: 'jenkins-hbase4.apache.org,43189,1675944180899' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-09 12:03:04,176 INFO [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/24db9ec6cca428b56e442ed464c75a7f/.tmp/f2/08f5fe5facbc4c9293cc89bd0ddad9c6 2023-02-09 12:03:04,184 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/24db9ec6cca428b56e442ed464c75a7f/.tmp/f1/94887c71c44e47069a66db037589a3b1 as hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/24db9ec6cca428b56e442ed464c75a7f/f1/94887c71c44e47069a66db037589a3b1 2023-02-09 12:03:04,190 INFO [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/24db9ec6cca428b56e442ed464c75a7f/f1/94887c71c44e47069a66db037589a3b1, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-09 12:03:04,191 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/24db9ec6cca428b56e442ed464c75a7f/.tmp/f2/08f5fe5facbc4c9293cc89bd0ddad9c6 as hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/24db9ec6cca428b56e442ed464c75a7f/f2/08f5fe5facbc4c9293cc89bd0ddad9c6 2023-02-09 12:03:04,197 INFO [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/24db9ec6cca428b56e442ed464c75a7f/f2/08f5fe5facbc4c9293cc89bd0ddad9c6, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-09 12:03:04,198 INFO [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 24db9ec6cca428b56e442ed464c75a7f in 120ms, sequenceid=5, compaction requested=false 2023-02-09 12:03:04,198 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 24db9ec6cca428b56e442ed464c75a7f: 2023-02-09 12:03:04,198 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1675944182259.24db9ec6cca428b56e442ed464c75a7f.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:04,198 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 12:03:04,198 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/24db9ec6cca428b56e442ed464c75a7f/f1/94887c71c44e47069a66db037589a3b1] hfiles 2023-02-09 12:03:04,198 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/24db9ec6cca428b56e442ed464c75a7f/f1/94887c71c44e47069a66db037589a3b1 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:04,198 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/24db9ec6cca428b56e442ed464c75a7f/f2/08f5fe5facbc4c9293cc89bd0ddad9c6] hfiles 2023-02-09 12:03:04,198 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/24db9ec6cca428b56e442ed464c75a7f/f2/08f5fe5facbc4c9293cc89bd0ddad9c6 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:04,206 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1675944182259.24db9ec6cca428b56e442ed464c75a7f. completed. 2023-02-09 12:03:04,206 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1675944182259.24db9ec6cca428b56e442ed464c75a7f. 2023-02-09 12:03:04,206 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1675944182259.148e52758718776d49fecdf247dc20da. 2023-02-09 12:03:04,206 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1675944182259.148e52758718776d49fecdf247dc20da. started... 2023-02-09 12:03:04,206 INFO [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 148e52758718776d49fecdf247dc20da 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-09 12:03:04,206 DEBUG [member: 'jenkins-hbase4.apache.org,35455,1675944180859' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-09 12:03:04,222 DEBUG [Listener at localhost/36513] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 12:03:04,222 INFO [Listener at localhost/36513] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:04,222 INFO [Listener at localhost/36513] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:04,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37615] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-09 12:03:04,224 INFO [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/148e52758718776d49fecdf247dc20da/.tmp/f1/6310ff8e346042ecb44e8798f7518ffa 2023-02-09 12:03:04,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37615] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-09 12:03:04,224 DEBUG [Listener at localhost/36513] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-09 12:03:04,243 INFO [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/148e52758718776d49fecdf247dc20da/.tmp/f2/f3a80a8d578840eb90d4f701173d1dfa 2023-02-09 12:03:04,250 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/148e52758718776d49fecdf247dc20da/.tmp/f1/6310ff8e346042ecb44e8798f7518ffa as hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/148e52758718776d49fecdf247dc20da/f1/6310ff8e346042ecb44e8798f7518ffa 2023-02-09 12:03:04,255 INFO [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/148e52758718776d49fecdf247dc20da/f1/6310ff8e346042ecb44e8798f7518ffa, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 12:03:04,256 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/148e52758718776d49fecdf247dc20da/.tmp/f2/f3a80a8d578840eb90d4f701173d1dfa as hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/148e52758718776d49fecdf247dc20da/f2/f3a80a8d578840eb90d4f701173d1dfa 2023-02-09 12:03:04,261 INFO [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/148e52758718776d49fecdf247dc20da/f2/f3a80a8d578840eb90d4f701173d1dfa, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 12:03:04,262 INFO [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 148e52758718776d49fecdf247dc20da in 56ms, sequenceid=5, compaction requested=false 2023-02-09 12:03:04,263 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 148e52758718776d49fecdf247dc20da: 2023-02-09 12:03:04,263 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1675944182259.148e52758718776d49fecdf247dc20da.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:04,263 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 12:03:04,263 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/148e52758718776d49fecdf247dc20da/f1/6310ff8e346042ecb44e8798f7518ffa] hfiles 2023-02-09 12:03:04,263 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/148e52758718776d49fecdf247dc20da/f1/6310ff8e346042ecb44e8798f7518ffa for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:04,263 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/148e52758718776d49fecdf247dc20da/f2/f3a80a8d578840eb90d4f701173d1dfa] hfiles 2023-02-09 12:03:04,263 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/148e52758718776d49fecdf247dc20da/f2/f3a80a8d578840eb90d4f701173d1dfa for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:04,272 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1675944182259.148e52758718776d49fecdf247dc20da. completed. 2023-02-09 12:03:04,273 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1675944182259.148e52758718776d49fecdf247dc20da. 2023-02-09 12:03:04,273 DEBUG [member: 'jenkins-hbase4.apache.org,35455,1675944180859' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-09 12:03:04,327 INFO [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/b9bd8844b5681299737e0a2f071b03f3/.tmp/f2/b90588d8e9ec4f789fd4de90e25da9f3 2023-02-09 12:03:04,333 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/b9bd8844b5681299737e0a2f071b03f3/.tmp/f1/e1fc333643cf4ce6aa6a40f51341db4c as hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/b9bd8844b5681299737e0a2f071b03f3/f1/e1fc333643cf4ce6aa6a40f51341db4c 2023-02-09 12:03:04,338 INFO [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/b9bd8844b5681299737e0a2f071b03f3/f1/e1fc333643cf4ce6aa6a40f51341db4c, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-09 12:03:04,338 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/b9bd8844b5681299737e0a2f071b03f3/.tmp/f2/b90588d8e9ec4f789fd4de90e25da9f3 as hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/b9bd8844b5681299737e0a2f071b03f3/f2/b90588d8e9ec4f789fd4de90e25da9f3 2023-02-09 12:03:04,344 INFO [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/b9bd8844b5681299737e0a2f071b03f3/f2/b90588d8e9ec4f789fd4de90e25da9f3, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-09 12:03:04,345 INFO [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for b9bd8844b5681299737e0a2f071b03f3 in 665ms, sequenceid=5, compaction requested=false 2023-02-09 12:03:04,345 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for b9bd8844b5681299737e0a2f071b03f3: 2023-02-09 12:03:04,345 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1675944182259.b9bd8844b5681299737e0a2f071b03f3.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:04,345 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 12:03:04,345 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/b9bd8844b5681299737e0a2f071b03f3/f1/e1fc333643cf4ce6aa6a40f51341db4c] hfiles 2023-02-09 12:03:04,345 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/b9bd8844b5681299737e0a2f071b03f3/f1/e1fc333643cf4ce6aa6a40f51341db4c for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:04,345 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/b9bd8844b5681299737e0a2f071b03f3/f2/b90588d8e9ec4f789fd4de90e25da9f3] hfiles 2023-02-09 12:03:04,345 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/b9bd8844b5681299737e0a2f071b03f3/f2/b90588d8e9ec4f789fd4de90e25da9f3 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:04,357 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1675944182259.b9bd8844b5681299737e0a2f071b03f3. completed. 2023-02-09 12:03:04,357 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1675944182259.b9bd8844b5681299737e0a2f071b03f3. 2023-02-09 12:03:04,357 DEBUG [member: 'jenkins-hbase4.apache.org,35455,1675944180859' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-09 12:03:04,450 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1675944182259.f8b958d29e440ca92af212e18425d242. completed. 2023-02-09 12:03:04,450 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1675944182259.f8b958d29e440ca92af212e18425d242. 2023-02-09 12:03:04,450 DEBUG [member: 'jenkins-hbase4.apache.org,35455,1675944180859' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-09 12:03:04,450 DEBUG [member: 'jenkins-hbase4.apache.org,35455,1675944180859' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-09 12:03:04,450 DEBUG [member: 'jenkins-hbase4.apache.org,35455,1675944180859' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35455,1675944180859 2023-02-09 12:03:04,450 DEBUG [member: 'jenkins-hbase4.apache.org,35455,1675944180859' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-09 12:03:04,450 DEBUG [member: 'jenkins-hbase4.apache.org,35455,1675944180859' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase4.apache.org,35455,1675944180859' in zk 2023-02-09 12:03:04,452 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35455,1675944180859 2023-02-09 12:03:04,452 DEBUG [member: 'jenkins-hbase4.apache.org,35455,1675944180859' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-09 12:03:04,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35455,1675944180859 2023-02-09 12:03:04,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 12:03:04,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 12:03:04,452 DEBUG [member: 'jenkins-hbase4.apache.org,35455,1675944180859' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 12:03:04,452 DEBUG [member: 'jenkins-hbase4.apache.org,35455,1675944180859' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-09 12:03:04,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 12:03:04,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 12:03:04,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:04,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35455,1675944180859 2023-02-09 12:03:04,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43189,1675944180899 2023-02-09 12:03:04,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 12:03:04,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:04,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35455,1675944180859 2023-02-09 12:03:04,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase4.apache.org,35455,1675944180859': 2023-02-09 12:03:04,457 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35455,1675944180859' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 1 more 2023-02-09 12:03:04,459 INFO [rs(jenkins-hbase4.apache.org,43189,1675944180899)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/fc52dac117cb96590c6edd7ac65df056/.tmp/f2/49b86c6c43894bf6a027ed6cfd78f851 2023-02-09 12:03:04,470 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/fc52dac117cb96590c6edd7ac65df056/.tmp/f1/ee422794f0314247ae6e9d11d6af55ea as hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/fc52dac117cb96590c6edd7ac65df056/f1/ee422794f0314247ae6e9d11d6af55ea 2023-02-09 12:03:04,476 INFO [rs(jenkins-hbase4.apache.org,43189,1675944180899)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/fc52dac117cb96590c6edd7ac65df056/f1/ee422794f0314247ae6e9d11d6af55ea, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 12:03:04,477 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/fc52dac117cb96590c6edd7ac65df056/.tmp/f2/49b86c6c43894bf6a027ed6cfd78f851 as hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/fc52dac117cb96590c6edd7ac65df056/f2/49b86c6c43894bf6a027ed6cfd78f851 2023-02-09 12:03:04,490 INFO [rs(jenkins-hbase4.apache.org,43189,1675944180899)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/fc52dac117cb96590c6edd7ac65df056/f2/49b86c6c43894bf6a027ed6cfd78f851, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 12:03:04,491 INFO [rs(jenkins-hbase4.apache.org,43189,1675944180899)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for fc52dac117cb96590c6edd7ac65df056 in 669ms, sequenceid=5, compaction requested=false 2023-02-09 12:03:04,491 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for fc52dac117cb96590c6edd7ac65df056: 2023-02-09 12:03:04,492 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1675944182259.fc52dac117cb96590c6edd7ac65df056.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:04,492 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 12:03:04,492 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/fc52dac117cb96590c6edd7ac65df056/f1/ee422794f0314247ae6e9d11d6af55ea] hfiles 2023-02-09 12:03:04,492 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/fc52dac117cb96590c6edd7ac65df056/f1/ee422794f0314247ae6e9d11d6af55ea for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:04,492 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/fc52dac117cb96590c6edd7ac65df056/f2/49b86c6c43894bf6a027ed6cfd78f851] hfiles 2023-02-09 12:03:04,492 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/fc52dac117cb96590c6edd7ac65df056/f2/49b86c6c43894bf6a027ed6cfd78f851 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:04,503 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1675944182259.fc52dac117cb96590c6edd7ac65df056. completed. 2023-02-09 12:03:04,504 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1675944182259.fc52dac117cb96590c6edd7ac65df056. 2023-02-09 12:03:04,504 DEBUG [member: 'jenkins-hbase4.apache.org,43189,1675944180899' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-09 12:03:04,504 DEBUG [member: 'jenkins-hbase4.apache.org,43189,1675944180899' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-09 12:03:04,504 DEBUG [member: 'jenkins-hbase4.apache.org,43189,1675944180899' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43189,1675944180899 2023-02-09 12:03:04,504 DEBUG [member: 'jenkins-hbase4.apache.org,43189,1675944180899' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-09 12:03:04,504 DEBUG [member: 'jenkins-hbase4.apache.org,43189,1675944180899' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase4.apache.org,43189,1675944180899' in zk 2023-02-09 12:03:04,506 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,43189,1675944180899 2023-02-09 12:03:04,506 DEBUG [member: 'jenkins-hbase4.apache.org,43189,1675944180899' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-09 12:03:04,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,43189,1675944180899 2023-02-09 12:03:04,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 12:03:04,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 12:03:04,506 DEBUG [member: 'jenkins-hbase4.apache.org,43189,1675944180899' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 12:03:04,506 DEBUG [member: 'jenkins-hbase4.apache.org,43189,1675944180899' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-09 12:03:04,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 12:03:04,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 12:03:04,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:04,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35455,1675944180859 2023-02-09 12:03:04,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43189,1675944180899 2023-02-09 12:03:04,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 12:03:04,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:04,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35455,1675944180859 2023-02-09 12:03:04,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43189,1675944180899 2023-02-09 12:03:04,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase4.apache.org,43189,1675944180899': 2023-02-09 12:03:04,511 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43189,1675944180899' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 0 more 2023-02-09 12:03:04,511 INFO [(jenkins-hbase4.apache.org,37615,1675944180795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' execution completed 2023-02-09 12:03:04,511 DEBUG [(jenkins-hbase4.apache.org,37615,1675944180795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 12:03:04,511 DEBUG [(jenkins-hbase4.apache.org,37615,1675944180795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 12:03:04,511 DEBUG [(jenkins-hbase4.apache.org,37615,1675944180795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:04,511 INFO [(jenkins-hbase4.apache.org,37615,1675944180795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceAndOfflineHBaseMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-09 12:03:04,513 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): regionserver:35455-0x10038f6a5e10001, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:04,513 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): regionserver:43189-0x10038f6a5e10002, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:04,513 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:04,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:04,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:04,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:04,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 12:03:04,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 12:03:04,513 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): regionserver:43189-0x10038f6a5e10002, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 12:03:04,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:04,513 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): regionserver:35455-0x10038f6a5e10001, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 12:03:04,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:04,514 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 12:03:04,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 12:03:04,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 12:03:04,514 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 12:03:04,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 12:03:04,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:04,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:04,515 DEBUG [(jenkins-hbase4.apache.org,37615,1675944180795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35455,1675944180859 2023-02-09 12:03:04,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:04,515 DEBUG [(jenkins-hbase4.apache.org,37615,1675944180795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,43189,1675944180899 2023-02-09 12:03:04,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 12:03:04,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:04,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35455,1675944180859 2023-02-09 12:03:04,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43189,1675944180899 2023-02-09 12:03:04,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 12:03:04,517 DEBUG [(jenkins-hbase4.apache.org,37615,1675944180795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35455,1675944180859 2023-02-09 12:03:04,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:04,518 DEBUG [(jenkins-hbase4.apache.org,37615,1675944180795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,43189,1675944180899 2023-02-09 12:03:04,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35455,1675944180859 2023-02-09 12:03:04,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43189,1675944180899 2023-02-09 12:03:04,529 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,43189,1675944180899 2023-02-09 12:03:04,529 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:04,529 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35455,1675944180859 2023-02-09 12:03:04,529 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:04,529 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): regionserver:43189-0x10038f6a5e10002, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 12:03:04,529 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): regionserver:35455-0x10038f6a5e10001, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 12:03:04,529 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,43189,1675944180899 2023-02-09 12:03:04,529 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 12:03:04,529 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:04,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 12:03:04,529 DEBUG [(jenkins-hbase4.apache.org,37615,1675944180795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 12:03:04,529 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:04,529 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): regionserver:35455-0x10038f6a5e10001, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 12:03:04,529 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 12:03:04,529 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): regionserver:43189-0x10038f6a5e10002, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 12:03:04,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 12:03:04,530 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35455,1675944180859 2023-02-09 12:03:04,529 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:04,531 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:04,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 12:03:04,531 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:04,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 12:03:04,531 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 12:03:04,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 12:03:04,532 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:04,725 DEBUG [Listener at localhost/36513] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 12:03:04,725 INFO [Listener at localhost/36513] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:04,725 INFO [Listener at localhost/36513] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:04,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37615] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-09 12:03:04,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37615] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-09 12:03:04,727 DEBUG [Listener at localhost/36513] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-09 12:03:04,989 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion to hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/.hbase-snapshot/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:05,416 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed 2023-02-09 12:03:05,416 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:05,417 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:05,417 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1675944183612Consolidate snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1675944184529 (+917 ms)Loading Region manifests for testWithMapReduceAndOfflineHBaseMultiRegion at 1675944184531 (+2 ms)Writing data manifest for testWithMapReduceAndOfflineHBaseMultiRegion at 1675944184548 (+17 ms)Verifying snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1675944184968 (+420 ms)Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed at 1675944185416 (+448 ms) 2023-02-09 12:03:05,418 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-09 12:03:05,420 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 1.8050 sec 2023-02-09 12:03:05,727 DEBUG [Listener at localhost/36513] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 12:03:05,727 INFO [Listener at localhost/36513] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:05,728 INFO [Listener at localhost/36513] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:05,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37615] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-09 12:03:05,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37615] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-09 12:03:05,729 INFO [Listener at localhost/36513] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-09 12:03:05,730 INFO [Listener at localhost/36513] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:05,730 INFO [Listener at localhost/36513] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:05,735 INFO [Listener at localhost/36513] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-09 12:03:05,743 INFO [Listener at localhost/36513] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-09 12:03:05,779 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43189] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6084 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,g\xA7\xA7,1675944182259.57c7ac6814f18d2541df5c154c377d70. 2023-02-09 12:03:06,099 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 11492 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1675944182259.b9bd8844b5681299737e0a2f071b03f3. 2023-02-09 12:03:06,200 INFO [Listener at localhost/36513] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-09 12:03:06,205 INFO [Listener at localhost/36513] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:06,206 INFO [Listener at localhost/36513] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:06,208 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 12:03:06,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37615] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-09 12:03:06,216 INFO [(jenkins-hbase4.apache.org,37615,1675944180795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-09 12:03:06,216 DEBUG [(jenkins-hbase4.apache.org,37615,1675944180795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 12:03:06,217 DEBUG [(jenkins-hbase4.apache.org,37615,1675944180795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-09 12:03:06,217 DEBUG [(jenkins-hbase4.apache.org,37615,1675944180795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-09 12:03:06,218 DEBUG [(jenkins-hbase4.apache.org,37615,1675944180795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 12:03:06,218 DEBUG [(jenkins-hbase4.apache.org,37615,1675944180795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 12:03:06,219 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): regionserver:35455-0x10038f6a5e10001, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 12:03:06,219 DEBUG [(jenkins-hbase4.apache.org,37615,1675944180795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35455,1675944180859 2023-02-09 12:03:06,219 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 12:03:06,219 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): regionserver:43189-0x10038f6a5e10002, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 12:03:06,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 12:03:06,220 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 12:03:06,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 12:03:06,220 DEBUG [(jenkins-hbase4.apache.org,37615,1675944180795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35455,1675944180859 2023-02-09 12:03:06,220 DEBUG [(jenkins-hbase4.apache.org,37615,1675944180795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,43189,1675944180899 2023-02-09 12:03:06,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 12:03:06,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 12:03:06,221 DEBUG [(jenkins-hbase4.apache.org,37615,1675944180795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,43189,1675944180899 2023-02-09 12:03:06,221 DEBUG [(jenkins-hbase4.apache.org,37615,1675944180795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 12:03:06,221 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35455-0x10038f6a5e10001, quorum=127.0.0.1:63665, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 12:03:06,221 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43189-0x10038f6a5e10002, quorum=127.0.0.1:63665, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 12:03:06,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 12:03:06,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 12:03:06,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 12:03:06,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 12:03:06,221 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-09 12:03:06,221 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-09 12:03:06,222 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-09 12:03:06,222 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-09 12:03:06,223 DEBUG [member: 'jenkins-hbase4.apache.org,43189,1675944180899' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-09 12:03:06,223 DEBUG [member: 'jenkins-hbase4.apache.org,43189,1675944180899' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 12:03:06,223 DEBUG [member: 'jenkins-hbase4.apache.org,35455,1675944180859' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-09 12:03:06,224 DEBUG [member: 'jenkins-hbase4.apache.org,35455,1675944180859' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 12:03:06,224 DEBUG [member: 'jenkins-hbase4.apache.org,43189,1675944180899' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-09 12:03:06,225 DEBUG [member: 'jenkins-hbase4.apache.org,35455,1675944180859' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-09 12:03:06,225 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1675944182259.08fa7b5b79fbcbb53ed767bc07fed909. 2023-02-09 12:03:06,225 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1675944182259.08fa7b5b79fbcbb53ed767bc07fed909. started... 2023-02-09 12:03:06,225 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 08fa7b5b79fbcbb53ed767bc07fed909: 2023-02-09 12:03:06,225 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1675944182259.08fa7b5b79fbcbb53ed767bc07fed909. 2023-02-09 12:03:06,228 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1675944182259.266cae67ac0efcfe59291a310a667874. 2023-02-09 12:03:06,228 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1675944182259.266cae67ac0efcfe59291a310a667874. started... 2023-02-09 12:03:06,228 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1675944182259.e361e7c32d779b70cb86f6640113527e. 2023-02-09 12:03:06,228 INFO [rs(jenkins-hbase4.apache.org,35455,1675944180859)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 266cae67ac0efcfe59291a310a667874 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-09 12:03:06,228 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1675944182259.e361e7c32d779b70cb86f6640113527e. started... 2023-02-09 12:03:06,228 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1675944182259.f8b958d29e440ca92af212e18425d242. 2023-02-09 12:03:06,228 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1675944182259.fc52dac117cb96590c6edd7ac65df056. 2023-02-09 12:03:06,228 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1675944182259.f8b958d29e440ca92af212e18425d242. started... 2023-02-09 12:03:06,228 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for e361e7c32d779b70cb86f6640113527e: 2023-02-09 12:03:06,228 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1675944182259.e361e7c32d779b70cb86f6640113527e. 2023-02-09 12:03:06,228 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1675944182259.57c7ac6814f18d2541df5c154c377d70. 2023-02-09 12:03:06,228 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1675944182259.57c7ac6814f18d2541df5c154c377d70. started... 2023-02-09 12:03:06,229 INFO [rs(jenkins-hbase4.apache.org,43189,1675944180899)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 57c7ac6814f18d2541df5c154c377d70 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-09 12:03:06,229 DEBUG [member: 'jenkins-hbase4.apache.org,35455,1675944180859' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-09 12:03:06,228 DEBUG [member: 'jenkins-hbase4.apache.org,43189,1675944180899' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-09 12:03:06,229 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1675944182259.b9bd8844b5681299737e0a2f071b03f3. 2023-02-09 12:03:06,229 DEBUG [member: 'jenkins-hbase4.apache.org,43189,1675944180899' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 12:03:06,229 DEBUG [member: 'jenkins-hbase4.apache.org,35455,1675944180859' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 12:03:06,228 INFO [rs(jenkins-hbase4.apache.org,35455,1675944180859)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing f8b958d29e440ca92af212e18425d242 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-09 12:03:06,228 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1675944182259.546fab1946eca3d1b91f4645b19fe169. 2023-02-09 12:03:06,228 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1675944182259.fc52dac117cb96590c6edd7ac65df056. started... 2023-02-09 12:03:06,231 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1675944182259.546fab1946eca3d1b91f4645b19fe169. started... 2023-02-09 12:03:06,231 INFO [rs(jenkins-hbase4.apache.org,43189,1675944180899)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing fc52dac117cb96590c6edd7ac65df056 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-09 12:03:06,230 DEBUG [member: 'jenkins-hbase4.apache.org,43189,1675944180899' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-09 12:03:06,231 DEBUG [member: 'jenkins-hbase4.apache.org,43189,1675944180899' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-09 12:03:06,231 INFO [rs(jenkins-hbase4.apache.org,43189,1675944180899)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 546fab1946eca3d1b91f4645b19fe169 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-09 12:03:06,229 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1675944182259.b9bd8844b5681299737e0a2f071b03f3. started... 2023-02-09 12:03:06,232 INFO [rs(jenkins-hbase4.apache.org,35455,1675944180859)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing b9bd8844b5681299737e0a2f071b03f3 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-09 12:03:06,274 INFO [rs(jenkins-hbase4.apache.org,43189,1675944180899)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/fc52dac117cb96590c6edd7ac65df056/.tmp/f1/398cbb5bc7f24ae5ab4031ccc3b3a13b 2023-02-09 12:03:06,296 INFO [rs(jenkins-hbase4.apache.org,35455,1675944180859)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/266cae67ac0efcfe59291a310a667874/.tmp/f1/fe3082e053574ebf9b13f6e4622695a4 2023-02-09 12:03:06,302 INFO [rs(jenkins-hbase4.apache.org,43189,1675944180899)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/57c7ac6814f18d2541df5c154c377d70/.tmp/f1/80a6e40af7564ff591e21d675190bd80 2023-02-09 12:03:06,309 INFO [rs(jenkins-hbase4.apache.org,43189,1675944180899)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/546fab1946eca3d1b91f4645b19fe169/.tmp/f1/d6f0d734582c4398a1246b31f103ced2 2023-02-09 12:03:06,311 INFO [rs(jenkins-hbase4.apache.org,35455,1675944180859)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/b9bd8844b5681299737e0a2f071b03f3/.tmp/f1/f6fbf68be0bc47cdaf81d88bd3d29823 2023-02-09 12:03:06,325 INFO [rs(jenkins-hbase4.apache.org,35455,1675944180859)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/f8b958d29e440ca92af212e18425d242/.tmp/f1/ab14c057b6bd488d9d76508bc1ab4fce 2023-02-09 12:03:06,356 INFO [rs(jenkins-hbase4.apache.org,43189,1675944180899)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/57c7ac6814f18d2541df5c154c377d70/.tmp/f2/200a70b1160e43a4bf9bf271d03df2b2 2023-02-09 12:03:06,356 INFO [rs(jenkins-hbase4.apache.org,35455,1675944180859)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/266cae67ac0efcfe59291a310a667874/.tmp/f2/2bbd6fdcd06a430a8bbf755e1eb04c87 2023-02-09 12:03:06,357 INFO [rs(jenkins-hbase4.apache.org,43189,1675944180899)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/fc52dac117cb96590c6edd7ac65df056/.tmp/f2/a0af953b2df644cdaaaf969649b100a4 2023-02-09 12:03:06,372 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/266cae67ac0efcfe59291a310a667874/.tmp/f1/fe3082e053574ebf9b13f6e4622695a4 as hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/266cae67ac0efcfe59291a310a667874/f1/fe3082e053574ebf9b13f6e4622695a4 2023-02-09 12:03:06,377 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/57c7ac6814f18d2541df5c154c377d70/.tmp/f1/80a6e40af7564ff591e21d675190bd80 as hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/57c7ac6814f18d2541df5c154c377d70/f1/80a6e40af7564ff591e21d675190bd80 2023-02-09 12:03:06,381 INFO [rs(jenkins-hbase4.apache.org,35455,1675944180859)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/266cae67ac0efcfe59291a310a667874/f1/fe3082e053574ebf9b13f6e4622695a4, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 12:03:06,383 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/266cae67ac0efcfe59291a310a667874/.tmp/f2/2bbd6fdcd06a430a8bbf755e1eb04c87 as hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/266cae67ac0efcfe59291a310a667874/f2/2bbd6fdcd06a430a8bbf755e1eb04c87 2023-02-09 12:03:06,387 INFO [rs(jenkins-hbase4.apache.org,43189,1675944180899)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/57c7ac6814f18d2541df5c154c377d70/f1/80a6e40af7564ff591e21d675190bd80, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 12:03:06,388 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/57c7ac6814f18d2541df5c154c377d70/.tmp/f2/200a70b1160e43a4bf9bf271d03df2b2 as hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/57c7ac6814f18d2541df5c154c377d70/f2/200a70b1160e43a4bf9bf271d03df2b2 2023-02-09 12:03:06,390 INFO [rs(jenkins-hbase4.apache.org,35455,1675944180859)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/266cae67ac0efcfe59291a310a667874/f2/2bbd6fdcd06a430a8bbf755e1eb04c87, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 12:03:06,391 INFO [rs(jenkins-hbase4.apache.org,35455,1675944180859)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 266cae67ac0efcfe59291a310a667874 in 163ms, sequenceid=9, compaction requested=false 2023-02-09 12:03:06,391 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 266cae67ac0efcfe59291a310a667874: 2023-02-09 12:03:06,391 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1675944182259.266cae67ac0efcfe59291a310a667874. 2023-02-09 12:03:06,395 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1675944182259.24db9ec6cca428b56e442ed464c75a7f. 2023-02-09 12:03:06,395 DEBUG [member: 'jenkins-hbase4.apache.org,35455,1675944180859' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-09 12:03:06,395 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1675944182259.24db9ec6cca428b56e442ed464c75a7f. started... 2023-02-09 12:03:06,395 INFO [rs(jenkins-hbase4.apache.org,35455,1675944180859)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 24db9ec6cca428b56e442ed464c75a7f 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-09 12:03:06,403 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/fc52dac117cb96590c6edd7ac65df056/.tmp/f1/398cbb5bc7f24ae5ab4031ccc3b3a13b as hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/fc52dac117cb96590c6edd7ac65df056/f1/398cbb5bc7f24ae5ab4031ccc3b3a13b 2023-02-09 12:03:06,405 INFO [rs(jenkins-hbase4.apache.org,43189,1675944180899)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/57c7ac6814f18d2541df5c154c377d70/f2/200a70b1160e43a4bf9bf271d03df2b2, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 12:03:06,406 INFO [rs(jenkins-hbase4.apache.org,43189,1675944180899)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 57c7ac6814f18d2541df5c154c377d70 in 177ms, sequenceid=9, compaction requested=false 2023-02-09 12:03:06,406 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 57c7ac6814f18d2541df5c154c377d70: 2023-02-09 12:03:06,406 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1675944182259.57c7ac6814f18d2541df5c154c377d70. 2023-02-09 12:03:06,409 INFO [rs(jenkins-hbase4.apache.org,43189,1675944180899)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/fc52dac117cb96590c6edd7ac65df056/f1/398cbb5bc7f24ae5ab4031ccc3b3a13b, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 12:03:06,410 DEBUG [member: 'jenkins-hbase4.apache.org,43189,1675944180899' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-09 12:03:06,410 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/fc52dac117cb96590c6edd7ac65df056/.tmp/f2/a0af953b2df644cdaaaf969649b100a4 as hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/fc52dac117cb96590c6edd7ac65df056/f2/a0af953b2df644cdaaaf969649b100a4 2023-02-09 12:03:06,416 INFO [rs(jenkins-hbase4.apache.org,43189,1675944180899)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/fc52dac117cb96590c6edd7ac65df056/f2/a0af953b2df644cdaaaf969649b100a4, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 12:03:06,417 INFO [rs(jenkins-hbase4.apache.org,43189,1675944180899)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for fc52dac117cb96590c6edd7ac65df056 in 186ms, sequenceid=9, compaction requested=false 2023-02-09 12:03:06,417 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for fc52dac117cb96590c6edd7ac65df056: 2023-02-09 12:03:06,417 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1675944182259.fc52dac117cb96590c6edd7ac65df056. 2023-02-09 12:03:06,417 DEBUG [member: 'jenkins-hbase4.apache.org,43189,1675944180899' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-09 12:03:06,424 INFO [rs(jenkins-hbase4.apache.org,43189,1675944180899)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/546fab1946eca3d1b91f4645b19fe169/.tmp/f2/5e5f310c208a4a0c8c9ef6c838a5ad29 2023-02-09 12:03:06,429 INFO [rs(jenkins-hbase4.apache.org,35455,1675944180859)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/f8b958d29e440ca92af212e18425d242/.tmp/f2/4dc9659a1c2446af95b89e28831f8f7e 2023-02-09 12:03:06,432 INFO [rs(jenkins-hbase4.apache.org,35455,1675944180859)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/24db9ec6cca428b56e442ed464c75a7f/.tmp/f1/e15e730b6ec14e7face4a922bfa4fef7 2023-02-09 12:03:06,435 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/546fab1946eca3d1b91f4645b19fe169/.tmp/f1/d6f0d734582c4398a1246b31f103ced2 as hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/546fab1946eca3d1b91f4645b19fe169/f1/d6f0d734582c4398a1246b31f103ced2 2023-02-09 12:03:06,441 INFO [rs(jenkins-hbase4.apache.org,43189,1675944180899)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/546fab1946eca3d1b91f4645b19fe169/f1/d6f0d734582c4398a1246b31f103ced2, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 12:03:06,442 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/f8b958d29e440ca92af212e18425d242/.tmp/f1/ab14c057b6bd488d9d76508bc1ab4fce as hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/f8b958d29e440ca92af212e18425d242/f1/ab14c057b6bd488d9d76508bc1ab4fce 2023-02-09 12:03:06,442 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/546fab1946eca3d1b91f4645b19fe169/.tmp/f2/5e5f310c208a4a0c8c9ef6c838a5ad29 as hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/546fab1946eca3d1b91f4645b19fe169/f2/5e5f310c208a4a0c8c9ef6c838a5ad29 2023-02-09 12:03:06,447 INFO [rs(jenkins-hbase4.apache.org,35455,1675944180859)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/f8b958d29e440ca92af212e18425d242/f1/ab14c057b6bd488d9d76508bc1ab4fce, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 12:03:06,448 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/f8b958d29e440ca92af212e18425d242/.tmp/f2/4dc9659a1c2446af95b89e28831f8f7e as hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/f8b958d29e440ca92af212e18425d242/f2/4dc9659a1c2446af95b89e28831f8f7e 2023-02-09 12:03:06,450 INFO [rs(jenkins-hbase4.apache.org,43189,1675944180899)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/546fab1946eca3d1b91f4645b19fe169/f2/5e5f310c208a4a0c8c9ef6c838a5ad29, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 12:03:06,451 INFO [rs(jenkins-hbase4.apache.org,43189,1675944180899)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 546fab1946eca3d1b91f4645b19fe169 in 220ms, sequenceid=9, compaction requested=false 2023-02-09 12:03:06,451 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 546fab1946eca3d1b91f4645b19fe169: 2023-02-09 12:03:06,451 DEBUG [rs(jenkins-hbase4.apache.org,43189,1675944180899)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1675944182259.546fab1946eca3d1b91f4645b19fe169. 2023-02-09 12:03:06,451 DEBUG [member: 'jenkins-hbase4.apache.org,43189,1675944180899' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-09 12:03:06,451 DEBUG [member: 'jenkins-hbase4.apache.org,43189,1675944180899' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-09 12:03:06,451 DEBUG [member: 'jenkins-hbase4.apache.org,43189,1675944180899' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43189,1675944180899 2023-02-09 12:03:06,453 INFO [rs(jenkins-hbase4.apache.org,35455,1675944180859)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/f8b958d29e440ca92af212e18425d242/f2/4dc9659a1c2446af95b89e28831f8f7e, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 12:03:06,454 INFO [rs(jenkins-hbase4.apache.org,35455,1675944180859)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for f8b958d29e440ca92af212e18425d242 in 226ms, sequenceid=9, compaction requested=false 2023-02-09 12:03:06,454 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for f8b958d29e440ca92af212e18425d242: 2023-02-09 12:03:06,454 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1675944182259.f8b958d29e440ca92af212e18425d242. 2023-02-09 12:03:06,455 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1675944182259.148e52758718776d49fecdf247dc20da. 2023-02-09 12:03:06,455 DEBUG [member: 'jenkins-hbase4.apache.org,35455,1675944180859' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-09 12:03:06,455 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1675944182259.148e52758718776d49fecdf247dc20da. started... 2023-02-09 12:03:06,455 INFO [rs(jenkins-hbase4.apache.org,35455,1675944180859)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 148e52758718776d49fecdf247dc20da 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-09 12:03:06,456 DEBUG [member: 'jenkins-hbase4.apache.org,43189,1675944180899' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-09 12:03:06,456 DEBUG [member: 'jenkins-hbase4.apache.org,43189,1675944180899' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43189,1675944180899' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-09 12:03:06,458 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,43189,1675944180899 2023-02-09 12:03:06,458 DEBUG [member: 'jenkins-hbase4.apache.org,43189,1675944180899' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 12:03:06,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,43189,1675944180899 2023-02-09 12:03:06,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 12:03:06,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 12:03:06,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 12:03:06,458 DEBUG [member: 'jenkins-hbase4.apache.org,43189,1675944180899' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43189-0x10038f6a5e10002, quorum=127.0.0.1:63665, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 12:03:06,459 DEBUG [member: 'jenkins-hbase4.apache.org,43189,1675944180899' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 12:03:06,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 12:03:06,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 12:03:06,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43189,1675944180899 2023-02-09 12:03:06,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 12:03:06,460 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43189,1675944180899' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-09 12:03:06,460 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@d5dceda[Count = 1] remaining members to acquire global barrier 2023-02-09 12:03:06,467 INFO [rs(jenkins-hbase4.apache.org,35455,1675944180859)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/24db9ec6cca428b56e442ed464c75a7f/.tmp/f2/5e5ba070934146c480e3773c8d8044ca 2023-02-09 12:03:06,473 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/24db9ec6cca428b56e442ed464c75a7f/.tmp/f1/e15e730b6ec14e7face4a922bfa4fef7 as hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/24db9ec6cca428b56e442ed464c75a7f/f1/e15e730b6ec14e7face4a922bfa4fef7 2023-02-09 12:03:06,477 INFO [rs(jenkins-hbase4.apache.org,35455,1675944180859)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/24db9ec6cca428b56e442ed464c75a7f/f1/e15e730b6ec14e7face4a922bfa4fef7, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-09 12:03:06,478 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/24db9ec6cca428b56e442ed464c75a7f/.tmp/f2/5e5ba070934146c480e3773c8d8044ca as hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/24db9ec6cca428b56e442ed464c75a7f/f2/5e5ba070934146c480e3773c8d8044ca 2023-02-09 12:03:06,483 INFO [rs(jenkins-hbase4.apache.org,35455,1675944180859)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/148e52758718776d49fecdf247dc20da/.tmp/f1/4c8e9f3fd5994206877fb055ff0a5a11 2023-02-09 12:03:06,485 INFO [rs(jenkins-hbase4.apache.org,35455,1675944180859)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/24db9ec6cca428b56e442ed464c75a7f/f2/5e5ba070934146c480e3773c8d8044ca, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-09 12:03:06,486 INFO [rs(jenkins-hbase4.apache.org,35455,1675944180859)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 24db9ec6cca428b56e442ed464c75a7f in 91ms, sequenceid=9, compaction requested=false 2023-02-09 12:03:06,486 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 24db9ec6cca428b56e442ed464c75a7f: 2023-02-09 12:03:06,486 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1675944182259.24db9ec6cca428b56e442ed464c75a7f. 2023-02-09 12:03:06,486 DEBUG [member: 'jenkins-hbase4.apache.org,35455,1675944180859' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-09 12:03:06,506 INFO [rs(jenkins-hbase4.apache.org,35455,1675944180859)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/148e52758718776d49fecdf247dc20da/.tmp/f2/daa5a3cfab62449a982e1f14b97a37a8 2023-02-09 12:03:06,512 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/148e52758718776d49fecdf247dc20da/.tmp/f1/4c8e9f3fd5994206877fb055ff0a5a11 as hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/148e52758718776d49fecdf247dc20da/f1/4c8e9f3fd5994206877fb055ff0a5a11 2023-02-09 12:03:06,516 INFO [rs(jenkins-hbase4.apache.org,35455,1675944180859)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/148e52758718776d49fecdf247dc20da/f1/4c8e9f3fd5994206877fb055ff0a5a11, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 12:03:06,517 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/148e52758718776d49fecdf247dc20da/.tmp/f2/daa5a3cfab62449a982e1f14b97a37a8 as hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/148e52758718776d49fecdf247dc20da/f2/daa5a3cfab62449a982e1f14b97a37a8 2023-02-09 12:03:06,521 INFO [rs(jenkins-hbase4.apache.org,35455,1675944180859)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/148e52758718776d49fecdf247dc20da/f2/daa5a3cfab62449a982e1f14b97a37a8, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 12:03:06,522 INFO [rs(jenkins-hbase4.apache.org,35455,1675944180859)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 148e52758718776d49fecdf247dc20da in 67ms, sequenceid=9, compaction requested=false 2023-02-09 12:03:06,522 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 148e52758718776d49fecdf247dc20da: 2023-02-09 12:03:06,522 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1675944182259.148e52758718776d49fecdf247dc20da. 2023-02-09 12:03:06,522 DEBUG [member: 'jenkins-hbase4.apache.org,35455,1675944180859' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-09 12:03:06,808 INFO [rs(jenkins-hbase4.apache.org,35455,1675944180859)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/b9bd8844b5681299737e0a2f071b03f3/.tmp/f2/644ba2bc2a014b08a691a7b9aa2f3116 2023-02-09 12:03:06,814 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/b9bd8844b5681299737e0a2f071b03f3/.tmp/f1/f6fbf68be0bc47cdaf81d88bd3d29823 as hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/b9bd8844b5681299737e0a2f071b03f3/f1/f6fbf68be0bc47cdaf81d88bd3d29823 2023-02-09 12:03:06,819 INFO [rs(jenkins-hbase4.apache.org,35455,1675944180859)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/b9bd8844b5681299737e0a2f071b03f3/f1/f6fbf68be0bc47cdaf81d88bd3d29823, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-09 12:03:06,819 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/b9bd8844b5681299737e0a2f071b03f3/.tmp/f2/644ba2bc2a014b08a691a7b9aa2f3116 as hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/b9bd8844b5681299737e0a2f071b03f3/f2/644ba2bc2a014b08a691a7b9aa2f3116 2023-02-09 12:03:06,824 INFO [rs(jenkins-hbase4.apache.org,35455,1675944180859)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/b9bd8844b5681299737e0a2f071b03f3/f2/644ba2bc2a014b08a691a7b9aa2f3116, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-09 12:03:06,825 INFO [rs(jenkins-hbase4.apache.org,35455,1675944180859)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for b9bd8844b5681299737e0a2f071b03f3 in 593ms, sequenceid=9, compaction requested=false 2023-02-09 12:03:06,825 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for b9bd8844b5681299737e0a2f071b03f3: 2023-02-09 12:03:06,825 DEBUG [rs(jenkins-hbase4.apache.org,35455,1675944180859)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1675944182259.b9bd8844b5681299737e0a2f071b03f3. 2023-02-09 12:03:06,825 DEBUG [member: 'jenkins-hbase4.apache.org,35455,1675944180859' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-09 12:03:06,825 DEBUG [member: 'jenkins-hbase4.apache.org,35455,1675944180859' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-09 12:03:06,825 DEBUG [member: 'jenkins-hbase4.apache.org,35455,1675944180859' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35455,1675944180859 2023-02-09 12:03:06,825 DEBUG [member: 'jenkins-hbase4.apache.org,35455,1675944180859' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-09 12:03:06,825 DEBUG [member: 'jenkins-hbase4.apache.org,35455,1675944180859' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35455,1675944180859' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-09 12:03:06,827 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35455,1675944180859 2023-02-09 12:03:06,827 DEBUG [member: 'jenkins-hbase4.apache.org,35455,1675944180859' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 12:03:06,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35455,1675944180859 2023-02-09 12:03:06,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 12:03:06,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 12:03:06,827 DEBUG [member: 'jenkins-hbase4.apache.org,35455,1675944180859' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35455-0x10038f6a5e10001, quorum=127.0.0.1:63665, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 12:03:06,827 DEBUG [member: 'jenkins-hbase4.apache.org,35455,1675944180859' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 12:03:06,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 12:03:06,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 12:03:06,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 12:03:06,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35455,1675944180859 2023-02-09 12:03:06,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43189,1675944180899 2023-02-09 12:03:06,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 12:03:06,829 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35455,1675944180859' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-09 12:03:06,829 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@d5dceda[Count = 0] remaining members to acquire global barrier 2023-02-09 12:03:06,829 DEBUG [(jenkins-hbase4.apache.org,37615,1675944180795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-09 12:03:06,829 DEBUG [(jenkins-hbase4.apache.org,37615,1675944180795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 12:03:06,831 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): regionserver:35455-0x10038f6a5e10001, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 12:03:06,831 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): regionserver:43189-0x10038f6a5e10002, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 12:03:06,831 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 12:03:06,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 12:03:06,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 12:03:06,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 12:03:06,832 DEBUG [member: 'jenkins-hbase4.apache.org,35455,1675944180859' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-09 12:03:06,832 DEBUG [member: 'jenkins-hbase4.apache.org,43189,1675944180899' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-09 12:03:06,832 DEBUG [(jenkins-hbase4.apache.org,37615,1675944180795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,43189,1675944180899 2023-02-09 12:03:06,832 DEBUG [member: 'jenkins-hbase4.apache.org,43189,1675944180899' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-09 12:03:06,832 DEBUG [member: 'jenkins-hbase4.apache.org,35455,1675944180859' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-09 12:03:06,832 DEBUG [member: 'jenkins-hbase4.apache.org,43189,1675944180899' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,43189,1675944180899' in zk 2023-02-09 12:03:06,832 DEBUG [member: 'jenkins-hbase4.apache.org,35455,1675944180859' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,35455,1675944180859' in zk 2023-02-09 12:03:06,832 DEBUG [(jenkins-hbase4.apache.org,37615,1675944180795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35455,1675944180859 2023-02-09 12:03:06,832 DEBUG [(jenkins-hbase4.apache.org,37615,1675944180795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 12:03:06,833 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,43189,1675944180899 2023-02-09 12:03:06,833 DEBUG [member: 'jenkins-hbase4.apache.org,35455,1675944180859' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-09 12:03:06,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,43189,1675944180899 2023-02-09 12:03:06,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 12:03:06,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 12:03:06,833 DEBUG [member: 'jenkins-hbase4.apache.org,43189,1675944180899' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-09 12:03:06,833 DEBUG [member: 'jenkins-hbase4.apache.org,35455,1675944180859' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 12:03:06,834 DEBUG [member: 'jenkins-hbase4.apache.org,43189,1675944180899' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 12:03:06,833 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35455,1675944180859 2023-02-09 12:03:06,835 DEBUG [member: 'jenkins-hbase4.apache.org,43189,1675944180899' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-09 12:03:06,834 DEBUG [member: 'jenkins-hbase4.apache.org,35455,1675944180859' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-09 12:03:06,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 12:03:06,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 12:03:06,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 12:03:06,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35455,1675944180859 2023-02-09 12:03:06,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43189,1675944180899 2023-02-09 12:03:06,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 12:03:06,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 12:03:06,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35455,1675944180859 2023-02-09 12:03:06,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43189,1675944180899 2023-02-09 12:03:06,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,43189,1675944180899': 2023-02-09 12:03:06,838 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43189,1675944180899' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-09 12:03:06,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35455,1675944180859 2023-02-09 12:03:06,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 12:03:06,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 12:03:06,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 12:03:06,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 12:03:06,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 12:03:06,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35455,1675944180859 2023-02-09 12:03:06,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43189,1675944180899 2023-02-09 12:03:06,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 12:03:06,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 12:03:06,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35455,1675944180859 2023-02-09 12:03:06,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43189,1675944180899 2023-02-09 12:03:06,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,35455,1675944180859': 2023-02-09 12:03:06,841 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35455,1675944180859' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-09 12:03:06,841 INFO [(jenkins-hbase4.apache.org,37615,1675944180795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-09 12:03:06,841 DEBUG [(jenkins-hbase4.apache.org,37615,1675944180795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 12:03:06,841 DEBUG [(jenkins-hbase4.apache.org,37615,1675944180795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 12:03:06,841 DEBUG [(jenkins-hbase4.apache.org,37615,1675944180795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-09 12:03:06,841 INFO [(jenkins-hbase4.apache.org,37615,1675944180795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 12:03:06,843 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): regionserver:35455-0x10038f6a5e10001, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 12:03:06,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 12:03:06,843 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): regionserver:35455-0x10038f6a5e10001, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 12:03:06,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 12:03:06,843 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): regionserver:43189-0x10038f6a5e10002, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 12:03:06,843 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): regionserver:43189-0x10038f6a5e10002, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 12:03:06,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 12:03:06,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 12:03:06,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 12:03:06,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 12:03:06,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 12:03:06,843 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 12:03:06,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 12:03:06,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 12:03:06,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 12:03:06,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 12:03:06,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 12:03:06,844 DEBUG [(jenkins-hbase4.apache.org,37615,1675944180795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35455,1675944180859 2023-02-09 12:03:06,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 12:03:06,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 12:03:06,844 DEBUG [(jenkins-hbase4.apache.org,37615,1675944180795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,43189,1675944180899 2023-02-09 12:03:06,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 12:03:06,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 12:03:06,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 12:03:06,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35455,1675944180859 2023-02-09 12:03:06,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43189,1675944180899 2023-02-09 12:03:06,849 DEBUG [(jenkins-hbase4.apache.org,37615,1675944180795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35455,1675944180859 2023-02-09 12:03:06,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 12:03:06,850 DEBUG [(jenkins-hbase4.apache.org,37615,1675944180795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,43189,1675944180899 2023-02-09 12:03:06,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 12:03:06,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35455,1675944180859 2023-02-09 12:03:06,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43189,1675944180899 2023-02-09 12:03:06,852 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,43189,1675944180899 2023-02-09 12:03:06,852 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 12:03:06,853 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): regionserver:43189-0x10038f6a5e10002, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 12:03:06,853 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): regionserver:43189-0x10038f6a5e10002, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 12:03:06,853 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35455,1675944180859 2023-02-09 12:03:06,853 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): regionserver:35455-0x10038f6a5e10001, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 12:03:06,853 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 12:03:06,853 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-09 12:03:06,853 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 12:03:06,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 12:03:06,853 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 12:03:06,853 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): regionserver:35455-0x10038f6a5e10001, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 12:03:06,853 DEBUG [(jenkins-hbase4.apache.org,37615,1675944180795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 12:03:06,853 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 12:03:06,854 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,43189,1675944180899 2023-02-09 12:03:06,854 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 12:03:06,854 DEBUG [Listener at localhost/36513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-09 12:03:06,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 12:03:06,854 DEBUG [Listener at localhost/36513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 12:03:06,854 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35455,1675944180859 2023-02-09 12:03:06,855 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 12:03:06,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 12:03:06,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 12:03:06,855 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 12:03:06,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 12:03:06,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 12:03:06,955 DEBUG [Listener at localhost/36513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 12:03:06,955 INFO [Listener at localhost/36513] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:06,955 INFO [Listener at localhost/36513] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:06,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 12:03:06,956 INFO [Listener at localhost/36513] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-09 12:03:06,957 DEBUG [Listener at localhost/36513] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3e7f48a8 to 127.0.0.1:63665 2023-02-09 12:03:06,957 DEBUG [Listener at localhost/36513] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 12:03:06,957 DEBUG [Listener at localhost/36513] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-09 12:03:06,957 DEBUG [Listener at localhost/36513] util.JVMClusterUtil(257): Found active master hash=2105627953, stopped=false 2023-02-09 12:03:06,957 INFO [Listener at localhost/36513] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,37615,1675944180795 2023-02-09 12:03:06,960 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): regionserver:43189-0x10038f6a5e10002, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 12:03:06,960 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): regionserver:35455-0x10038f6a5e10001, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 12:03:06,960 INFO [Listener at localhost/36513] procedure2.ProcedureExecutor(629): Stopping 2023-02-09 12:03:06,960 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 12:03:06,961 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 12:03:06,962 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43189-0x10038f6a5e10002, quorum=127.0.0.1:63665, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 12:03:06,962 DEBUG [Listener at localhost/36513] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1d876702 to 127.0.0.1:63665 2023-02-09 12:03:06,962 DEBUG [Listener at localhost/36513] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 12:03:06,962 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35455-0x10038f6a5e10001, quorum=127.0.0.1:63665, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 12:03:06,962 INFO [Listener at localhost/36513] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,35455,1675944180859' ***** 2023-02-09 12:03:06,962 INFO [Listener at localhost/36513] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-09 12:03:06,962 INFO [Listener at localhost/36513] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,43189,1675944180899' ***** 2023-02-09 12:03:06,962 INFO [Listener at localhost/36513] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-09 12:03:06,962 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 12:03:06,963 INFO [RS:1;jenkins-hbase4:43189] regionserver.HeapMemoryManager(220): Stopping 2023-02-09 12:03:06,962 INFO [RS:0;jenkins-hbase4:35455] regionserver.HeapMemoryManager(220): Stopping 2023-02-09 12:03:06,963 INFO [RS:1;jenkins-hbase4:43189] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-09 12:03:06,963 INFO [RS:0;jenkins-hbase4:35455] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-09 12:03:06,963 INFO [RS:1;jenkins-hbase4:43189] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-09 12:03:06,963 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-09 12:03:06,963 INFO [RS:1;jenkins-hbase4:43189] regionserver.HRegionServer(3304): Received CLOSE for 08fa7b5b79fbcbb53ed767bc07fed909 2023-02-09 12:03:06,963 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-09 12:03:06,963 INFO [RS:0;jenkins-hbase4:35455] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-09 12:03:06,965 INFO [RS:0;jenkins-hbase4:35455] regionserver.HRegionServer(3304): Received CLOSE for 266cae67ac0efcfe59291a310a667874 2023-02-09 12:03:06,965 INFO [RS:1;jenkins-hbase4:43189] regionserver.HRegionServer(3304): Received CLOSE for e361e7c32d779b70cb86f6640113527e 2023-02-09 12:03:06,965 INFO [RS:1;jenkins-hbase4:43189] regionserver.HRegionServer(3304): Received CLOSE for 546fab1946eca3d1b91f4645b19fe169 2023-02-09 12:03:06,965 INFO [RS:1;jenkins-hbase4:43189] regionserver.HRegionServer(3304): Received CLOSE for fc52dac117cb96590c6edd7ac65df056 2023-02-09 12:03:06,965 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 08fa7b5b79fbcbb53ed767bc07fed909, disabling compactions & flushes 2023-02-09 12:03:06,965 INFO [RS:0;jenkins-hbase4:35455] regionserver.HRegionServer(3304): Received CLOSE for e1dd793ac803300b286ce0e5bfa795cc 2023-02-09 12:03:06,965 INFO [RS:1;jenkins-hbase4:43189] regionserver.HRegionServer(3304): Received CLOSE for 57c7ac6814f18d2541df5c154c377d70 2023-02-09 12:03:06,965 INFO [RS:0;jenkins-hbase4:35455] regionserver.HRegionServer(3304): Received CLOSE for f8b958d29e440ca92af212e18425d242 2023-02-09 12:03:06,965 INFO [RS:1;jenkins-hbase4:43189] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,43189,1675944180899 2023-02-09 12:03:06,965 INFO [RS:0;jenkins-hbase4:35455] regionserver.HRegionServer(3304): Received CLOSE for b9bd8844b5681299737e0a2f071b03f3 2023-02-09 12:03:06,965 DEBUG [RS:1;jenkins-hbase4:43189] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x51ccd630 to 127.0.0.1:63665 2023-02-09 12:03:06,965 INFO [RS:0;jenkins-hbase4:35455] regionserver.HRegionServer(3304): Received CLOSE for 24db9ec6cca428b56e442ed464c75a7f 2023-02-09 12:03:06,965 DEBUG [RS:1;jenkins-hbase4:43189] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 12:03:06,965 INFO [RS:0;jenkins-hbase4:35455] regionserver.HRegionServer(3304): Received CLOSE for 148e52758718776d49fecdf247dc20da 2023-02-09 12:03:06,965 INFO [RS:1;jenkins-hbase4:43189] regionserver.HRegionServer(1475): Waiting on 5 regions to close 2023-02-09 12:03:06,965 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 266cae67ac0efcfe59291a310a667874, disabling compactions & flushes 2023-02-09 12:03:06,965 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675944182259.08fa7b5b79fbcbb53ed767bc07fed909. 2023-02-09 12:03:06,966 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1675944182259.266cae67ac0efcfe59291a310a667874. 2023-02-09 12:03:06,966 DEBUG [RS:1;jenkins-hbase4:43189] regionserver.HRegionServer(1479): Online Regions={08fa7b5b79fbcbb53ed767bc07fed909=testWithMapReduce,,1675944182259.08fa7b5b79fbcbb53ed767bc07fed909., e361e7c32d779b70cb86f6640113527e=testWithMapReduce,zz{,1675944182259.e361e7c32d779b70cb86f6640113527e., 546fab1946eca3d1b91f4645b19fe169=testWithMapReduce,m\xED\xED,1675944182259.546fab1946eca3d1b91f4645b19fe169., fc52dac117cb96590c6edd7ac65df056=testWithMapReduce,t43,1675944182259.fc52dac117cb96590c6edd7ac65df056., 57c7ac6814f18d2541df5c154c377d70=testWithMapReduce,g\xA7\xA7,1675944182259.57c7ac6814f18d2541df5c154c377d70.} 2023-02-09 12:03:06,966 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1675944182259.266cae67ac0efcfe59291a310a667874. 2023-02-09 12:03:06,965 INFO [RS:0;jenkins-hbase4:35455] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,35455,1675944180859 2023-02-09 12:03:06,966 DEBUG [RS:1;jenkins-hbase4:43189] regionserver.HRegionServer(1505): Waiting on 08fa7b5b79fbcbb53ed767bc07fed909, 546fab1946eca3d1b91f4645b19fe169, 57c7ac6814f18d2541df5c154c377d70, e361e7c32d779b70cb86f6640113527e, fc52dac117cb96590c6edd7ac65df056 2023-02-09 12:03:06,966 DEBUG [RS:0;jenkins-hbase4:35455] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x68fc165c to 127.0.0.1:63665 2023-02-09 12:03:06,966 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1675944182259.266cae67ac0efcfe59291a310a667874. after waiting 0 ms 2023-02-09 12:03:06,966 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675944182259.08fa7b5b79fbcbb53ed767bc07fed909. 2023-02-09 12:03:06,966 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1675944182259.266cae67ac0efcfe59291a310a667874. 2023-02-09 12:03:06,966 DEBUG [RS:0;jenkins-hbase4:35455] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 12:03:06,966 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675944182259.08fa7b5b79fbcbb53ed767bc07fed909. after waiting 0 ms 2023-02-09 12:03:06,966 INFO [RS:0;jenkins-hbase4:35455] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-09 12:03:06,966 INFO [RS:0;jenkins-hbase4:35455] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-09 12:03:06,966 INFO [RS:0;jenkins-hbase4:35455] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-09 12:03:06,966 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675944182259.08fa7b5b79fbcbb53ed767bc07fed909. 2023-02-09 12:03:06,966 INFO [RS:0;jenkins-hbase4:35455] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-09 12:03:06,967 INFO [RS:0;jenkins-hbase4:35455] regionserver.HRegionServer(1475): Waiting on 7 regions to close 2023-02-09 12:03:06,968 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-09 12:03:06,968 DEBUG [RS:0;jenkins-hbase4:35455] regionserver.HRegionServer(1479): Online Regions={266cae67ac0efcfe59291a310a667874=testWithMapReduce,d\x84\x84,1675944182259.266cae67ac0efcfe59291a310a667874., e1dd793ac803300b286ce0e5bfa795cc=hbase:namespace,,1675944181599.e1dd793ac803300b286ce0e5bfa795cc., 1588230740=hbase:meta,,1.1588230740, f8b958d29e440ca92af212e18425d242=testWithMapReduce,q\x11\x10,1675944182259.f8b958d29e440ca92af212e18425d242., b9bd8844b5681299737e0a2f071b03f3=testWithMapReduce,aaa,1675944182259.b9bd8844b5681299737e0a2f071b03f3., 24db9ec6cca428b56e442ed464c75a7f=testWithMapReduce,wWV,1675944182259.24db9ec6cca428b56e442ed464c75a7f., 148e52758718776d49fecdf247dc20da=testWithMapReduce,j\xCA\xCA,1675944182259.148e52758718776d49fecdf247dc20da.} 2023-02-09 12:03:06,970 DEBUG [RS:0;jenkins-hbase4:35455] regionserver.HRegionServer(1505): Waiting on 148e52758718776d49fecdf247dc20da, 1588230740, 24db9ec6cca428b56e442ed464c75a7f, 266cae67ac0efcfe59291a310a667874, b9bd8844b5681299737e0a2f071b03f3, e1dd793ac803300b286ce0e5bfa795cc, f8b958d29e440ca92af212e18425d242 2023-02-09 12:03:06,969 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-09 12:03:06,970 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-09 12:03:06,970 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-09 12:03:06,970 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-09 12:03:06,972 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=13.95 KB heapSize=23.05 KB 2023-02-09 12:03:06,978 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/08fa7b5b79fbcbb53ed767bc07fed909/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-09 12:03:06,978 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/266cae67ac0efcfe59291a310a667874/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 12:03:06,979 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675944182259.08fa7b5b79fbcbb53ed767bc07fed909. 2023-02-09 12:03:06,979 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 08fa7b5b79fbcbb53ed767bc07fed909: Waiting for close lock at 1675944186965Running coprocessor pre-close hooks at 1675944186965Disabling compacts and flushes for region at 1675944186965Disabling writes for close at 1675944186966 (+1 ms)Writing region close event to WAL at 1675944186970 (+4 ms)Running coprocessor post-close hooks at 1675944186979 (+9 ms)Closed at 1675944186979 2023-02-09 12:03:06,980 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,,1675944182259.08fa7b5b79fbcbb53ed767bc07fed909. 2023-02-09 12:03:06,980 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing e361e7c32d779b70cb86f6640113527e, disabling compactions & flushes 2023-02-09 12:03:06,980 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1675944182259.e361e7c32d779b70cb86f6640113527e. 2023-02-09 12:03:06,980 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1675944182259.e361e7c32d779b70cb86f6640113527e. 2023-02-09 12:03:06,980 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1675944182259.266cae67ac0efcfe59291a310a667874. 2023-02-09 12:03:06,980 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1675944182259.e361e7c32d779b70cb86f6640113527e. after waiting 0 ms 2023-02-09 12:03:06,981 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 266cae67ac0efcfe59291a310a667874: Waiting for close lock at 1675944186965Running coprocessor pre-close hooks at 1675944186965Disabling compacts and flushes for region at 1675944186965Disabling writes for close at 1675944186966 (+1 ms)Writing region close event to WAL at 1675944186973 (+7 ms)Running coprocessor post-close hooks at 1675944186980 (+7 ms)Closed at 1675944186980 2023-02-09 12:03:06,981 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1675944182259.e361e7c32d779b70cb86f6640113527e. 2023-02-09 12:03:06,981 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,d\x84\x84,1675944182259.266cae67ac0efcfe59291a310a667874. 2023-02-09 12:03:06,981 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing e1dd793ac803300b286ce0e5bfa795cc, disabling compactions & flushes 2023-02-09 12:03:06,981 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675944181599.e1dd793ac803300b286ce0e5bfa795cc. 2023-02-09 12:03:06,981 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675944181599.e1dd793ac803300b286ce0e5bfa795cc. 2023-02-09 12:03:06,981 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675944181599.e1dd793ac803300b286ce0e5bfa795cc. after waiting 0 ms 2023-02-09 12:03:06,981 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675944181599.e1dd793ac803300b286ce0e5bfa795cc. 2023-02-09 12:03:06,981 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing e1dd793ac803300b286ce0e5bfa795cc 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-09 12:03:06,987 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=13.76 KB at sequenceid=32 (bloomFilter=false), to=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/hbase/meta/1588230740/.tmp/info/9eecafe5a78641fbb40a005c71eb9670 2023-02-09 12:03:06,987 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/e361e7c32d779b70cb86f6640113527e/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-09 12:03:06,992 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-09 12:03:06,992 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-09 12:03:06,996 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1675944182259.e361e7c32d779b70cb86f6640113527e. 2023-02-09 12:03:06,996 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for e361e7c32d779b70cb86f6640113527e: Waiting for close lock at 1675944186980Running coprocessor pre-close hooks at 1675944186980Disabling compacts and flushes for region at 1675944186980Disabling writes for close at 1675944186981 (+1 ms)Writing region close event to WAL at 1675944186984 (+3 ms)Running coprocessor post-close hooks at 1675944186989 (+5 ms)Closed at 1675944186996 (+7 ms) 2023-02-09 12:03:06,996 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,zz{,1675944182259.e361e7c32d779b70cb86f6640113527e. 2023-02-09 12:03:06,996 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 546fab1946eca3d1b91f4645b19fe169, disabling compactions & flushes 2023-02-09 12:03:06,996 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1675944182259.546fab1946eca3d1b91f4645b19fe169. 2023-02-09 12:03:06,996 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1675944182259.546fab1946eca3d1b91f4645b19fe169. 2023-02-09 12:03:06,996 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1675944182259.546fab1946eca3d1b91f4645b19fe169. after waiting 0 ms 2023-02-09 12:03:06,996 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1675944182259.546fab1946eca3d1b91f4645b19fe169. 2023-02-09 12:03:06,998 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/hbase/namespace/e1dd793ac803300b286ce0e5bfa795cc/.tmp/info/440c08506b42419aa3d0a1865672df49 2023-02-09 12:03:07,008 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/546fab1946eca3d1b91f4645b19fe169/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 12:03:07,010 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1675944182259.546fab1946eca3d1b91f4645b19fe169. 2023-02-09 12:03:07,010 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 546fab1946eca3d1b91f4645b19fe169: Waiting for close lock at 1675944186996Running coprocessor pre-close hooks at 1675944186996Disabling compacts and flushes for region at 1675944186996Disabling writes for close at 1675944186996Writing region close event to WAL at 1675944187005 (+9 ms)Running coprocessor post-close hooks at 1675944187009 (+4 ms)Closed at 1675944187010 (+1 ms) 2023-02-09 12:03:07,010 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,m\xED\xED,1675944182259.546fab1946eca3d1b91f4645b19fe169. 2023-02-09 12:03:07,010 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing fc52dac117cb96590c6edd7ac65df056, disabling compactions & flushes 2023-02-09 12:03:07,010 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1675944182259.fc52dac117cb96590c6edd7ac65df056. 2023-02-09 12:03:07,010 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1675944182259.fc52dac117cb96590c6edd7ac65df056. 2023-02-09 12:03:07,010 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1675944182259.fc52dac117cb96590c6edd7ac65df056. after waiting 0 ms 2023-02-09 12:03:07,010 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1675944182259.fc52dac117cb96590c6edd7ac65df056. 2023-02-09 12:03:07,014 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=192 B at sequenceid=32 (bloomFilter=false), to=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/hbase/meta/1588230740/.tmp/table/59d5b9704dbf4b9288e8fd7c24cf46ca 2023-02-09 12:03:07,014 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/hbase/namespace/e1dd793ac803300b286ce0e5bfa795cc/.tmp/info/440c08506b42419aa3d0a1865672df49 as hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/hbase/namespace/e1dd793ac803300b286ce0e5bfa795cc/info/440c08506b42419aa3d0a1865672df49 2023-02-09 12:03:07,021 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/hbase/namespace/e1dd793ac803300b286ce0e5bfa795cc/info/440c08506b42419aa3d0a1865672df49, entries=2, sequenceid=6, filesize=4.8 K 2023-02-09 12:03:07,021 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/hbase/meta/1588230740/.tmp/info/9eecafe5a78641fbb40a005c71eb9670 as hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/hbase/meta/1588230740/info/9eecafe5a78641fbb40a005c71eb9670 2023-02-09 12:03:07,026 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for e1dd793ac803300b286ce0e5bfa795cc in 45ms, sequenceid=6, compaction requested=false 2023-02-09 12:03:07,026 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-09 12:03:07,034 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/hbase/meta/1588230740/info/9eecafe5a78641fbb40a005c71eb9670, entries=110, sequenceid=32, filesize=18.7 K 2023-02-09 12:03:07,034 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/fc52dac117cb96590c6edd7ac65df056/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 12:03:07,035 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1675944182259.fc52dac117cb96590c6edd7ac65df056. 2023-02-09 12:03:07,035 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for fc52dac117cb96590c6edd7ac65df056: Waiting for close lock at 1675944187010Running coprocessor pre-close hooks at 1675944187010Disabling compacts and flushes for region at 1675944187010Disabling writes for close at 1675944187010Writing region close event to WAL at 1675944187028 (+18 ms)Running coprocessor post-close hooks at 1675944187034 (+6 ms)Closed at 1675944187035 (+1 ms) 2023-02-09 12:03:07,035 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,t43,1675944182259.fc52dac117cb96590c6edd7ac65df056. 2023-02-09 12:03:07,036 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/hbase/meta/1588230740/.tmp/table/59d5b9704dbf4b9288e8fd7c24cf46ca as hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/hbase/meta/1588230740/table/59d5b9704dbf4b9288e8fd7c24cf46ca 2023-02-09 12:03:07,036 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 57c7ac6814f18d2541df5c154c377d70, disabling compactions & flushes 2023-02-09 12:03:07,036 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1675944182259.57c7ac6814f18d2541df5c154c377d70. 2023-02-09 12:03:07,036 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1675944182259.57c7ac6814f18d2541df5c154c377d70. 2023-02-09 12:03:07,036 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/hbase/namespace/e1dd793ac803300b286ce0e5bfa795cc/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-09 12:03:07,036 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1675944182259.57c7ac6814f18d2541df5c154c377d70. after waiting 0 ms 2023-02-09 12:03:07,036 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1675944182259.57c7ac6814f18d2541df5c154c377d70. 2023-02-09 12:03:07,037 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675944181599.e1dd793ac803300b286ce0e5bfa795cc. 2023-02-09 12:03:07,038 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for e1dd793ac803300b286ce0e5bfa795cc: Waiting for close lock at 1675944186981Running coprocessor pre-close hooks at 1675944186981Disabling compacts and flushes for region at 1675944186981Disabling writes for close at 1675944186981Obtaining lock to block concurrent updates at 1675944186981Preparing flush snapshotting stores in e1dd793ac803300b286ce0e5bfa795cc at 1675944186981Finished memstore snapshotting hbase:namespace,,1675944181599.e1dd793ac803300b286ce0e5bfa795cc., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1675944186981Flushing stores of hbase:namespace,,1675944181599.e1dd793ac803300b286ce0e5bfa795cc. at 1675944186982 (+1 ms)Flushing e1dd793ac803300b286ce0e5bfa795cc/info: creating writer at 1675944186982Flushing e1dd793ac803300b286ce0e5bfa795cc/info: appending metadata at 1675944186984 (+2 ms)Flushing e1dd793ac803300b286ce0e5bfa795cc/info: closing flushed file at 1675944186984Flushing e1dd793ac803300b286ce0e5bfa795cc/info: reopening flushed file at 1675944187016 (+32 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for e1dd793ac803300b286ce0e5bfa795cc in 45ms, sequenceid=6, compaction requested=false at 1675944187026 (+10 ms)Writing region close event to WAL at 1675944187031 (+5 ms)Running coprocessor post-close hooks at 1675944187037 (+6 ms)Closed at 1675944187037 2023-02-09 12:03:07,042 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1675944181599.e1dd793ac803300b286ce0e5bfa795cc. 2023-02-09 12:03:07,043 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing f8b958d29e440ca92af212e18425d242, disabling compactions & flushes 2023-02-09 12:03:07,043 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1675944182259.f8b958d29e440ca92af212e18425d242. 2023-02-09 12:03:07,043 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1675944182259.f8b958d29e440ca92af212e18425d242. 2023-02-09 12:03:07,043 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1675944182259.f8b958d29e440ca92af212e18425d242. after waiting 0 ms 2023-02-09 12:03:07,043 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1675944182259.f8b958d29e440ca92af212e18425d242. 2023-02-09 12:03:07,051 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/hbase/meta/1588230740/table/59d5b9704dbf4b9288e8fd7c24cf46ca, entries=4, sequenceid=32, filesize=4.8 K 2023-02-09 12:03:07,052 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~13.95 KB/14280, heapSize ~22.77 KB/23312, currentSize=0 B/0 for 1588230740 in 81ms, sequenceid=32, compaction requested=false 2023-02-09 12:03:07,052 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-09 12:03:07,054 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/57c7ac6814f18d2541df5c154c377d70/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 12:03:07,056 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1675944182259.57c7ac6814f18d2541df5c154c377d70. 2023-02-09 12:03:07,056 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 57c7ac6814f18d2541df5c154c377d70: Waiting for close lock at 1675944187036Running coprocessor pre-close hooks at 1675944187036Disabling compacts and flushes for region at 1675944187036Disabling writes for close at 1675944187036Writing region close event to WAL at 1675944187045 (+9 ms)Running coprocessor post-close hooks at 1675944187055 (+10 ms)Closed at 1675944187056 (+1 ms) 2023-02-09 12:03:07,056 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,g\xA7\xA7,1675944182259.57c7ac6814f18d2541df5c154c377d70. 2023-02-09 12:03:07,056 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/f8b958d29e440ca92af212e18425d242/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 12:03:07,059 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1675944182259.f8b958d29e440ca92af212e18425d242. 2023-02-09 12:03:07,059 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for f8b958d29e440ca92af212e18425d242: Waiting for close lock at 1675944187042Running coprocessor pre-close hooks at 1675944187043 (+1 ms)Disabling compacts and flushes for region at 1675944187043Disabling writes for close at 1675944187043Writing region close event to WAL at 1675944187048 (+5 ms)Running coprocessor post-close hooks at 1675944187057 (+9 ms)Closed at 1675944187059 (+2 ms) 2023-02-09 12:03:07,060 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,q\x11\x10,1675944182259.f8b958d29e440ca92af212e18425d242. 2023-02-09 12:03:07,060 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing b9bd8844b5681299737e0a2f071b03f3, disabling compactions & flushes 2023-02-09 12:03:07,060 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1675944182259.b9bd8844b5681299737e0a2f071b03f3. 2023-02-09 12:03:07,060 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1675944182259.b9bd8844b5681299737e0a2f071b03f3. 2023-02-09 12:03:07,060 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1675944182259.b9bd8844b5681299737e0a2f071b03f3. after waiting 0 ms 2023-02-09 12:03:07,060 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1675944182259.b9bd8844b5681299737e0a2f071b03f3. 2023-02-09 12:03:07,065 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/hbase/meta/1588230740/recovered.edits/35.seqid, newMaxSeqId=35, maxSeqId=1 2023-02-09 12:03:07,065 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-09 12:03:07,066 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-09 12:03:07,066 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675944186968Running coprocessor pre-close hooks at 1675944186968Disabling compacts and flushes for region at 1675944186968Disabling writes for close at 1675944186970 (+2 ms)Obtaining lock to block concurrent updates at 1675944186972 (+2 ms)Preparing flush snapshotting stores in 1588230740 at 1675944186972Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=14280, getHeapSize=23552, getOffHeapSize=0, getCellsCount=114 at 1675944186973 (+1 ms)Flushing stores of hbase:meta,,1.1588230740 at 1675944186973Flushing 1588230740/info: creating writer at 1675944186973Flushing 1588230740/info: appending metadata at 1675944186976 (+3 ms)Flushing 1588230740/info: closing flushed file at 1675944186976Flushing 1588230740/table: creating writer at 1675944186992 (+16 ms)Flushing 1588230740/table: appending metadata at 1675944186997 (+5 ms)Flushing 1588230740/table: closing flushed file at 1675944186997Flushing 1588230740/info: reopening flushed file at 1675944187022 (+25 ms)Flushing 1588230740/table: reopening flushed file at 1675944187036 (+14 ms)Finished flush of dataSize ~13.95 KB/14280, heapSize ~22.77 KB/23312, currentSize=0 B/0 for 1588230740 in 81ms, sequenceid=32, compaction requested=false at 1675944187052 (+16 ms)Writing region close event to WAL at 1675944187054 (+2 ms)Running coprocessor post-close hooks at 1675944187065 (+11 ms)Closed at 1675944187066 (+1 ms) 2023-02-09 12:03:07,066 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-09 12:03:07,068 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/b9bd8844b5681299737e0a2f071b03f3/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 12:03:07,068 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1675944182259.b9bd8844b5681299737e0a2f071b03f3. 2023-02-09 12:03:07,068 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for b9bd8844b5681299737e0a2f071b03f3: Waiting for close lock at 1675944187060Running coprocessor pre-close hooks at 1675944187060Disabling compacts and flushes for region at 1675944187060Disabling writes for close at 1675944187060Writing region close event to WAL at 1675944187065 (+5 ms)Running coprocessor post-close hooks at 1675944187068 (+3 ms)Closed at 1675944187068 2023-02-09 12:03:07,069 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,aaa,1675944182259.b9bd8844b5681299737e0a2f071b03f3. 2023-02-09 12:03:07,069 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 24db9ec6cca428b56e442ed464c75a7f, disabling compactions & flushes 2023-02-09 12:03:07,069 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1675944182259.24db9ec6cca428b56e442ed464c75a7f. 2023-02-09 12:03:07,069 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1675944182259.24db9ec6cca428b56e442ed464c75a7f. 2023-02-09 12:03:07,069 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1675944182259.24db9ec6cca428b56e442ed464c75a7f. after waiting 0 ms 2023-02-09 12:03:07,069 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1675944182259.24db9ec6cca428b56e442ed464c75a7f. 2023-02-09 12:03:07,073 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/24db9ec6cca428b56e442ed464c75a7f/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 12:03:07,074 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1675944182259.24db9ec6cca428b56e442ed464c75a7f. 2023-02-09 12:03:07,074 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 24db9ec6cca428b56e442ed464c75a7f: Waiting for close lock at 1675944187069Running coprocessor pre-close hooks at 1675944187069Disabling compacts and flushes for region at 1675944187069Disabling writes for close at 1675944187069Writing region close event to WAL at 1675944187070 (+1 ms)Running coprocessor post-close hooks at 1675944187074 (+4 ms)Closed at 1675944187074 2023-02-09 12:03:07,074 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,wWV,1675944182259.24db9ec6cca428b56e442ed464c75a7f. 2023-02-09 12:03:07,074 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 148e52758718776d49fecdf247dc20da, disabling compactions & flushes 2023-02-09 12:03:07,074 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1675944182259.148e52758718776d49fecdf247dc20da. 2023-02-09 12:03:07,074 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1675944182259.148e52758718776d49fecdf247dc20da. 2023-02-09 12:03:07,074 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1675944182259.148e52758718776d49fecdf247dc20da. after waiting 0 ms 2023-02-09 12:03:07,074 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1675944182259.148e52758718776d49fecdf247dc20da. 2023-02-09 12:03:07,079 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/data/default/testWithMapReduce/148e52758718776d49fecdf247dc20da/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 12:03:07,080 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1675944182259.148e52758718776d49fecdf247dc20da. 2023-02-09 12:03:07,080 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 148e52758718776d49fecdf247dc20da: Waiting for close lock at 1675944187074Running coprocessor pre-close hooks at 1675944187074Disabling compacts and flushes for region at 1675944187074Disabling writes for close at 1675944187074Writing region close event to WAL at 1675944187077 (+3 ms)Running coprocessor post-close hooks at 1675944187080 (+3 ms)Closed at 1675944187080 2023-02-09 12:03:07,080 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,j\xCA\xCA,1675944182259.148e52758718776d49fecdf247dc20da. 2023-02-09 12:03:07,166 INFO [RS:1;jenkins-hbase4:43189] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,43189,1675944180899; all regions closed. 2023-02-09 12:03:07,170 INFO [RS:0;jenkins-hbase4:35455] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,35455,1675944180859; all regions closed. 2023-02-09 12:03:07,173 DEBUG [RS:1;jenkins-hbase4:43189] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/oldWALs 2023-02-09 12:03:07,173 INFO [RS:1;jenkins-hbase4:43189] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43189%2C1675944180899:(num 1675944182255) 2023-02-09 12:03:07,173 DEBUG [RS:1;jenkins-hbase4:43189] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 12:03:07,173 INFO [RS:1;jenkins-hbase4:43189] regionserver.LeaseManager(133): Closed leases 2023-02-09 12:03:07,173 INFO [RS:1;jenkins-hbase4:43189] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-09 12:03:07,174 INFO [RS:1;jenkins-hbase4:43189] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-09 12:03:07,174 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 12:03:07,174 INFO [RS:1;jenkins-hbase4:43189] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-09 12:03:07,174 INFO [RS:1;jenkins-hbase4:43189] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-09 12:03:07,174 INFO [RS:1;jenkins-hbase4:43189] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43189 2023-02-09 12:03:07,178 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): regionserver:35455-0x10038f6a5e10001, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43189,1675944180899 2023-02-09 12:03:07,178 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): regionserver:43189-0x10038f6a5e10002, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43189,1675944180899 2023-02-09 12:03:07,178 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 12:03:07,178 ERROR [Listener at localhost/36513-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1b1875e6 rejected from java.util.concurrent.ThreadPoolExecutor@1f27e25d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 12:03:07,178 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): regionserver:35455-0x10038f6a5e10001, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 12:03:07,179 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): regionserver:43189-0x10038f6a5e10002, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 12:03:07,179 ERROR [Listener at localhost/36513-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@335a1355 rejected from java.util.concurrent.ThreadPoolExecutor@1f27e25d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 12:03:07,179 DEBUG [RS:0;jenkins-hbase4:35455] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/oldWALs 2023-02-09 12:03:07,179 INFO [RS:0;jenkins-hbase4:35455] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35455%2C1675944180859.meta:.meta(num 1675944181514) 2023-02-09 12:03:07,182 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,43189,1675944180899] 2023-02-09 12:03:07,182 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,43189,1675944180899; numProcessing=1 2023-02-09 12:03:07,183 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,43189,1675944180899 already deleted, retry=false 2023-02-09 12:03:07,183 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,43189,1675944180899 expired; onlineServers=1 2023-02-09 12:03:07,185 DEBUG [RS:0;jenkins-hbase4:35455] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/oldWALs 2023-02-09 12:03:07,185 INFO [RS:0;jenkins-hbase4:35455] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35455%2C1675944180859:(num 1675944181967) 2023-02-09 12:03:07,185 DEBUG [RS:0;jenkins-hbase4:35455] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 12:03:07,185 INFO [RS:0;jenkins-hbase4:35455] regionserver.LeaseManager(133): Closed leases 2023-02-09 12:03:07,186 INFO [RS:0;jenkins-hbase4:35455] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-09 12:03:07,186 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 12:03:07,187 INFO [RS:0;jenkins-hbase4:35455] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35455 2023-02-09 12:03:07,190 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 12:03:07,190 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): regionserver:35455-0x10038f6a5e10001, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35455,1675944180859 2023-02-09 12:03:07,190 ERROR [Listener at localhost/36513-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3e2dc8d2 rejected from java.util.concurrent.ThreadPoolExecutor@3a124bcf[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 12:03:07,191 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,35455,1675944180859] 2023-02-09 12:03:07,191 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,35455,1675944180859; numProcessing=2 2023-02-09 12:03:07,192 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,35455,1675944180859 already deleted, retry=false 2023-02-09 12:03:07,192 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,35455,1675944180859 expired; onlineServers=0 2023-02-09 12:03:07,192 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,37615,1675944180795' ***** 2023-02-09 12:03:07,192 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-09 12:03:07,193 DEBUG [M:0;jenkins-hbase4:37615] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3cbc5f0a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 12:03:07,194 INFO [M:0;jenkins-hbase4:37615] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,37615,1675944180795 2023-02-09 12:03:07,194 INFO [M:0;jenkins-hbase4:37615] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,37615,1675944180795; all regions closed. 2023-02-09 12:03:07,194 DEBUG [M:0;jenkins-hbase4:37615] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 12:03:07,194 DEBUG [M:0;jenkins-hbase4:37615] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-09 12:03:07,194 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-09 12:03:07,194 DEBUG [M:0;jenkins-hbase4:37615] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-09 12:03:07,194 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675944181122] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675944181122,5,FailOnTimeoutGroup] 2023-02-09 12:03:07,194 INFO [M:0;jenkins-hbase4:37615] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-09 12:03:07,194 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675944181122] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675944181122,5,FailOnTimeoutGroup] 2023-02-09 12:03:07,195 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-09 12:03:07,195 INFO [M:0;jenkins-hbase4:37615] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-09 12:03:07,195 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 12:03:07,196 INFO [M:0;jenkins-hbase4:37615] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-09 12:03:07,196 DEBUG [M:0;jenkins-hbase4:37615] master.HMaster(1502): Stopping service threads 2023-02-09 12:03:07,196 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 12:03:07,196 INFO [M:0;jenkins-hbase4:37615] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-09 12:03:07,196 ERROR [M:0;jenkins-hbase4:37615] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-09 12:03:07,196 INFO [M:0;jenkins-hbase4:37615] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-09 12:03:07,197 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-09 12:03:07,197 DEBUG [M:0;jenkins-hbase4:37615] zookeeper.ZKUtil(398): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-09 12:03:07,197 WARN [M:0;jenkins-hbase4:37615] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-09 12:03:07,197 INFO [M:0;jenkins-hbase4:37615] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-09 12:03:07,197 INFO [M:0;jenkins-hbase4:37615] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-09 12:03:07,198 DEBUG [M:0;jenkins-hbase4:37615] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-09 12:03:07,198 INFO [M:0;jenkins-hbase4:37615] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 12:03:07,198 DEBUG [M:0;jenkins-hbase4:37615] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 12:03:07,198 DEBUG [M:0;jenkins-hbase4:37615] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-09 12:03:07,198 DEBUG [M:0;jenkins-hbase4:37615] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 12:03:07,198 INFO [M:0;jenkins-hbase4:37615] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=100.95 KB heapSize=120.63 KB 2023-02-09 12:03:07,207 INFO [M:0;jenkins-hbase4:37615] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=100.95 KB at sequenceid=218 (bloomFilter=true), to=hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/87786785dd5e47869896c6712dd38bc2 2023-02-09 12:03:07,213 DEBUG [M:0;jenkins-hbase4:37615] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/87786785dd5e47869896c6712dd38bc2 as hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/87786785dd5e47869896c6712dd38bc2 2023-02-09 12:03:07,218 INFO [M:0;jenkins-hbase4:37615] regionserver.HStore(1080): Added hdfs://localhost:35677/user/jenkins/test-data/4a5008e9-041f-c845-ef6f-72d2f6acdab6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/87786785dd5e47869896c6712dd38bc2, entries=31, sequenceid=218, filesize=9.0 K 2023-02-09 12:03:07,219 INFO [M:0;jenkins-hbase4:37615] regionserver.HRegion(2947): Finished flush of dataSize ~100.95 KB/103374, heapSize ~120.62 KB/123512, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 21ms, sequenceid=218, compaction requested=false 2023-02-09 12:03:07,220 INFO [M:0;jenkins-hbase4:37615] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 12:03:07,220 DEBUG [M:0;jenkins-hbase4:37615] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675944187198Disabling compacts and flushes for region at 1675944187198Disabling writes for close at 1675944187198Obtaining lock to block concurrent updates at 1675944187198Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1675944187198Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=103374, getHeapSize=123512, getOffHeapSize=0, getCellsCount=263 at 1675944187198Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1675944187199 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1675944187199Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1675944187202 (+3 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1675944187202Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1675944187214 (+12 ms)Finished flush of dataSize ~100.95 KB/103374, heapSize ~120.62 KB/123512, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 21ms, sequenceid=218, compaction requested=false at 1675944187219 (+5 ms)Writing region close event to WAL at 1675944187220 (+1 ms)Closed at 1675944187220 2023-02-09 12:03:07,223 INFO [M:0;jenkins-hbase4:37615] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-09 12:03:07,223 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 12:03:07,224 INFO [M:0;jenkins-hbase4:37615] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37615 2023-02-09 12:03:07,229 DEBUG [M:0;jenkins-hbase4:37615] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,37615,1675944180795 already deleted, retry=false 2023-02-09 12:03:07,461 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 12:03:07,461 INFO [M:0;jenkins-hbase4:37615] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,37615,1675944180795; zookeeper connection closed. 2023-02-09 12:03:07,461 ERROR [Listener at localhost/36513-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@413cc837 rejected from java.util.concurrent.ThreadPoolExecutor@450344c8[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 12:03:07,462 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): master:37615-0x10038f6a5e10000, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 12:03:07,462 ERROR [Listener at localhost/36513-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1691ab5b rejected from java.util.concurrent.ThreadPoolExecutor@450344c8[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 12:03:07,561 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): regionserver:35455-0x10038f6a5e10001, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 12:03:07,561 INFO [RS:0;jenkins-hbase4:35455] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,35455,1675944180859; zookeeper connection closed. 2023-02-09 12:03:07,561 ERROR [Listener at localhost/36513-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1e1efa6c rejected from java.util.concurrent.ThreadPoolExecutor@3a124bcf[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 12:03:07,561 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@606cb0b1] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@606cb0b1 2023-02-09 12:03:07,561 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): regionserver:35455-0x10038f6a5e10001, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 12:03:07,562 ERROR [Listener at localhost/36513-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@66c1bc1d rejected from java.util.concurrent.ThreadPoolExecutor@3a124bcf[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 12:03:07,661 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): regionserver:43189-0x10038f6a5e10002, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 12:03:07,661 INFO [RS:1;jenkins-hbase4:43189] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,43189,1675944180899; zookeeper connection closed. 2023-02-09 12:03:07,662 ERROR [Listener at localhost/36513-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4b20d5bc rejected from java.util.concurrent.ThreadPoolExecutor@1f27e25d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 12:03:07,662 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@744e22c1] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@744e22c1 2023-02-09 12:03:07,662 DEBUG [Listener at localhost/36513-EventThread] zookeeper.ZKWatcher(600): regionserver:43189-0x10038f6a5e10002, quorum=127.0.0.1:63665, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 12:03:07,662 ERROR [Listener at localhost/36513-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5929fc3d rejected from java.util.concurrent.ThreadPoolExecutor@1f27e25d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 12:03:07,662 INFO [Listener at localhost/36513] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-09 12:03:07,749 DEBUG [Listener at localhost/36513] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4f4a1677-b9c2-11c9-6e72-f44b3a4b8222/hadoop-8456544585831924068.jar 2023-02-09 12:03:07,753 INFO [Listener at localhost/36513] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1675944183584 type: FLUSH version: 2 ttl: 0 2023-02-09 12:03:07,754 DEBUG [Listener at localhost/36513] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:35677/user/jenkins/test-data/070b1f80-84b1-c9f1-7e89-c401c182e07a/testWithMapReduceAndOfflineHBaseMultiRegion/8aecd276-a74f-4ec3-b6ee-436ca6593d68/data/default/testWithMapReduce 2023-02-09 12:03:07,754 INFO [Listener at localhost/36513] snapshot.RestoreSnapshotHelper(239): region to add: 266cae67ac0efcfe59291a310a667874 2023-02-09 12:03:07,754 INFO [Listener at localhost/36513] snapshot.RestoreSnapshotHelper(239): region to add: 08fa7b5b79fbcbb53ed767bc07fed909 2023-02-09 12:03:07,754 INFO [Listener at localhost/36513] snapshot.RestoreSnapshotHelper(239): region to add: e361e7c32d779b70cb86f6640113527e 2023-02-09 12:03:07,754 INFO [Listener at localhost/36513] snapshot.RestoreSnapshotHelper(239): region to add: 546fab1946eca3d1b91f4645b19fe169 2023-02-09 12:03:07,754 INFO [Listener at localhost/36513] snapshot.RestoreSnapshotHelper(239): region to add: fc52dac117cb96590c6edd7ac65df056 2023-02-09 12:03:07,754 INFO [Listener at localhost/36513] snapshot.RestoreSnapshotHelper(239): region to add: 57c7ac6814f18d2541df5c154c377d70 2023-02-09 12:03:07,754 INFO [Listener at localhost/36513] snapshot.RestoreSnapshotHelper(239): region to add: 24db9ec6cca428b56e442ed464c75a7f 2023-02-09 12:03:07,754 INFO [Listener at localhost/36513] snapshot.RestoreSnapshotHelper(239): region to add: f8b958d29e440ca92af212e18425d242 2023-02-09 12:03:07,755 INFO [Listener at localhost/36513] snapshot.RestoreSnapshotHelper(239): region to add: b9bd8844b5681299737e0a2f071b03f3 2023-02-09 12:03:07,755 INFO [Listener at localhost/36513] snapshot.RestoreSnapshotHelper(239): region to add: 148e52758718776d49fecdf247dc20da 2023-02-09 12:03:07,755 INFO [Listener at localhost/36513] snapshot.RestoreSnapshotHelper(585): clone region=266cae67ac0efcfe59291a310a667874 as 266cae67ac0efcfe59291a310a667874 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:07,755 INFO [Listener at localhost/36513] snapshot.RestoreSnapshotHelper(585): clone region=08fa7b5b79fbcbb53ed767bc07fed909 as 08fa7b5b79fbcbb53ed767bc07fed909 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:07,755 INFO [Listener at localhost/36513] snapshot.RestoreSnapshotHelper(585): clone region=e361e7c32d779b70cb86f6640113527e as e361e7c32d779b70cb86f6640113527e in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:07,755 INFO [Listener at localhost/36513] snapshot.RestoreSnapshotHelper(585): clone region=546fab1946eca3d1b91f4645b19fe169 as 546fab1946eca3d1b91f4645b19fe169 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:07,755 INFO [Listener at localhost/36513] snapshot.RestoreSnapshotHelper(585): clone region=fc52dac117cb96590c6edd7ac65df056 as fc52dac117cb96590c6edd7ac65df056 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:07,755 INFO [Listener at localhost/36513] snapshot.RestoreSnapshotHelper(585): clone region=57c7ac6814f18d2541df5c154c377d70 as 57c7ac6814f18d2541df5c154c377d70 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:07,755 INFO [Listener at localhost/36513] snapshot.RestoreSnapshotHelper(585): clone region=24db9ec6cca428b56e442ed464c75a7f as 24db9ec6cca428b56e442ed464c75a7f in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:07,755 INFO [Listener at localhost/36513] snapshot.RestoreSnapshotHelper(585): clone region=f8b958d29e440ca92af212e18425d242 as f8b958d29e440ca92af212e18425d242 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:07,755 INFO [Listener at localhost/36513] snapshot.RestoreSnapshotHelper(585): clone region=b9bd8844b5681299737e0a2f071b03f3 as b9bd8844b5681299737e0a2f071b03f3 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:07,755 INFO [Listener at localhost/36513] snapshot.RestoreSnapshotHelper(585): clone region=148e52758718776d49fecdf247dc20da as 148e52758718776d49fecdf247dc20da in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 12:03:07,756 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 266cae67ac0efcfe59291a310a667874, NAME => 'testWithMapReduce,d\x84\x84,1675944182259.266cae67ac0efcfe59291a310a667874.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35677/user/jenkins/test-data/070b1f80-84b1-c9f1-7e89-c401c182e07a/testWithMapReduceAndOfflineHBaseMultiRegion/8aecd276-a74f-4ec3-b6ee-436ca6593d68 2023-02-09 12:03:07,759 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 08fa7b5b79fbcbb53ed767bc07fed909, NAME => 'testWithMapReduce,,1675944182259.08fa7b5b79fbcbb53ed767bc07fed909.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35677/user/jenkins/test-data/070b1f80-84b1-c9f1-7e89-c401c182e07a/testWithMapReduceAndOfflineHBaseMultiRegion/8aecd276-a74f-4ec3-b6ee-436ca6593d68 2023-02-09 12:03:07,759 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => e361e7c32d779b70cb86f6640113527e, NAME => 'testWithMapReduce,zz{,1675944182259.e361e7c32d779b70cb86f6640113527e.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35677/user/jenkins/test-data/070b1f80-84b1-c9f1-7e89-c401c182e07a/testWithMapReduceAndOfflineHBaseMultiRegion/8aecd276-a74f-4ec3-b6ee-436ca6593d68 2023-02-09 12:03:07,760 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 546fab1946eca3d1b91f4645b19fe169, NAME => 'testWithMapReduce,m\xED\xED,1675944182259.546fab1946eca3d1b91f4645b19fe169.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35677/user/jenkins/test-data/070b1f80-84b1-c9f1-7e89-c401c182e07a/testWithMapReduceAndOfflineHBaseMultiRegion/8aecd276-a74f-4ec3-b6ee-436ca6593d68 2023-02-09 12:03:07,760 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => fc52dac117cb96590c6edd7ac65df056, NAME => 'testWithMapReduce,t43,1675944182259.fc52dac117cb96590c6edd7ac65df056.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35677/user/jenkins/test-data/070b1f80-84b1-c9f1-7e89-c401c182e07a/testWithMapReduceAndOfflineHBaseMultiRegion/8aecd276-a74f-4ec3-b6ee-436ca6593d68 2023-02-09 12:03:07,761 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 57c7ac6814f18d2541df5c154c377d70, NAME => 'testWithMapReduce,g\xA7\xA7,1675944182259.57c7ac6814f18d2541df5c154c377d70.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35677/user/jenkins/test-data/070b1f80-84b1-c9f1-7e89-c401c182e07a/testWithMapReduceAndOfflineHBaseMultiRegion/8aecd276-a74f-4ec3-b6ee-436ca6593d68 2023-02-09 12:03:07,763 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 24db9ec6cca428b56e442ed464c75a7f, NAME => 'testWithMapReduce,wWV,1675944182259.24db9ec6cca428b56e442ed464c75a7f.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35677/user/jenkins/test-data/070b1f80-84b1-c9f1-7e89-c401c182e07a/testWithMapReduceAndOfflineHBaseMultiRegion/8aecd276-a74f-4ec3-b6ee-436ca6593d68 2023-02-09 12:03:07,764 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => f8b958d29e440ca92af212e18425d242, NAME => 'testWithMapReduce,q\x11\x10,1675944182259.f8b958d29e440ca92af212e18425d242.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35677/user/jenkins/test-data/070b1f80-84b1-c9f1-7e89-c401c182e07a/testWithMapReduceAndOfflineHBaseMultiRegion/8aecd276-a74f-4ec3-b6ee-436ca6593d68 2023-02-09 12:03:07,784 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1675944182259.266cae67ac0efcfe59291a310a667874.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:07,784 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a0f8d136afa24c7ea95f8333ec8d6392 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-09 12:03:07,797 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1675944182259.546fab1946eca3d1b91f4645b19fe169.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:07,797 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e135ace1984d4bb49f6c24fa4b95ea2f from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-09 12:03:07,801 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 75248938aef14ef7a960142f0b49797e from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-09 12:03:07,810 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink fab535d80a0e4a058e6e8559d4bf6705 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-09 12:03:07,810 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 266cae67ac0efcfe59291a310a667874, disabling compactions & flushes 2023-02-09 12:03:07,810 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1675944182259.266cae67ac0efcfe59291a310a667874. 2023-02-09 12:03:07,810 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1675944182259.fc52dac117cb96590c6edd7ac65df056.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:07,810 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1675944182259.266cae67ac0efcfe59291a310a667874. 2023-02-09 12:03:07,810 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink ee422794f0314247ae6e9d11d6af55ea from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-09 12:03:07,810 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1675944182259.266cae67ac0efcfe59291a310a667874. after waiting 0 ms 2023-02-09 12:03:07,810 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1675944182259.266cae67ac0efcfe59291a310a667874. 2023-02-09 12:03:07,810 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1675944182259.266cae67ac0efcfe59291a310a667874. 2023-02-09 12:03:07,810 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 266cae67ac0efcfe59291a310a667874: Waiting for close lock at 1675944187810Disabling compacts and flushes for region at 1675944187810Disabling writes for close at 1675944187810Writing region close event to WAL at 1675944187810Closed at 1675944187810 2023-02-09 12:03:07,811 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => b9bd8844b5681299737e0a2f071b03f3, NAME => 'testWithMapReduce,aaa,1675944182259.b9bd8844b5681299737e0a2f071b03f3.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35677/user/jenkins/test-data/070b1f80-84b1-c9f1-7e89-c401c182e07a/testWithMapReduceAndOfflineHBaseMultiRegion/8aecd276-a74f-4ec3-b6ee-436ca6593d68 2023-02-09 12:03:07,812 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675944182259.08fa7b5b79fbcbb53ed767bc07fed909.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:07,812 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 08fa7b5b79fbcbb53ed767bc07fed909, disabling compactions & flushes 2023-02-09 12:03:07,812 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675944182259.08fa7b5b79fbcbb53ed767bc07fed909. 2023-02-09 12:03:07,812 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675944182259.08fa7b5b79fbcbb53ed767bc07fed909. 2023-02-09 12:03:07,813 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675944182259.08fa7b5b79fbcbb53ed767bc07fed909. after waiting 0 ms 2023-02-09 12:03:07,813 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675944182259.08fa7b5b79fbcbb53ed767bc07fed909. 2023-02-09 12:03:07,813 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,,1675944182259.08fa7b5b79fbcbb53ed767bc07fed909. 2023-02-09 12:03:07,813 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 08fa7b5b79fbcbb53ed767bc07fed909: Waiting for close lock at 1675944187812Disabling compacts and flushes for region at 1675944187812Disabling writes for close at 1675944187813 (+1 ms)Writing region close event to WAL at 1675944187813Closed at 1675944187813 2023-02-09 12:03:07,813 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 148e52758718776d49fecdf247dc20da, NAME => 'testWithMapReduce,j\xCA\xCA,1675944182259.148e52758718776d49fecdf247dc20da.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35677/user/jenkins/test-data/070b1f80-84b1-c9f1-7e89-c401c182e07a/testWithMapReduceAndOfflineHBaseMultiRegion/8aecd276-a74f-4ec3-b6ee-436ca6593d68 2023-02-09 12:03:07,816 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 49b86c6c43894bf6a027ed6cfd78f851 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-09 12:03:07,828 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing fc52dac117cb96590c6edd7ac65df056, disabling compactions & flushes 2023-02-09 12:03:07,828 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1675944182259.fc52dac117cb96590c6edd7ac65df056. 2023-02-09 12:03:07,828 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1675944182259.fc52dac117cb96590c6edd7ac65df056. 2023-02-09 12:03:07,828 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1675944182259.fc52dac117cb96590c6edd7ac65df056. after waiting 0 ms 2023-02-09 12:03:07,828 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1675944182259.fc52dac117cb96590c6edd7ac65df056. 2023-02-09 12:03:07,828 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1675944182259.fc52dac117cb96590c6edd7ac65df056. 2023-02-09 12:03:07,828 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for fc52dac117cb96590c6edd7ac65df056: Waiting for close lock at 1675944187828Disabling compacts and flushes for region at 1675944187828Disabling writes for close at 1675944187828Writing region close event to WAL at 1675944187828Closed at 1675944187828 2023-02-09 12:03:07,832 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 546fab1946eca3d1b91f4645b19fe169, disabling compactions & flushes 2023-02-09 12:03:07,832 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1675944182259.546fab1946eca3d1b91f4645b19fe169. 2023-02-09 12:03:07,832 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1675944182259.546fab1946eca3d1b91f4645b19fe169. 2023-02-09 12:03:07,832 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1675944182259.546fab1946eca3d1b91f4645b19fe169. after waiting 0 ms 2023-02-09 12:03:07,832 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1675944182259.546fab1946eca3d1b91f4645b19fe169. 2023-02-09 12:03:07,832 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1675944182259.546fab1946eca3d1b91f4645b19fe169. 2023-02-09 12:03:07,832 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 546fab1946eca3d1b91f4645b19fe169: Waiting for close lock at 1675944187832Disabling compacts and flushes for region at 1675944187832Disabling writes for close at 1675944187832Writing region close event to WAL at 1675944187832Closed at 1675944187832 2023-02-09 12:03:07,845 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1675944182259.f8b958d29e440ca92af212e18425d242.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:07,845 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1675944182259.57c7ac6814f18d2541df5c154c377d70.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:07,845 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 1bbc7bca84244b22bbdd2af8de18c7c0 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-09 12:03:07,845 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 754811ab88a54f2896d954293fcd4083 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-09 12:03:07,848 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1675944182259.24db9ec6cca428b56e442ed464c75a7f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:07,848 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 94887c71c44e47069a66db037589a3b1 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-09 12:03:07,848 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1675944182259.e361e7c32d779b70cb86f6640113527e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:07,849 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing e361e7c32d779b70cb86f6640113527e, disabling compactions & flushes 2023-02-09 12:03:07,849 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1675944182259.e361e7c32d779b70cb86f6640113527e. 2023-02-09 12:03:07,849 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1675944182259.e361e7c32d779b70cb86f6640113527e. 2023-02-09 12:03:07,849 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1675944182259.e361e7c32d779b70cb86f6640113527e. after waiting 0 ms 2023-02-09 12:03:07,849 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1675944182259.e361e7c32d779b70cb86f6640113527e. 2023-02-09 12:03:07,849 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1675944182259.e361e7c32d779b70cb86f6640113527e. 2023-02-09 12:03:07,849 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1675944182259.148e52758718776d49fecdf247dc20da.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:07,849 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for e361e7c32d779b70cb86f6640113527e: Waiting for close lock at 1675944187849Disabling compacts and flushes for region at 1675944187849Disabling writes for close at 1675944187849Writing region close event to WAL at 1675944187849Closed at 1675944187849 2023-02-09 12:03:07,849 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 6310ff8e346042ecb44e8798f7518ffa from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-09 12:03:07,851 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f8e42f68fbce432bb90cfb80554dbae6 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-09 12:03:07,852 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink bbc6e5e0672b4c0a9fb7e25f54f64ad1 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-09 12:03:07,852 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1675944182259.b9bd8844b5681299737e0a2f071b03f3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:07,852 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e1fc333643cf4ce6aa6a40f51341db4c from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-09 12:03:07,852 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 08f5fe5facbc4c9293cc89bd0ddad9c6 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-09 12:03:07,853 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f3a80a8d578840eb90d4f701173d1dfa from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-09 12:03:07,854 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 57c7ac6814f18d2541df5c154c377d70, disabling compactions & flushes 2023-02-09 12:03:07,854 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1675944182259.57c7ac6814f18d2541df5c154c377d70. 2023-02-09 12:03:07,854 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1675944182259.57c7ac6814f18d2541df5c154c377d70. 2023-02-09 12:03:07,854 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1675944182259.57c7ac6814f18d2541df5c154c377d70. after waiting 0 ms 2023-02-09 12:03:07,854 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1675944182259.57c7ac6814f18d2541df5c154c377d70. 2023-02-09 12:03:07,854 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1675944182259.57c7ac6814f18d2541df5c154c377d70. 2023-02-09 12:03:07,854 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 57c7ac6814f18d2541df5c154c377d70: Waiting for close lock at 1675944187854Disabling compacts and flushes for region at 1675944187854Disabling writes for close at 1675944187854Writing region close event to WAL at 1675944187854Closed at 1675944187854 2023-02-09 12:03:07,856 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b90588d8e9ec4f789fd4de90e25da9f3 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-09 12:03:07,856 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing f8b958d29e440ca92af212e18425d242, disabling compactions & flushes 2023-02-09 12:03:07,856 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1675944182259.f8b958d29e440ca92af212e18425d242. 2023-02-09 12:03:07,857 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1675944182259.f8b958d29e440ca92af212e18425d242. 2023-02-09 12:03:07,857 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1675944182259.f8b958d29e440ca92af212e18425d242. after waiting 0 ms 2023-02-09 12:03:07,857 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1675944182259.f8b958d29e440ca92af212e18425d242. 2023-02-09 12:03:07,857 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1675944182259.f8b958d29e440ca92af212e18425d242. 2023-02-09 12:03:07,857 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for f8b958d29e440ca92af212e18425d242: Waiting for close lock at 1675944187856Disabling compacts and flushes for region at 1675944187856Disabling writes for close at 1675944187857 (+1 ms)Writing region close event to WAL at 1675944187857Closed at 1675944187857 2023-02-09 12:03:07,857 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 24db9ec6cca428b56e442ed464c75a7f, disabling compactions & flushes 2023-02-09 12:03:07,857 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1675944182259.24db9ec6cca428b56e442ed464c75a7f. 2023-02-09 12:03:07,857 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1675944182259.24db9ec6cca428b56e442ed464c75a7f. 2023-02-09 12:03:07,857 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1675944182259.24db9ec6cca428b56e442ed464c75a7f. after waiting 0 ms 2023-02-09 12:03:07,857 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 148e52758718776d49fecdf247dc20da, disabling compactions & flushes 2023-02-09 12:03:07,857 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1675944182259.24db9ec6cca428b56e442ed464c75a7f. 2023-02-09 12:03:07,857 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1675944182259.148e52758718776d49fecdf247dc20da. 2023-02-09 12:03:07,857 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1675944182259.24db9ec6cca428b56e442ed464c75a7f. 2023-02-09 12:03:07,857 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1675944182259.148e52758718776d49fecdf247dc20da. 2023-02-09 12:03:07,857 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 24db9ec6cca428b56e442ed464c75a7f: Waiting for close lock at 1675944187857Disabling compacts and flushes for region at 1675944187857Disabling writes for close at 1675944187857Writing region close event to WAL at 1675944187857Closed at 1675944187857 2023-02-09 12:03:07,857 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1675944182259.148e52758718776d49fecdf247dc20da. after waiting 0 ms 2023-02-09 12:03:07,857 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1675944182259.148e52758718776d49fecdf247dc20da. 2023-02-09 12:03:07,857 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1675944182259.148e52758718776d49fecdf247dc20da. 2023-02-09 12:03:07,857 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 148e52758718776d49fecdf247dc20da: Waiting for close lock at 1675944187857Disabling compacts and flushes for region at 1675944187857Disabling writes for close at 1675944187857Writing region close event to WAL at 1675944187857Closed at 1675944187857 2023-02-09 12:03:07,860 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing b9bd8844b5681299737e0a2f071b03f3, disabling compactions & flushes 2023-02-09 12:03:07,860 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1675944182259.b9bd8844b5681299737e0a2f071b03f3. 2023-02-09 12:03:07,860 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1675944182259.b9bd8844b5681299737e0a2f071b03f3. 2023-02-09 12:03:07,860 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1675944182259.b9bd8844b5681299737e0a2f071b03f3. after waiting 0 ms 2023-02-09 12:03:07,860 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1675944182259.b9bd8844b5681299737e0a2f071b03f3. 2023-02-09 12:03:07,860 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1675944182259.b9bd8844b5681299737e0a2f071b03f3. 2023-02-09 12:03:07,861 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for b9bd8844b5681299737e0a2f071b03f3: Waiting for close lock at 1675944187860Disabling compacts and flushes for region at 1675944187860Disabling writes for close at 1675944187860Writing region close event to WAL at 1675944187860Closed at 1675944187860 2023-02-09 12:03:07,861 INFO [Listener at localhost/36513] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1675944183584 type: FLUSH version: 2 ttl: 0 2023-02-09 12:03:07,861 DEBUG [Listener at localhost/36513] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:35677/user/jenkins/test-data/070b1f80-84b1-c9f1-7e89-c401c182e07a/testWithMapReduceAndOfflineHBaseMultiRegion/8aecd276-a74f-4ec3-b6ee-436ca6593d68 2023-02-09 12:03:07,861 DEBUG [Listener at localhost/36513] util.CommonFSUtils(682): File system contents for path hdfs://localhost:35677/user/jenkins/test-data/070b1f80-84b1-c9f1-7e89-c401c182e07a/testWithMapReduceAndOfflineHBaseMultiRegion/8aecd276-a74f-4ec3-b6ee-436ca6593d68 2023-02-09 12:03:07,862 DEBUG [Listener at localhost/36513] util.CommonFSUtils(699): |-data/ 2023-02-09 12:03:07,862 DEBUG [Listener at localhost/36513] util.CommonFSUtils(699): |----default/ 2023-02-09 12:03:07,863 DEBUG [Listener at localhost/36513] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-09 12:03:07,863 DEBUG [Listener at localhost/36513] util.CommonFSUtils(699): |----------08fa7b5b79fbcbb53ed767bc07fed909/ 2023-02-09 12:03:07,864 DEBUG [Listener at localhost/36513] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 12:03:07,864 DEBUG [Listener at localhost/36513] util.CommonFSUtils(699): |----------148e52758718776d49fecdf247dc20da/ 2023-02-09 12:03:07,864 DEBUG [Listener at localhost/36513] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 12:03:07,864 DEBUG [Listener at localhost/36513] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 12:03:07,865 DEBUG [Listener at localhost/36513] util.CommonFSUtils(702): |----------------testWithMapReduce=148e52758718776d49fecdf247dc20da-6310ff8e346042ecb44e8798f7518ffa 2023-02-09 12:03:07,865 DEBUG [Listener at localhost/36513] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 12:03:07,865 DEBUG [Listener at localhost/36513] util.CommonFSUtils(702): |----------------testWithMapReduce=148e52758718776d49fecdf247dc20da-f3a80a8d578840eb90d4f701173d1dfa 2023-02-09 12:03:07,865 DEBUG [Listener at localhost/36513] util.CommonFSUtils(699): |----------24db9ec6cca428b56e442ed464c75a7f/ 2023-02-09 12:03:07,866 DEBUG [Listener at localhost/36513] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 12:03:07,866 DEBUG [Listener at localhost/36513] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 12:03:07,866 DEBUG [Listener at localhost/36513] util.CommonFSUtils(702): |----------------testWithMapReduce=24db9ec6cca428b56e442ed464c75a7f-94887c71c44e47069a66db037589a3b1 2023-02-09 12:03:07,866 DEBUG [Listener at localhost/36513] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 12:03:07,867 DEBUG [Listener at localhost/36513] util.CommonFSUtils(702): |----------------testWithMapReduce=24db9ec6cca428b56e442ed464c75a7f-08f5fe5facbc4c9293cc89bd0ddad9c6 2023-02-09 12:03:07,867 DEBUG [Listener at localhost/36513] util.CommonFSUtils(699): |----------266cae67ac0efcfe59291a310a667874/ 2023-02-09 12:03:07,867 DEBUG [Listener at localhost/36513] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 12:03:07,867 DEBUG [Listener at localhost/36513] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 12:03:07,868 DEBUG [Listener at localhost/36513] util.CommonFSUtils(702): |----------------testWithMapReduce=266cae67ac0efcfe59291a310a667874-a0f8d136afa24c7ea95f8333ec8d6392 2023-02-09 12:03:07,868 DEBUG [Listener at localhost/36513] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 12:03:07,868 DEBUG [Listener at localhost/36513] util.CommonFSUtils(702): |----------------testWithMapReduce=266cae67ac0efcfe59291a310a667874-75248938aef14ef7a960142f0b49797e 2023-02-09 12:03:07,868 DEBUG [Listener at localhost/36513] util.CommonFSUtils(699): |----------546fab1946eca3d1b91f4645b19fe169/ 2023-02-09 12:03:07,869 DEBUG [Listener at localhost/36513] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 12:03:07,869 DEBUG [Listener at localhost/36513] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 12:03:07,869 DEBUG [Listener at localhost/36513] util.CommonFSUtils(702): |----------------testWithMapReduce=546fab1946eca3d1b91f4645b19fe169-e135ace1984d4bb49f6c24fa4b95ea2f 2023-02-09 12:03:07,869 DEBUG [Listener at localhost/36513] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 12:03:07,869 DEBUG [Listener at localhost/36513] util.CommonFSUtils(702): |----------------testWithMapReduce=546fab1946eca3d1b91f4645b19fe169-fab535d80a0e4a058e6e8559d4bf6705 2023-02-09 12:03:07,869 DEBUG [Listener at localhost/36513] util.CommonFSUtils(699): |----------57c7ac6814f18d2541df5c154c377d70/ 2023-02-09 12:03:07,870 DEBUG [Listener at localhost/36513] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 12:03:07,870 DEBUG [Listener at localhost/36513] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 12:03:07,870 DEBUG [Listener at localhost/36513] util.CommonFSUtils(702): |----------------testWithMapReduce=57c7ac6814f18d2541df5c154c377d70-754811ab88a54f2896d954293fcd4083 2023-02-09 12:03:07,870 DEBUG [Listener at localhost/36513] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 12:03:07,871 DEBUG [Listener at localhost/36513] util.CommonFSUtils(702): |----------------testWithMapReduce=57c7ac6814f18d2541df5c154c377d70-f8e42f68fbce432bb90cfb80554dbae6 2023-02-09 12:03:07,871 DEBUG [Listener at localhost/36513] util.CommonFSUtils(699): |----------b9bd8844b5681299737e0a2f071b03f3/ 2023-02-09 12:03:07,871 DEBUG [Listener at localhost/36513] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 12:03:07,872 DEBUG [Listener at localhost/36513] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 12:03:07,872 DEBUG [Listener at localhost/36513] util.CommonFSUtils(702): |----------------testWithMapReduce=b9bd8844b5681299737e0a2f071b03f3-e1fc333643cf4ce6aa6a40f51341db4c 2023-02-09 12:03:07,872 DEBUG [Listener at localhost/36513] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 12:03:07,873 DEBUG [Listener at localhost/36513] util.CommonFSUtils(702): |----------------testWithMapReduce=b9bd8844b5681299737e0a2f071b03f3-b90588d8e9ec4f789fd4de90e25da9f3 2023-02-09 12:03:07,873 DEBUG [Listener at localhost/36513] util.CommonFSUtils(699): |----------e361e7c32d779b70cb86f6640113527e/ 2023-02-09 12:03:07,873 DEBUG [Listener at localhost/36513] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 12:03:07,873 DEBUG [Listener at localhost/36513] util.CommonFSUtils(699): |----------f8b958d29e440ca92af212e18425d242/ 2023-02-09 12:03:07,874 DEBUG [Listener at localhost/36513] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 12:03:07,874 DEBUG [Listener at localhost/36513] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 12:03:07,874 DEBUG [Listener at localhost/36513] util.CommonFSUtils(702): |----------------testWithMapReduce=f8b958d29e440ca92af212e18425d242-1bbc7bca84244b22bbdd2af8de18c7c0 2023-02-09 12:03:07,874 DEBUG [Listener at localhost/36513] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 12:03:07,875 DEBUG [Listener at localhost/36513] util.CommonFSUtils(702): |----------------testWithMapReduce=f8b958d29e440ca92af212e18425d242-bbc6e5e0672b4c0a9fb7e25f54f64ad1 2023-02-09 12:03:07,875 DEBUG [Listener at localhost/36513] util.CommonFSUtils(699): |----------fc52dac117cb96590c6edd7ac65df056/ 2023-02-09 12:03:07,875 DEBUG [Listener at localhost/36513] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 12:03:07,875 DEBUG [Listener at localhost/36513] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 12:03:07,876 DEBUG [Listener at localhost/36513] util.CommonFSUtils(702): |----------------testWithMapReduce=fc52dac117cb96590c6edd7ac65df056-ee422794f0314247ae6e9d11d6af55ea 2023-02-09 12:03:07,876 DEBUG [Listener at localhost/36513] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 12:03:07,876 DEBUG [Listener at localhost/36513] util.CommonFSUtils(702): |----------------testWithMapReduce=fc52dac117cb96590c6edd7ac65df056-49b86c6c43894bf6a027ed6cfd78f851 2023-02-09 12:03:07,877 DEBUG [Listener at localhost/36513] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-09 12:03:07,878 DEBUG [Listener at localhost/36513] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-09 12:03:07,878 DEBUG [Listener at localhost/36513] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-09 12:03:07,879 DEBUG [Listener at localhost/36513] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-09 12:03:07,879 DEBUG [Listener at localhost/36513] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.17-SNAPSHOT.jar 2023-02-09 12:03:07,880 DEBUG [Listener at localhost/36513] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-09 12:03:07,880 DEBUG [Listener at localhost/36513] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-09 12:03:07,946 DEBUG [Listener at localhost/36513] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4f4a1677-b9c2-11c9-6e72-f44b3a4b8222/hadoop-5167627363238350957.jar 2023-02-09 12:03:07,947 DEBUG [Listener at localhost/36513] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-09 12:03:07,947 DEBUG [Listener at localhost/36513] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-09 12:03:07,948 DEBUG [Listener at localhost/36513] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-09 12:03:07,948 DEBUG [Listener at localhost/36513] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-09 12:03:07,949 DEBUG [Listener at localhost/36513] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-09 12:03:07,949 DEBUG [Listener at localhost/36513] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-09 12:03:07,949 DEBUG [Listener at localhost/36513] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-09 12:03:07,950 DEBUG [Listener at localhost/36513] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-09 12:03:07,950 DEBUG [Listener at localhost/36513] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-09 12:03:07,950 DEBUG [Listener at localhost/36513] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-09 12:03:07,951 DEBUG [Listener at localhost/36513] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-09 12:03:07,951 DEBUG [Listener at localhost/36513] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-09 12:03:07,951 DEBUG [Listener at localhost/36513] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-09 12:03:07,952 DEBUG [Listener at localhost/36513] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-09 12:03:07,952 DEBUG [Listener at localhost/36513] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-09 12:03:07,953 DEBUG [Listener at localhost/36513] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-09 12:03:07,953 DEBUG [Listener at localhost/36513] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-09 12:03:07,953 DEBUG [Listener at localhost/36513] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-09 12:03:07,954 DEBUG [Listener at localhost/36513] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-09 12:03:07,954 DEBUG [Listener at localhost/36513] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-09 12:03:07,954 DEBUG [Listener at localhost/36513] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-09 12:03:08,020 DEBUG [Listener at localhost/36513] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4f4a1677-b9c2-11c9-6e72-f44b3a4b8222/hadoop-5437002195576845679.jar 2023-02-09 12:03:08,021 DEBUG [Listener at localhost/36513] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-09 12:03:08,026 WARN [Listener at localhost/36513] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-09 12:03:08,056 INFO [Listener at localhost/36513] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-09 12:03:08,149 WARN [Listener at localhost/36513] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4f4a1677-b9c2-11c9-6e72-f44b3a4b8222/mapreduce.cluster.local.dir/1675944188117/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-09 12:03:08,149 WARN [Listener at localhost/36513] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4f4a1677-b9c2-11c9-6e72-f44b3a4b8222/mapreduce.cluster.local.dir/1675944188117/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-09 12:03:08,185 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675944182259.08fa7b5b79fbcbb53ed767bc07fed909.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:08,185 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 12:03:08,186 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 12:03:08,188 INFO [StoreOpener-08fa7b5b79fbcbb53ed767bc07fed909-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 08fa7b5b79fbcbb53ed767bc07fed909 2023-02-09 12:03:08,189 DEBUG [StoreOpener-08fa7b5b79fbcbb53ed767bc07fed909-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35677/user/jenkins/test-data/070b1f80-84b1-c9f1-7e89-c401c182e07a/testWithMapReduceAndOfflineHBaseMultiRegion/8aecd276-a74f-4ec3-b6ee-436ca6593d68/data/default/testWithMapReduce/08fa7b5b79fbcbb53ed767bc07fed909/f1 2023-02-09 12:03:08,190 INFO [StoreOpener-08fa7b5b79fbcbb53ed767bc07fed909-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 08fa7b5b79fbcbb53ed767bc07fed909 columnFamilyName f1 2023-02-09 12:03:08,190 INFO [StoreOpener-08fa7b5b79fbcbb53ed767bc07fed909-1] regionserver.HStore(310): Store=08fa7b5b79fbcbb53ed767bc07fed909/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:08,190 INFO [StoreOpener-08fa7b5b79fbcbb53ed767bc07fed909-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 08fa7b5b79fbcbb53ed767bc07fed909 2023-02-09 12:03:08,192 DEBUG [StoreOpener-08fa7b5b79fbcbb53ed767bc07fed909-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35677/user/jenkins/test-data/070b1f80-84b1-c9f1-7e89-c401c182e07a/testWithMapReduceAndOfflineHBaseMultiRegion/8aecd276-a74f-4ec3-b6ee-436ca6593d68/data/default/testWithMapReduce/08fa7b5b79fbcbb53ed767bc07fed909/f2 2023-02-09 12:03:08,192 INFO [StoreOpener-08fa7b5b79fbcbb53ed767bc07fed909-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 08fa7b5b79fbcbb53ed767bc07fed909 columnFamilyName f2 2023-02-09 12:03:08,192 INFO [StoreOpener-08fa7b5b79fbcbb53ed767bc07fed909-1] regionserver.HStore(310): Store=08fa7b5b79fbcbb53ed767bc07fed909/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:08,193 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 12:03:08,193 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 08fa7b5b79fbcbb53ed767bc07fed909; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70683423, jitterRate=0.053265079855918884}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 12:03:08,193 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 08fa7b5b79fbcbb53ed767bc07fed909: Writing region info on filesystem at 1675944188186Initializing all the Stores at 1675944188187 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944188187Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944188187Region opened successfully at 1675944188193 (+6 ms) 2023-02-09 12:03:08,211 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 08fa7b5b79fbcbb53ed767bc07fed909, disabling compactions & flushes 2023-02-09 12:03:08,211 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675944182259.08fa7b5b79fbcbb53ed767bc07fed909. 2023-02-09 12:03:08,211 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675944182259.08fa7b5b79fbcbb53ed767bc07fed909. 2023-02-09 12:03:08,211 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675944182259.08fa7b5b79fbcbb53ed767bc07fed909. after waiting 0 ms 2023-02-09 12:03:08,211 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675944182259.08fa7b5b79fbcbb53ed767bc07fed909. 2023-02-09 12:03:08,211 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675944182259.08fa7b5b79fbcbb53ed767bc07fed909. 2023-02-09 12:03:08,212 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 08fa7b5b79fbcbb53ed767bc07fed909: Waiting for close lock at 1675944188211Disabling compacts and flushes for region at 1675944188211Disabling writes for close at 1675944188211Writing region close event to WAL at 1675944188211Closed at 1675944188211 2023-02-09 12:03:08,216 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1675944182259.546fab1946eca3d1b91f4645b19fe169.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:08,216 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 12:03:08,217 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 12:03:08,219 INFO [StoreOpener-546fab1946eca3d1b91f4645b19fe169-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 546fab1946eca3d1b91f4645b19fe169 2023-02-09 12:03:08,220 DEBUG [StoreOpener-546fab1946eca3d1b91f4645b19fe169-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35677/user/jenkins/test-data/070b1f80-84b1-c9f1-7e89-c401c182e07a/testWithMapReduceAndOfflineHBaseMultiRegion/8aecd276-a74f-4ec3-b6ee-436ca6593d68/data/default/testWithMapReduce/546fab1946eca3d1b91f4645b19fe169/f1 2023-02-09 12:03:08,220 INFO [StoreOpener-546fab1946eca3d1b91f4645b19fe169-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 546fab1946eca3d1b91f4645b19fe169 columnFamilyName f1 2023-02-09 12:03:08,225 DEBUG [StoreOpener-546fab1946eca3d1b91f4645b19fe169-1] regionserver.HStore(539): loaded hdfs://localhost:35677/user/jenkins/test-data/070b1f80-84b1-c9f1-7e89-c401c182e07a/testWithMapReduceAndOfflineHBaseMultiRegion/8aecd276-a74f-4ec3-b6ee-436ca6593d68/data/default/testWithMapReduce/546fab1946eca3d1b91f4645b19fe169/f1/testWithMapReduce=546fab1946eca3d1b91f4645b19fe169-e135ace1984d4bb49f6c24fa4b95ea2f 2023-02-09 12:03:08,225 INFO [StoreOpener-546fab1946eca3d1b91f4645b19fe169-1] regionserver.HStore(310): Store=546fab1946eca3d1b91f4645b19fe169/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:08,225 INFO [StoreOpener-546fab1946eca3d1b91f4645b19fe169-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 546fab1946eca3d1b91f4645b19fe169 2023-02-09 12:03:08,226 DEBUG [StoreOpener-546fab1946eca3d1b91f4645b19fe169-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35677/user/jenkins/test-data/070b1f80-84b1-c9f1-7e89-c401c182e07a/testWithMapReduceAndOfflineHBaseMultiRegion/8aecd276-a74f-4ec3-b6ee-436ca6593d68/data/default/testWithMapReduce/546fab1946eca3d1b91f4645b19fe169/f2 2023-02-09 12:03:08,226 INFO [StoreOpener-546fab1946eca3d1b91f4645b19fe169-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 546fab1946eca3d1b91f4645b19fe169 columnFamilyName f2 2023-02-09 12:03:08,231 DEBUG [StoreOpener-546fab1946eca3d1b91f4645b19fe169-1] regionserver.HStore(539): loaded hdfs://localhost:35677/user/jenkins/test-data/070b1f80-84b1-c9f1-7e89-c401c182e07a/testWithMapReduceAndOfflineHBaseMultiRegion/8aecd276-a74f-4ec3-b6ee-436ca6593d68/data/default/testWithMapReduce/546fab1946eca3d1b91f4645b19fe169/f2/testWithMapReduce=546fab1946eca3d1b91f4645b19fe169-fab535d80a0e4a058e6e8559d4bf6705 2023-02-09 12:03:08,231 INFO [StoreOpener-546fab1946eca3d1b91f4645b19fe169-1] regionserver.HStore(310): Store=546fab1946eca3d1b91f4645b19fe169/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:08,231 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 12:03:08,231 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 546fab1946eca3d1b91f4645b19fe169; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75203938, jitterRate=0.12062600255012512}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 12:03:08,231 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 546fab1946eca3d1b91f4645b19fe169: Writing region info on filesystem at 1675944188217Initializing all the Stores at 1675944188218 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944188218Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944188218Region opened successfully at 1675944188231 (+13 ms) 2023-02-09 12:03:08,263 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 546fab1946eca3d1b91f4645b19fe169, disabling compactions & flushes 2023-02-09 12:03:08,263 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1675944182259.546fab1946eca3d1b91f4645b19fe169. 2023-02-09 12:03:08,263 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1675944182259.546fab1946eca3d1b91f4645b19fe169. 2023-02-09 12:03:08,264 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1675944182259.546fab1946eca3d1b91f4645b19fe169. after waiting 0 ms 2023-02-09 12:03:08,264 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1675944182259.546fab1946eca3d1b91f4645b19fe169. 2023-02-09 12:03:08,264 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1675944182259.546fab1946eca3d1b91f4645b19fe169. 2023-02-09 12:03:08,264 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 546fab1946eca3d1b91f4645b19fe169: Waiting for close lock at 1675944188263Disabling compacts and flushes for region at 1675944188263Disabling writes for close at 1675944188264 (+1 ms)Writing region close event to WAL at 1675944188264Closed at 1675944188264 2023-02-09 12:03:08,268 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1675944182259.266cae67ac0efcfe59291a310a667874.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:08,268 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 12:03:08,269 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 12:03:08,271 INFO [StoreOpener-266cae67ac0efcfe59291a310a667874-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 266cae67ac0efcfe59291a310a667874 2023-02-09 12:03:08,272 DEBUG [StoreOpener-266cae67ac0efcfe59291a310a667874-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35677/user/jenkins/test-data/070b1f80-84b1-c9f1-7e89-c401c182e07a/testWithMapReduceAndOfflineHBaseMultiRegion/8aecd276-a74f-4ec3-b6ee-436ca6593d68/data/default/testWithMapReduce/266cae67ac0efcfe59291a310a667874/f1 2023-02-09 12:03:08,272 INFO [StoreOpener-266cae67ac0efcfe59291a310a667874-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 266cae67ac0efcfe59291a310a667874 columnFamilyName f1 2023-02-09 12:03:08,277 DEBUG [StoreOpener-266cae67ac0efcfe59291a310a667874-1] regionserver.HStore(539): loaded hdfs://localhost:35677/user/jenkins/test-data/070b1f80-84b1-c9f1-7e89-c401c182e07a/testWithMapReduceAndOfflineHBaseMultiRegion/8aecd276-a74f-4ec3-b6ee-436ca6593d68/data/default/testWithMapReduce/266cae67ac0efcfe59291a310a667874/f1/testWithMapReduce=266cae67ac0efcfe59291a310a667874-a0f8d136afa24c7ea95f8333ec8d6392 2023-02-09 12:03:08,277 INFO [StoreOpener-266cae67ac0efcfe59291a310a667874-1] regionserver.HStore(310): Store=266cae67ac0efcfe59291a310a667874/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:08,277 INFO [StoreOpener-266cae67ac0efcfe59291a310a667874-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 266cae67ac0efcfe59291a310a667874 2023-02-09 12:03:08,278 DEBUG [StoreOpener-266cae67ac0efcfe59291a310a667874-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35677/user/jenkins/test-data/070b1f80-84b1-c9f1-7e89-c401c182e07a/testWithMapReduceAndOfflineHBaseMultiRegion/8aecd276-a74f-4ec3-b6ee-436ca6593d68/data/default/testWithMapReduce/266cae67ac0efcfe59291a310a667874/f2 2023-02-09 12:03:08,278 INFO [StoreOpener-266cae67ac0efcfe59291a310a667874-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 266cae67ac0efcfe59291a310a667874 columnFamilyName f2 2023-02-09 12:03:08,283 DEBUG [StoreOpener-266cae67ac0efcfe59291a310a667874-1] regionserver.HStore(539): loaded hdfs://localhost:35677/user/jenkins/test-data/070b1f80-84b1-c9f1-7e89-c401c182e07a/testWithMapReduceAndOfflineHBaseMultiRegion/8aecd276-a74f-4ec3-b6ee-436ca6593d68/data/default/testWithMapReduce/266cae67ac0efcfe59291a310a667874/f2/testWithMapReduce=266cae67ac0efcfe59291a310a667874-75248938aef14ef7a960142f0b49797e 2023-02-09 12:03:08,283 INFO [StoreOpener-266cae67ac0efcfe59291a310a667874-1] regionserver.HStore(310): Store=266cae67ac0efcfe59291a310a667874/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:08,284 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 12:03:08,284 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 266cae67ac0efcfe59291a310a667874; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66015625, jitterRate=-0.016290530562400818}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 12:03:08,284 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 266cae67ac0efcfe59291a310a667874: Writing region info on filesystem at 1675944188269Initializing all the Stores at 1675944188270 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944188270Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944188270Region opened successfully at 1675944188284 (+14 ms) 2023-02-09 12:03:08,312 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 266cae67ac0efcfe59291a310a667874, disabling compactions & flushes 2023-02-09 12:03:08,313 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1675944182259.266cae67ac0efcfe59291a310a667874. 2023-02-09 12:03:08,313 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1675944182259.266cae67ac0efcfe59291a310a667874. 2023-02-09 12:03:08,313 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1675944182259.266cae67ac0efcfe59291a310a667874. after waiting 0 ms 2023-02-09 12:03:08,313 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1675944182259.266cae67ac0efcfe59291a310a667874. 2023-02-09 12:03:08,314 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1675944182259.266cae67ac0efcfe59291a310a667874. 2023-02-09 12:03:08,314 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 266cae67ac0efcfe59291a310a667874: Waiting for close lock at 1675944188312Disabling compacts and flushes for region at 1675944188312Disabling writes for close at 1675944188313 (+1 ms)Writing region close event to WAL at 1675944188314 (+1 ms)Closed at 1675944188314 2023-02-09 12:03:08,317 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1675944182259.148e52758718776d49fecdf247dc20da.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:08,317 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 12:03:08,320 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 12:03:08,324 INFO [StoreOpener-148e52758718776d49fecdf247dc20da-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 148e52758718776d49fecdf247dc20da 2023-02-09 12:03:08,325 DEBUG [StoreOpener-148e52758718776d49fecdf247dc20da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35677/user/jenkins/test-data/070b1f80-84b1-c9f1-7e89-c401c182e07a/testWithMapReduceAndOfflineHBaseMultiRegion/8aecd276-a74f-4ec3-b6ee-436ca6593d68/data/default/testWithMapReduce/148e52758718776d49fecdf247dc20da/f1 2023-02-09 12:03:08,326 INFO [StoreOpener-148e52758718776d49fecdf247dc20da-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 148e52758718776d49fecdf247dc20da columnFamilyName f1 2023-02-09 12:03:08,331 DEBUG [StoreOpener-148e52758718776d49fecdf247dc20da-1] regionserver.HStore(539): loaded hdfs://localhost:35677/user/jenkins/test-data/070b1f80-84b1-c9f1-7e89-c401c182e07a/testWithMapReduceAndOfflineHBaseMultiRegion/8aecd276-a74f-4ec3-b6ee-436ca6593d68/data/default/testWithMapReduce/148e52758718776d49fecdf247dc20da/f1/testWithMapReduce=148e52758718776d49fecdf247dc20da-6310ff8e346042ecb44e8798f7518ffa 2023-02-09 12:03:08,332 INFO [StoreOpener-148e52758718776d49fecdf247dc20da-1] regionserver.HStore(310): Store=148e52758718776d49fecdf247dc20da/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:08,332 INFO [StoreOpener-148e52758718776d49fecdf247dc20da-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 148e52758718776d49fecdf247dc20da 2023-02-09 12:03:08,333 DEBUG [StoreOpener-148e52758718776d49fecdf247dc20da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35677/user/jenkins/test-data/070b1f80-84b1-c9f1-7e89-c401c182e07a/testWithMapReduceAndOfflineHBaseMultiRegion/8aecd276-a74f-4ec3-b6ee-436ca6593d68/data/default/testWithMapReduce/148e52758718776d49fecdf247dc20da/f2 2023-02-09 12:03:08,333 INFO [StoreOpener-148e52758718776d49fecdf247dc20da-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 148e52758718776d49fecdf247dc20da columnFamilyName f2 2023-02-09 12:03:08,338 DEBUG [StoreOpener-148e52758718776d49fecdf247dc20da-1] regionserver.HStore(539): loaded hdfs://localhost:35677/user/jenkins/test-data/070b1f80-84b1-c9f1-7e89-c401c182e07a/testWithMapReduceAndOfflineHBaseMultiRegion/8aecd276-a74f-4ec3-b6ee-436ca6593d68/data/default/testWithMapReduce/148e52758718776d49fecdf247dc20da/f2/testWithMapReduce=148e52758718776d49fecdf247dc20da-f3a80a8d578840eb90d4f701173d1dfa 2023-02-09 12:03:08,338 INFO [StoreOpener-148e52758718776d49fecdf247dc20da-1] regionserver.HStore(310): Store=148e52758718776d49fecdf247dc20da/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:08,338 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 12:03:08,338 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 148e52758718776d49fecdf247dc20da; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74102144, jitterRate=0.10420799255371094}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 12:03:08,338 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 148e52758718776d49fecdf247dc20da: Writing region info on filesystem at 1675944188320Initializing all the Stores at 1675944188321 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944188321Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944188324 (+3 ms)Region opened successfully at 1675944188338 (+14 ms) 2023-02-09 12:03:08,377 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 148e52758718776d49fecdf247dc20da, disabling compactions & flushes 2023-02-09 12:03:08,377 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1675944182259.148e52758718776d49fecdf247dc20da. 2023-02-09 12:03:08,377 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1675944182259.148e52758718776d49fecdf247dc20da. 2023-02-09 12:03:08,377 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1675944182259.148e52758718776d49fecdf247dc20da. after waiting 0 ms 2023-02-09 12:03:08,377 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1675944182259.148e52758718776d49fecdf247dc20da. 2023-02-09 12:03:08,378 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1675944182259.148e52758718776d49fecdf247dc20da. 2023-02-09 12:03:08,378 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 148e52758718776d49fecdf247dc20da: Waiting for close lock at 1675944188377Disabling compacts and flushes for region at 1675944188377Disabling writes for close at 1675944188377Writing region close event to WAL at 1675944188378 (+1 ms)Closed at 1675944188378 2023-02-09 12:03:08,381 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1675944182259.24db9ec6cca428b56e442ed464c75a7f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:08,381 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 12:03:08,384 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 12:03:08,386 INFO [StoreOpener-24db9ec6cca428b56e442ed464c75a7f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 24db9ec6cca428b56e442ed464c75a7f 2023-02-09 12:03:08,386 DEBUG [StoreOpener-24db9ec6cca428b56e442ed464c75a7f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35677/user/jenkins/test-data/070b1f80-84b1-c9f1-7e89-c401c182e07a/testWithMapReduceAndOfflineHBaseMultiRegion/8aecd276-a74f-4ec3-b6ee-436ca6593d68/data/default/testWithMapReduce/24db9ec6cca428b56e442ed464c75a7f/f1 2023-02-09 12:03:08,387 INFO [StoreOpener-24db9ec6cca428b56e442ed464c75a7f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 24db9ec6cca428b56e442ed464c75a7f columnFamilyName f1 2023-02-09 12:03:08,392 DEBUG [StoreOpener-24db9ec6cca428b56e442ed464c75a7f-1] regionserver.HStore(539): loaded hdfs://localhost:35677/user/jenkins/test-data/070b1f80-84b1-c9f1-7e89-c401c182e07a/testWithMapReduceAndOfflineHBaseMultiRegion/8aecd276-a74f-4ec3-b6ee-436ca6593d68/data/default/testWithMapReduce/24db9ec6cca428b56e442ed464c75a7f/f1/testWithMapReduce=24db9ec6cca428b56e442ed464c75a7f-94887c71c44e47069a66db037589a3b1 2023-02-09 12:03:08,392 INFO [StoreOpener-24db9ec6cca428b56e442ed464c75a7f-1] regionserver.HStore(310): Store=24db9ec6cca428b56e442ed464c75a7f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:08,392 INFO [StoreOpener-24db9ec6cca428b56e442ed464c75a7f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 24db9ec6cca428b56e442ed464c75a7f 2023-02-09 12:03:08,393 DEBUG [StoreOpener-24db9ec6cca428b56e442ed464c75a7f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35677/user/jenkins/test-data/070b1f80-84b1-c9f1-7e89-c401c182e07a/testWithMapReduceAndOfflineHBaseMultiRegion/8aecd276-a74f-4ec3-b6ee-436ca6593d68/data/default/testWithMapReduce/24db9ec6cca428b56e442ed464c75a7f/f2 2023-02-09 12:03:08,393 INFO [StoreOpener-24db9ec6cca428b56e442ed464c75a7f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 24db9ec6cca428b56e442ed464c75a7f columnFamilyName f2 2023-02-09 12:03:08,397 DEBUG [StoreOpener-24db9ec6cca428b56e442ed464c75a7f-1] regionserver.HStore(539): loaded hdfs://localhost:35677/user/jenkins/test-data/070b1f80-84b1-c9f1-7e89-c401c182e07a/testWithMapReduceAndOfflineHBaseMultiRegion/8aecd276-a74f-4ec3-b6ee-436ca6593d68/data/default/testWithMapReduce/24db9ec6cca428b56e442ed464c75a7f/f2/testWithMapReduce=24db9ec6cca428b56e442ed464c75a7f-08f5fe5facbc4c9293cc89bd0ddad9c6 2023-02-09 12:03:08,398 INFO [StoreOpener-24db9ec6cca428b56e442ed464c75a7f-1] regionserver.HStore(310): Store=24db9ec6cca428b56e442ed464c75a7f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:08,398 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 12:03:08,398 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 24db9ec6cca428b56e442ed464c75a7f; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60958703, jitterRate=-0.0916445404291153}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 12:03:08,398 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 24db9ec6cca428b56e442ed464c75a7f: Writing region info on filesystem at 1675944188384Initializing all the Stores at 1675944188385 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944188385Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944188385Region opened successfully at 1675944188398 (+13 ms) 2023-02-09 12:03:08,434 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 24db9ec6cca428b56e442ed464c75a7f, disabling compactions & flushes 2023-02-09 12:03:08,434 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1675944182259.24db9ec6cca428b56e442ed464c75a7f. 2023-02-09 12:03:08,434 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1675944182259.24db9ec6cca428b56e442ed464c75a7f. 2023-02-09 12:03:08,434 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1675944182259.24db9ec6cca428b56e442ed464c75a7f. after waiting 0 ms 2023-02-09 12:03:08,434 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1675944182259.24db9ec6cca428b56e442ed464c75a7f. 2023-02-09 12:03:08,435 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1675944182259.24db9ec6cca428b56e442ed464c75a7f. 2023-02-09 12:03:08,435 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 24db9ec6cca428b56e442ed464c75a7f: Waiting for close lock at 1675944188434Disabling compacts and flushes for region at 1675944188434Disabling writes for close at 1675944188434Writing region close event to WAL at 1675944188435 (+1 ms)Closed at 1675944188435 2023-02-09 12:03:08,439 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1675944182259.f8b958d29e440ca92af212e18425d242.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:08,439 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 12:03:08,441 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 12:03:08,443 INFO [StoreOpener-f8b958d29e440ca92af212e18425d242-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f8b958d29e440ca92af212e18425d242 2023-02-09 12:03:08,444 DEBUG [StoreOpener-f8b958d29e440ca92af212e18425d242-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35677/user/jenkins/test-data/070b1f80-84b1-c9f1-7e89-c401c182e07a/testWithMapReduceAndOfflineHBaseMultiRegion/8aecd276-a74f-4ec3-b6ee-436ca6593d68/data/default/testWithMapReduce/f8b958d29e440ca92af212e18425d242/f1 2023-02-09 12:03:08,444 INFO [StoreOpener-f8b958d29e440ca92af212e18425d242-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f8b958d29e440ca92af212e18425d242 columnFamilyName f1 2023-02-09 12:03:08,448 DEBUG [StoreOpener-f8b958d29e440ca92af212e18425d242-1] regionserver.HStore(539): loaded hdfs://localhost:35677/user/jenkins/test-data/070b1f80-84b1-c9f1-7e89-c401c182e07a/testWithMapReduceAndOfflineHBaseMultiRegion/8aecd276-a74f-4ec3-b6ee-436ca6593d68/data/default/testWithMapReduce/f8b958d29e440ca92af212e18425d242/f1/testWithMapReduce=f8b958d29e440ca92af212e18425d242-1bbc7bca84244b22bbdd2af8de18c7c0 2023-02-09 12:03:08,448 INFO [StoreOpener-f8b958d29e440ca92af212e18425d242-1] regionserver.HStore(310): Store=f8b958d29e440ca92af212e18425d242/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:08,449 INFO [StoreOpener-f8b958d29e440ca92af212e18425d242-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f8b958d29e440ca92af212e18425d242 2023-02-09 12:03:08,449 DEBUG [StoreOpener-f8b958d29e440ca92af212e18425d242-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35677/user/jenkins/test-data/070b1f80-84b1-c9f1-7e89-c401c182e07a/testWithMapReduceAndOfflineHBaseMultiRegion/8aecd276-a74f-4ec3-b6ee-436ca6593d68/data/default/testWithMapReduce/f8b958d29e440ca92af212e18425d242/f2 2023-02-09 12:03:08,450 INFO [StoreOpener-f8b958d29e440ca92af212e18425d242-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f8b958d29e440ca92af212e18425d242 columnFamilyName f2 2023-02-09 12:03:08,454 DEBUG [StoreOpener-f8b958d29e440ca92af212e18425d242-1] regionserver.HStore(539): loaded hdfs://localhost:35677/user/jenkins/test-data/070b1f80-84b1-c9f1-7e89-c401c182e07a/testWithMapReduceAndOfflineHBaseMultiRegion/8aecd276-a74f-4ec3-b6ee-436ca6593d68/data/default/testWithMapReduce/f8b958d29e440ca92af212e18425d242/f2/testWithMapReduce=f8b958d29e440ca92af212e18425d242-bbc6e5e0672b4c0a9fb7e25f54f64ad1 2023-02-09 12:03:08,454 INFO [StoreOpener-f8b958d29e440ca92af212e18425d242-1] regionserver.HStore(310): Store=f8b958d29e440ca92af212e18425d242/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:08,454 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 12:03:08,455 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened f8b958d29e440ca92af212e18425d242; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67568021, jitterRate=0.006841972470283508}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 12:03:08,455 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for f8b958d29e440ca92af212e18425d242: Writing region info on filesystem at 1675944188441Initializing all the Stores at 1675944188442 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944188442Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944188442Region opened successfully at 1675944188455 (+13 ms) 2023-02-09 12:03:08,487 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing f8b958d29e440ca92af212e18425d242, disabling compactions & flushes 2023-02-09 12:03:08,487 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1675944182259.f8b958d29e440ca92af212e18425d242. 2023-02-09 12:03:08,487 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1675944182259.f8b958d29e440ca92af212e18425d242. 2023-02-09 12:03:08,487 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1675944182259.f8b958d29e440ca92af212e18425d242. after waiting 0 ms 2023-02-09 12:03:08,487 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1675944182259.f8b958d29e440ca92af212e18425d242. 2023-02-09 12:03:08,488 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1675944182259.f8b958d29e440ca92af212e18425d242. 2023-02-09 12:03:08,488 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for f8b958d29e440ca92af212e18425d242: Waiting for close lock at 1675944188487Disabling compacts and flushes for region at 1675944188487Disabling writes for close at 1675944188487Writing region close event to WAL at 1675944188488 (+1 ms)Closed at 1675944188488 2023-02-09 12:03:08,491 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1675944182259.fc52dac117cb96590c6edd7ac65df056.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:08,491 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 12:03:08,492 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 12:03:08,493 INFO [StoreOpener-fc52dac117cb96590c6edd7ac65df056-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region fc52dac117cb96590c6edd7ac65df056 2023-02-09 12:03:08,494 DEBUG [StoreOpener-fc52dac117cb96590c6edd7ac65df056-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35677/user/jenkins/test-data/070b1f80-84b1-c9f1-7e89-c401c182e07a/testWithMapReduceAndOfflineHBaseMultiRegion/8aecd276-a74f-4ec3-b6ee-436ca6593d68/data/default/testWithMapReduce/fc52dac117cb96590c6edd7ac65df056/f1 2023-02-09 12:03:08,495 INFO [StoreOpener-fc52dac117cb96590c6edd7ac65df056-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fc52dac117cb96590c6edd7ac65df056 columnFamilyName f1 2023-02-09 12:03:08,499 DEBUG [StoreOpener-fc52dac117cb96590c6edd7ac65df056-1] regionserver.HStore(539): loaded hdfs://localhost:35677/user/jenkins/test-data/070b1f80-84b1-c9f1-7e89-c401c182e07a/testWithMapReduceAndOfflineHBaseMultiRegion/8aecd276-a74f-4ec3-b6ee-436ca6593d68/data/default/testWithMapReduce/fc52dac117cb96590c6edd7ac65df056/f1/testWithMapReduce=fc52dac117cb96590c6edd7ac65df056-ee422794f0314247ae6e9d11d6af55ea 2023-02-09 12:03:08,499 INFO [StoreOpener-fc52dac117cb96590c6edd7ac65df056-1] regionserver.HStore(310): Store=fc52dac117cb96590c6edd7ac65df056/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:08,499 INFO [StoreOpener-fc52dac117cb96590c6edd7ac65df056-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region fc52dac117cb96590c6edd7ac65df056 2023-02-09 12:03:08,500 DEBUG [StoreOpener-fc52dac117cb96590c6edd7ac65df056-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35677/user/jenkins/test-data/070b1f80-84b1-c9f1-7e89-c401c182e07a/testWithMapReduceAndOfflineHBaseMultiRegion/8aecd276-a74f-4ec3-b6ee-436ca6593d68/data/default/testWithMapReduce/fc52dac117cb96590c6edd7ac65df056/f2 2023-02-09 12:03:08,500 INFO [StoreOpener-fc52dac117cb96590c6edd7ac65df056-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fc52dac117cb96590c6edd7ac65df056 columnFamilyName f2 2023-02-09 12:03:08,504 DEBUG [StoreOpener-fc52dac117cb96590c6edd7ac65df056-1] regionserver.HStore(539): loaded hdfs://localhost:35677/user/jenkins/test-data/070b1f80-84b1-c9f1-7e89-c401c182e07a/testWithMapReduceAndOfflineHBaseMultiRegion/8aecd276-a74f-4ec3-b6ee-436ca6593d68/data/default/testWithMapReduce/fc52dac117cb96590c6edd7ac65df056/f2/testWithMapReduce=fc52dac117cb96590c6edd7ac65df056-49b86c6c43894bf6a027ed6cfd78f851 2023-02-09 12:03:08,505 INFO [StoreOpener-fc52dac117cb96590c6edd7ac65df056-1] regionserver.HStore(310): Store=fc52dac117cb96590c6edd7ac65df056/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:08,505 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 12:03:08,505 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened fc52dac117cb96590c6edd7ac65df056; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74901536, jitterRate=0.1161198616027832}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 12:03:08,505 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for fc52dac117cb96590c6edd7ac65df056: Writing region info on filesystem at 1675944188492Initializing all the Stores at 1675944188493 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944188493Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944188493Region opened successfully at 1675944188505 (+12 ms) 2023-02-09 12:03:08,532 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing fc52dac117cb96590c6edd7ac65df056, disabling compactions & flushes 2023-02-09 12:03:08,532 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1675944182259.fc52dac117cb96590c6edd7ac65df056. 2023-02-09 12:03:08,532 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1675944182259.fc52dac117cb96590c6edd7ac65df056. 2023-02-09 12:03:08,532 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1675944182259.fc52dac117cb96590c6edd7ac65df056. after waiting 0 ms 2023-02-09 12:03:08,532 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1675944182259.fc52dac117cb96590c6edd7ac65df056. 2023-02-09 12:03:08,533 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1675944182259.fc52dac117cb96590c6edd7ac65df056. 2023-02-09 12:03:08,533 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for fc52dac117cb96590c6edd7ac65df056: Waiting for close lock at 1675944188532Disabling compacts and flushes for region at 1675944188532Disabling writes for close at 1675944188532Writing region close event to WAL at 1675944188533 (+1 ms)Closed at 1675944188533 2023-02-09 12:03:08,535 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1675944182259.e361e7c32d779b70cb86f6640113527e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:08,535 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 12:03:08,536 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 12:03:08,538 INFO [StoreOpener-e361e7c32d779b70cb86f6640113527e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e361e7c32d779b70cb86f6640113527e 2023-02-09 12:03:08,539 DEBUG [StoreOpener-e361e7c32d779b70cb86f6640113527e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35677/user/jenkins/test-data/070b1f80-84b1-c9f1-7e89-c401c182e07a/testWithMapReduceAndOfflineHBaseMultiRegion/8aecd276-a74f-4ec3-b6ee-436ca6593d68/data/default/testWithMapReduce/e361e7c32d779b70cb86f6640113527e/f1 2023-02-09 12:03:08,540 INFO [StoreOpener-e361e7c32d779b70cb86f6640113527e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e361e7c32d779b70cb86f6640113527e columnFamilyName f1 2023-02-09 12:03:08,540 INFO [StoreOpener-e361e7c32d779b70cb86f6640113527e-1] regionserver.HStore(310): Store=e361e7c32d779b70cb86f6640113527e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:08,540 INFO [StoreOpener-e361e7c32d779b70cb86f6640113527e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e361e7c32d779b70cb86f6640113527e 2023-02-09 12:03:08,542 DEBUG [StoreOpener-e361e7c32d779b70cb86f6640113527e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35677/user/jenkins/test-data/070b1f80-84b1-c9f1-7e89-c401c182e07a/testWithMapReduceAndOfflineHBaseMultiRegion/8aecd276-a74f-4ec3-b6ee-436ca6593d68/data/default/testWithMapReduce/e361e7c32d779b70cb86f6640113527e/f2 2023-02-09 12:03:08,542 INFO [StoreOpener-e361e7c32d779b70cb86f6640113527e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e361e7c32d779b70cb86f6640113527e columnFamilyName f2 2023-02-09 12:03:08,542 INFO [StoreOpener-e361e7c32d779b70cb86f6640113527e-1] regionserver.HStore(310): Store=e361e7c32d779b70cb86f6640113527e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:08,542 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 12:03:08,543 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened e361e7c32d779b70cb86f6640113527e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59950398, jitterRate=-0.10666945576667786}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 12:03:08,543 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for e361e7c32d779b70cb86f6640113527e: Writing region info on filesystem at 1675944188536Initializing all the Stores at 1675944188537 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944188537Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944188537Region opened successfully at 1675944188543 (+6 ms) 2023-02-09 12:03:08,560 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing e361e7c32d779b70cb86f6640113527e, disabling compactions & flushes 2023-02-09 12:03:08,560 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1675944182259.e361e7c32d779b70cb86f6640113527e. 2023-02-09 12:03:08,560 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1675944182259.e361e7c32d779b70cb86f6640113527e. 2023-02-09 12:03:08,560 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1675944182259.e361e7c32d779b70cb86f6640113527e. after waiting 0 ms 2023-02-09 12:03:08,560 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1675944182259.e361e7c32d779b70cb86f6640113527e. 2023-02-09 12:03:08,560 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1675944182259.e361e7c32d779b70cb86f6640113527e. 2023-02-09 12:03:08,561 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for e361e7c32d779b70cb86f6640113527e: Waiting for close lock at 1675944188560Disabling compacts and flushes for region at 1675944188560Disabling writes for close at 1675944188560Writing region close event to WAL at 1675944188560Closed at 1675944188560 2023-02-09 12:03:08,563 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1675944182259.57c7ac6814f18d2541df5c154c377d70.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:08,563 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 12:03:08,564 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 12:03:08,566 INFO [StoreOpener-57c7ac6814f18d2541df5c154c377d70-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 57c7ac6814f18d2541df5c154c377d70 2023-02-09 12:03:08,567 DEBUG [StoreOpener-57c7ac6814f18d2541df5c154c377d70-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35677/user/jenkins/test-data/070b1f80-84b1-c9f1-7e89-c401c182e07a/testWithMapReduceAndOfflineHBaseMultiRegion/8aecd276-a74f-4ec3-b6ee-436ca6593d68/data/default/testWithMapReduce/57c7ac6814f18d2541df5c154c377d70/f1 2023-02-09 12:03:08,567 INFO [StoreOpener-57c7ac6814f18d2541df5c154c377d70-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 57c7ac6814f18d2541df5c154c377d70 columnFamilyName f1 2023-02-09 12:03:08,571 DEBUG [StoreOpener-57c7ac6814f18d2541df5c154c377d70-1] regionserver.HStore(539): loaded hdfs://localhost:35677/user/jenkins/test-data/070b1f80-84b1-c9f1-7e89-c401c182e07a/testWithMapReduceAndOfflineHBaseMultiRegion/8aecd276-a74f-4ec3-b6ee-436ca6593d68/data/default/testWithMapReduce/57c7ac6814f18d2541df5c154c377d70/f1/testWithMapReduce=57c7ac6814f18d2541df5c154c377d70-754811ab88a54f2896d954293fcd4083 2023-02-09 12:03:08,571 INFO [StoreOpener-57c7ac6814f18d2541df5c154c377d70-1] regionserver.HStore(310): Store=57c7ac6814f18d2541df5c154c377d70/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:08,572 INFO [StoreOpener-57c7ac6814f18d2541df5c154c377d70-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 57c7ac6814f18d2541df5c154c377d70 2023-02-09 12:03:08,572 DEBUG [StoreOpener-57c7ac6814f18d2541df5c154c377d70-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35677/user/jenkins/test-data/070b1f80-84b1-c9f1-7e89-c401c182e07a/testWithMapReduceAndOfflineHBaseMultiRegion/8aecd276-a74f-4ec3-b6ee-436ca6593d68/data/default/testWithMapReduce/57c7ac6814f18d2541df5c154c377d70/f2 2023-02-09 12:03:08,573 INFO [StoreOpener-57c7ac6814f18d2541df5c154c377d70-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 57c7ac6814f18d2541df5c154c377d70 columnFamilyName f2 2023-02-09 12:03:08,580 DEBUG [StoreOpener-57c7ac6814f18d2541df5c154c377d70-1] regionserver.HStore(539): loaded hdfs://localhost:35677/user/jenkins/test-data/070b1f80-84b1-c9f1-7e89-c401c182e07a/testWithMapReduceAndOfflineHBaseMultiRegion/8aecd276-a74f-4ec3-b6ee-436ca6593d68/data/default/testWithMapReduce/57c7ac6814f18d2541df5c154c377d70/f2/testWithMapReduce=57c7ac6814f18d2541df5c154c377d70-f8e42f68fbce432bb90cfb80554dbae6 2023-02-09 12:03:08,580 INFO [StoreOpener-57c7ac6814f18d2541df5c154c377d70-1] regionserver.HStore(310): Store=57c7ac6814f18d2541df5c154c377d70/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:08,580 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 12:03:08,580 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 57c7ac6814f18d2541df5c154c377d70; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73944650, jitterRate=0.1018611490726471}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 12:03:08,580 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 57c7ac6814f18d2541df5c154c377d70: Writing region info on filesystem at 1675944188564Initializing all the Stores at 1675944188565 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944188565Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944188565Region opened successfully at 1675944188580 (+15 ms) 2023-02-09 12:03:08,620 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 57c7ac6814f18d2541df5c154c377d70, disabling compactions & flushes 2023-02-09 12:03:08,621 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1675944182259.57c7ac6814f18d2541df5c154c377d70. 2023-02-09 12:03:08,621 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1675944182259.57c7ac6814f18d2541df5c154c377d70. 2023-02-09 12:03:08,621 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1675944182259.57c7ac6814f18d2541df5c154c377d70. after waiting 0 ms 2023-02-09 12:03:08,621 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1675944182259.57c7ac6814f18d2541df5c154c377d70. 2023-02-09 12:03:08,622 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1675944182259.57c7ac6814f18d2541df5c154c377d70. 2023-02-09 12:03:08,622 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 57c7ac6814f18d2541df5c154c377d70: Waiting for close lock at 1675944188620Disabling compacts and flushes for region at 1675944188620Disabling writes for close at 1675944188621 (+1 ms)Writing region close event to WAL at 1675944188622 (+1 ms)Closed at 1675944188622 2023-02-09 12:03:08,625 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1675944182259.b9bd8844b5681299737e0a2f071b03f3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:08,626 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 12:03:08,627 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 12:03:08,629 INFO [StoreOpener-b9bd8844b5681299737e0a2f071b03f3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b9bd8844b5681299737e0a2f071b03f3 2023-02-09 12:03:08,630 DEBUG [StoreOpener-b9bd8844b5681299737e0a2f071b03f3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35677/user/jenkins/test-data/070b1f80-84b1-c9f1-7e89-c401c182e07a/testWithMapReduceAndOfflineHBaseMultiRegion/8aecd276-a74f-4ec3-b6ee-436ca6593d68/data/default/testWithMapReduce/b9bd8844b5681299737e0a2f071b03f3/f1 2023-02-09 12:03:08,631 INFO [StoreOpener-b9bd8844b5681299737e0a2f071b03f3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b9bd8844b5681299737e0a2f071b03f3 columnFamilyName f1 2023-02-09 12:03:08,636 DEBUG [StoreOpener-b9bd8844b5681299737e0a2f071b03f3-1] regionserver.HStore(539): loaded hdfs://localhost:35677/user/jenkins/test-data/070b1f80-84b1-c9f1-7e89-c401c182e07a/testWithMapReduceAndOfflineHBaseMultiRegion/8aecd276-a74f-4ec3-b6ee-436ca6593d68/data/default/testWithMapReduce/b9bd8844b5681299737e0a2f071b03f3/f1/testWithMapReduce=b9bd8844b5681299737e0a2f071b03f3-e1fc333643cf4ce6aa6a40f51341db4c 2023-02-09 12:03:08,636 INFO [StoreOpener-b9bd8844b5681299737e0a2f071b03f3-1] regionserver.HStore(310): Store=b9bd8844b5681299737e0a2f071b03f3/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:08,636 INFO [StoreOpener-b9bd8844b5681299737e0a2f071b03f3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b9bd8844b5681299737e0a2f071b03f3 2023-02-09 12:03:08,637 DEBUG [StoreOpener-b9bd8844b5681299737e0a2f071b03f3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35677/user/jenkins/test-data/070b1f80-84b1-c9f1-7e89-c401c182e07a/testWithMapReduceAndOfflineHBaseMultiRegion/8aecd276-a74f-4ec3-b6ee-436ca6593d68/data/default/testWithMapReduce/b9bd8844b5681299737e0a2f071b03f3/f2 2023-02-09 12:03:08,637 INFO [StoreOpener-b9bd8844b5681299737e0a2f071b03f3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b9bd8844b5681299737e0a2f071b03f3 columnFamilyName f2 2023-02-09 12:03:08,644 DEBUG [StoreOpener-b9bd8844b5681299737e0a2f071b03f3-1] regionserver.HStore(539): loaded hdfs://localhost:35677/user/jenkins/test-data/070b1f80-84b1-c9f1-7e89-c401c182e07a/testWithMapReduceAndOfflineHBaseMultiRegion/8aecd276-a74f-4ec3-b6ee-436ca6593d68/data/default/testWithMapReduce/b9bd8844b5681299737e0a2f071b03f3/f2/testWithMapReduce=b9bd8844b5681299737e0a2f071b03f3-b90588d8e9ec4f789fd4de90e25da9f3 2023-02-09 12:03:08,644 INFO [StoreOpener-b9bd8844b5681299737e0a2f071b03f3-1] regionserver.HStore(310): Store=b9bd8844b5681299737e0a2f071b03f3/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:08,644 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 12:03:08,645 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened b9bd8844b5681299737e0a2f071b03f3; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59638365, jitterRate=-0.11131910979747772}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 12:03:08,645 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for b9bd8844b5681299737e0a2f071b03f3: Writing region info on filesystem at 1675944188627Initializing all the Stores at 1675944188628 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944188628Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944188628Region opened successfully at 1675944188645 (+17 ms) 2023-02-09 12:03:08,676 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing b9bd8844b5681299737e0a2f071b03f3, disabling compactions & flushes 2023-02-09 12:03:08,676 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1675944182259.b9bd8844b5681299737e0a2f071b03f3. 2023-02-09 12:03:08,676 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1675944182259.b9bd8844b5681299737e0a2f071b03f3. 2023-02-09 12:03:08,676 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1675944182259.b9bd8844b5681299737e0a2f071b03f3. after waiting 0 ms 2023-02-09 12:03:08,676 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1675944182259.b9bd8844b5681299737e0a2f071b03f3. 2023-02-09 12:03:08,677 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1675944182259.b9bd8844b5681299737e0a2f071b03f3. 2023-02-09 12:03:08,677 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for b9bd8844b5681299737e0a2f071b03f3: Waiting for close lock at 1675944188676Disabling compacts and flushes for region at 1675944188676Disabling writes for close at 1675944188676Writing region close event to WAL at 1675944188677 (+1 ms)Closed at 1675944188677 2023-02-09 12:03:09,186 INFO [Listener at localhost/36513] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-09 12:03:09,186 WARN [Listener at localhost/36513] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-09 12:03:09,192 INFO [Listener at localhost/36513] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 12:03:09,294 WARN [BP-14533360-172.31.14.131-1675944180151 heartbeating to localhost/127.0.0.1:35677] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-09 12:03:09,296 WARN [BP-14533360-172.31.14.131-1675944180151 heartbeating to localhost/127.0.0.1:35677] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-14533360-172.31.14.131-1675944180151 (Datanode Uuid 82ff60a2-e703-4695-bd78-2998491c23c1) service to localhost/127.0.0.1:35677 2023-02-09 12:03:09,296 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4f4a1677-b9c2-11c9-6e72-f44b3a4b8222/cluster_20755aa6-e4e8-8b03-8c63-3e3f85986b3c/dfs/data/data3/current/BP-14533360-172.31.14.131-1675944180151] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 12:03:09,297 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4f4a1677-b9c2-11c9-6e72-f44b3a4b8222/cluster_20755aa6-e4e8-8b03-8c63-3e3f85986b3c/dfs/data/data4/current/BP-14533360-172.31.14.131-1675944180151] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 12:03:09,298 WARN [Listener at localhost/36513] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-09 12:03:09,300 INFO [Listener at localhost/36513] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 12:03:09,403 WARN [BP-14533360-172.31.14.131-1675944180151 heartbeating to localhost/127.0.0.1:35677] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-09 12:03:09,403 WARN [BP-14533360-172.31.14.131-1675944180151 heartbeating to localhost/127.0.0.1:35677] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-14533360-172.31.14.131-1675944180151 (Datanode Uuid eef49c46-bea1-4163-a4f4-3f56bcfccd25) service to localhost/127.0.0.1:35677 2023-02-09 12:03:09,404 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4f4a1677-b9c2-11c9-6e72-f44b3a4b8222/cluster_20755aa6-e4e8-8b03-8c63-3e3f85986b3c/dfs/data/data1/current/BP-14533360-172.31.14.131-1675944180151] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 12:03:09,404 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4f4a1677-b9c2-11c9-6e72-f44b3a4b8222/cluster_20755aa6-e4e8-8b03-8c63-3e3f85986b3c/dfs/data/data2/current/BP-14533360-172.31.14.131-1675944180151] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 12:03:09,415 INFO [Listener at localhost/36513] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 12:03:09,535 INFO [Listener at localhost/36513] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-09 12:03:09,577 INFO [Listener at localhost/36513] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-09 12:03:09,590 INFO [Listener at localhost/36513] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=157 (was 103) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:35677 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,37615,1675944180795)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:35677 from jenkins.hfs.2 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-7-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.3@localhost:35677 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.2@localhost:35677 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/36513 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: nioEventLoopGroup-7-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:35677 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-8-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: nioEventLoopGroup-6-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:35677 from jenkins.hfs.3 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-6-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'DataNode' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: RS-EventLoopGroup-6-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:35677 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=540 (was 543), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=275 (was 250) - SystemLoadAverage LEAK? -, ProcessCount=166 (was 166), AvailableMemoryMB=3556 (was 3695) 2023-02-09 12:03:09,600 INFO [Listener at localhost/36513] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=157, OpenFileDescriptor=540, MaxFileDescriptor=60000, SystemLoadAverage=275, ProcessCount=166, AvailableMemoryMB=3556 2023-02-09 12:03:09,610 INFO [Listener at localhost/36513] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4f4a1677-b9c2-11c9-6e72-f44b3a4b8222/hadoop.log.dir so I do NOT create it in target/test-data/6e44d3da-277b-421d-1f0e-72ff66653ed5 2023-02-09 12:03:09,610 WARN [Listener at localhost/36513] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4f4a1677-b9c2-11c9-6e72-f44b3a4b8222/hadoop.log.dir Erasing configuration value by system value. 2023-02-09 12:03:09,610 INFO [Listener at localhost/36513] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4f4a1677-b9c2-11c9-6e72-f44b3a4b8222/hadoop.tmp.dir so I do NOT create it in target/test-data/6e44d3da-277b-421d-1f0e-72ff66653ed5 2023-02-09 12:03:09,610 WARN [Listener at localhost/36513] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4f4a1677-b9c2-11c9-6e72-f44b3a4b8222/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-09 12:03:09,610 DEBUG [Listener at localhost/36513] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6e44d3da-277b-421d-1f0e-72ff66653ed5 2023-02-09 12:03:09,611 INFO [Listener at localhost/36513] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-09 12:03:09,611 INFO [Listener at localhost/36513] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6e44d3da-277b-421d-1f0e-72ff66653ed5/cluster_1899341e-5259-892b-3d81-c2edd2de3898, deleteOnExit=true 2023-02-09 12:03:09,611 INFO [Listener at localhost/36513] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-09 12:03:09,611 INFO [Listener at localhost/36513] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6e44d3da-277b-421d-1f0e-72ff66653ed5/test.cache.data in system properties and HBase conf 2023-02-09 12:03:09,611 INFO [Listener at localhost/36513] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6e44d3da-277b-421d-1f0e-72ff66653ed5/hadoop.tmp.dir in system properties and HBase conf 2023-02-09 12:03:09,611 INFO [Listener at localhost/36513] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6e44d3da-277b-421d-1f0e-72ff66653ed5/hadoop.log.dir in system properties and HBase conf 2023-02-09 12:03:09,611 INFO [Listener at localhost/36513] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6e44d3da-277b-421d-1f0e-72ff66653ed5/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-09 12:03:09,611 INFO [Listener at localhost/36513] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6e44d3da-277b-421d-1f0e-72ff66653ed5/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-09 12:03:09,611 INFO [Listener at localhost/36513] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-09 12:03:09,611 DEBUG [Listener at localhost/36513] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-09 12:03:09,612 INFO [Listener at localhost/36513] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6e44d3da-277b-421d-1f0e-72ff66653ed5/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-09 12:03:09,612 INFO [Listener at localhost/36513] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6e44d3da-277b-421d-1f0e-72ff66653ed5/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-09 12:03:09,612 INFO [Listener at localhost/36513] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6e44d3da-277b-421d-1f0e-72ff66653ed5/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-09 12:03:09,612 INFO [Listener at localhost/36513] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6e44d3da-277b-421d-1f0e-72ff66653ed5/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-09 12:03:09,612 INFO [Listener at localhost/36513] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6e44d3da-277b-421d-1f0e-72ff66653ed5/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-09 12:03:09,612 INFO [Listener at localhost/36513] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6e44d3da-277b-421d-1f0e-72ff66653ed5/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-09 12:03:09,612 INFO [Listener at localhost/36513] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6e44d3da-277b-421d-1f0e-72ff66653ed5/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-09 12:03:09,612 INFO [Listener at localhost/36513] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6e44d3da-277b-421d-1f0e-72ff66653ed5/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-09 12:03:09,612 INFO [Listener at localhost/36513] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6e44d3da-277b-421d-1f0e-72ff66653ed5/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-09 12:03:09,612 INFO [Listener at localhost/36513] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6e44d3da-277b-421d-1f0e-72ff66653ed5/nfs.dump.dir in system properties and HBase conf 2023-02-09 12:03:09,613 INFO [Listener at localhost/36513] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6e44d3da-277b-421d-1f0e-72ff66653ed5/java.io.tmpdir in system properties and HBase conf 2023-02-09 12:03:09,613 INFO [Listener at localhost/36513] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6e44d3da-277b-421d-1f0e-72ff66653ed5/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-09 12:03:09,613 INFO [Listener at localhost/36513] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6e44d3da-277b-421d-1f0e-72ff66653ed5/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-09 12:03:09,613 INFO [Listener at localhost/36513] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6e44d3da-277b-421d-1f0e-72ff66653ed5/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-09 12:03:09,617 WARN [Listener at localhost/36513] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-09 12:03:09,617 WARN [Listener at localhost/36513] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-09 12:03:09,656 WARN [Listener at localhost/36513] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 12:03:09,659 INFO [Listener at localhost/36513] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 12:03:09,665 INFO [Listener at localhost/36513] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6e44d3da-277b-421d-1f0e-72ff66653ed5/java.io.tmpdir/Jetty_localhost_46327_hdfs____.yfy1r4/webapp 2023-02-09 12:03:09,760 INFO [Listener at localhost/36513] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46327 2023-02-09 12:03:09,764 WARN [Listener at localhost/36513] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-09 12:03:09,765 WARN [Listener at localhost/36513] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-09 12:03:09,807 WARN [Listener at localhost/37835] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 12:03:09,823 WARN [Listener at localhost/37835] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-09 12:03:09,826 WARN [Listener at localhost/37835] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 12:03:09,827 INFO [Listener at localhost/37835] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 12:03:09,831 INFO [Listener at localhost/37835] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6e44d3da-277b-421d-1f0e-72ff66653ed5/java.io.tmpdir/Jetty_localhost_37415_datanode____.18lmsl/webapp 2023-02-09 12:03:09,925 INFO [Listener at localhost/37835] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37415 2023-02-09 12:03:09,931 WARN [Listener at localhost/45119] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 12:03:09,947 WARN [Listener at localhost/45119] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-09 12:03:09,950 WARN [Listener at localhost/45119] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 12:03:09,951 INFO [Listener at localhost/45119] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 12:03:09,955 INFO [Listener at localhost/45119] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6e44d3da-277b-421d-1f0e-72ff66653ed5/java.io.tmpdir/Jetty_localhost_34895_datanode____.e3kv9i/webapp 2023-02-09 12:03:10,025 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x90c0496f7a78732c: Processing first storage report for DS-2538eef9-de8d-4478-a59e-d4efe09cd811 from datanode a24f0230-e059-4a22-8aab-cfeca300bda5 2023-02-09 12:03:10,025 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x90c0496f7a78732c: from storage DS-2538eef9-de8d-4478-a59e-d4efe09cd811 node DatanodeRegistration(127.0.0.1:41831, datanodeUuid=a24f0230-e059-4a22-8aab-cfeca300bda5, infoPort=35513, infoSecurePort=0, ipcPort=45119, storageInfo=lv=-57;cid=testClusterID;nsid=1363464203;c=1675944189619), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 12:03:10,025 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x90c0496f7a78732c: Processing first storage report for DS-d947e1da-dbb5-4a8a-890a-e37189803d31 from datanode a24f0230-e059-4a22-8aab-cfeca300bda5 2023-02-09 12:03:10,025 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x90c0496f7a78732c: from storage DS-d947e1da-dbb5-4a8a-890a-e37189803d31 node DatanodeRegistration(127.0.0.1:41831, datanodeUuid=a24f0230-e059-4a22-8aab-cfeca300bda5, infoPort=35513, infoSecurePort=0, ipcPort=45119, storageInfo=lv=-57;cid=testClusterID;nsid=1363464203;c=1675944189619), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 12:03:10,053 INFO [Listener at localhost/45119] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34895 2023-02-09 12:03:10,061 WARN [Listener at localhost/42145] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 12:03:10,158 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xa64b447d614c427a: Processing first storage report for DS-6871f59e-874b-4210-9de7-27604d93f96b from datanode 5e030390-a5e3-46ff-93c3-52b6043f4f12 2023-02-09 12:03:10,158 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xa64b447d614c427a: from storage DS-6871f59e-874b-4210-9de7-27604d93f96b node DatanodeRegistration(127.0.0.1:40529, datanodeUuid=5e030390-a5e3-46ff-93c3-52b6043f4f12, infoPort=33351, infoSecurePort=0, ipcPort=42145, storageInfo=lv=-57;cid=testClusterID;nsid=1363464203;c=1675944189619), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 12:03:10,158 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xa64b447d614c427a: Processing first storage report for DS-6a8a76a7-eb7c-4b9e-97fe-2e822058cb18 from datanode 5e030390-a5e3-46ff-93c3-52b6043f4f12 2023-02-09 12:03:10,158 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xa64b447d614c427a: from storage DS-6a8a76a7-eb7c-4b9e-97fe-2e822058cb18 node DatanodeRegistration(127.0.0.1:40529, datanodeUuid=5e030390-a5e3-46ff-93c3-52b6043f4f12, infoPort=33351, infoSecurePort=0, ipcPort=42145, storageInfo=lv=-57;cid=testClusterID;nsid=1363464203;c=1675944189619), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 12:03:10,175 DEBUG [Listener at localhost/42145] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6e44d3da-277b-421d-1f0e-72ff66653ed5 2023-02-09 12:03:10,177 INFO [Listener at localhost/42145] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6e44d3da-277b-421d-1f0e-72ff66653ed5/cluster_1899341e-5259-892b-3d81-c2edd2de3898/zookeeper_0, clientPort=55305, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6e44d3da-277b-421d-1f0e-72ff66653ed5/cluster_1899341e-5259-892b-3d81-c2edd2de3898/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6e44d3da-277b-421d-1f0e-72ff66653ed5/cluster_1899341e-5259-892b-3d81-c2edd2de3898/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-09 12:03:10,178 INFO [Listener at localhost/42145] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=55305 2023-02-09 12:03:10,178 INFO [Listener at localhost/42145] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 12:03:10,179 INFO [Listener at localhost/42145] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 12:03:10,192 INFO [Listener at localhost/42145] util.FSUtils(479): Created version file at hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5 with version=8 2023-02-09 12:03:10,192 INFO [Listener at localhost/42145] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 12:03:10,193 INFO [Listener at localhost/42145] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 12:03:10,194 INFO [Listener at localhost/42145] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:37835/user/jenkins/test-data/ce8a350a-5bc7-c072-c50e-5bb44ffebfd5/hbase-staging 2023-02-09 12:03:10,195 INFO [Listener at localhost/42145] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 12:03:10,195 INFO [Listener at localhost/42145] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 12:03:10,196 INFO [Listener at localhost/42145] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 12:03:10,196 INFO [Listener at localhost/42145] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 12:03:10,196 INFO [Listener at localhost/42145] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 12:03:10,196 INFO [Listener at localhost/42145] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 12:03:10,196 INFO [Listener at localhost/42145] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 12:03:10,197 INFO [Listener at localhost/42145] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41197 2023-02-09 12:03:10,197 INFO [Listener at localhost/42145] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 12:03:10,198 INFO [Listener at localhost/42145] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 12:03:10,199 INFO [Listener at localhost/42145] zookeeper.RecoverableZooKeeper(93): Process identifier=master:41197 connecting to ZooKeeper ensemble=127.0.0.1:55305 2023-02-09 12:03:10,206 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): master:411970x0, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 12:03:10,208 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:41197-0x10038f6caa60000 connected 2023-02-09 12:03:10,222 DEBUG [Listener at localhost/42145] zookeeper.ZKUtil(164): master:41197-0x10038f6caa60000, quorum=127.0.0.1:55305, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 12:03:10,223 DEBUG [Listener at localhost/42145] zookeeper.ZKUtil(164): master:41197-0x10038f6caa60000, quorum=127.0.0.1:55305, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 12:03:10,223 DEBUG [Listener at localhost/42145] zookeeper.ZKUtil(164): master:41197-0x10038f6caa60000, quorum=127.0.0.1:55305, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 12:03:10,223 DEBUG [Listener at localhost/42145] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41197 2023-02-09 12:03:10,223 DEBUG [Listener at localhost/42145] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41197 2023-02-09 12:03:10,224 DEBUG [Listener at localhost/42145] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41197 2023-02-09 12:03:10,227 DEBUG [Listener at localhost/42145] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41197 2023-02-09 12:03:10,228 DEBUG [Listener at localhost/42145] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41197 2023-02-09 12:03:10,228 INFO [Listener at localhost/42145] master.HMaster(439): hbase.rootdir=hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5, hbase.cluster.distributed=false 2023-02-09 12:03:10,240 INFO [Listener at localhost/42145] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 12:03:10,240 INFO [Listener at localhost/42145] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 12:03:10,240 INFO [Listener at localhost/42145] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 12:03:10,240 INFO [Listener at localhost/42145] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 12:03:10,240 INFO [Listener at localhost/42145] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 12:03:10,240 INFO [Listener at localhost/42145] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 12:03:10,240 INFO [Listener at localhost/42145] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 12:03:10,243 INFO [Listener at localhost/42145] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38709 2023-02-09 12:03:10,243 INFO [Listener at localhost/42145] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-09 12:03:10,246 DEBUG [Listener at localhost/42145] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 12:03:10,247 INFO [Listener at localhost/42145] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 12:03:10,248 INFO [Listener at localhost/42145] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 12:03:10,249 INFO [Listener at localhost/42145] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38709 connecting to ZooKeeper ensemble=127.0.0.1:55305 2023-02-09 12:03:10,251 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): regionserver:387090x0, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 12:03:10,253 DEBUG [Listener at localhost/42145] zookeeper.ZKUtil(164): regionserver:387090x0, quorum=127.0.0.1:55305, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 12:03:10,253 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:38709-0x10038f6caa60001 connected 2023-02-09 12:03:10,254 DEBUG [Listener at localhost/42145] zookeeper.ZKUtil(164): regionserver:38709-0x10038f6caa60001, quorum=127.0.0.1:55305, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 12:03:10,255 DEBUG [Listener at localhost/42145] zookeeper.ZKUtil(164): regionserver:38709-0x10038f6caa60001, quorum=127.0.0.1:55305, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 12:03:10,255 DEBUG [Listener at localhost/42145] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38709 2023-02-09 12:03:10,255 DEBUG [Listener at localhost/42145] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38709 2023-02-09 12:03:10,256 DEBUG [Listener at localhost/42145] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38709 2023-02-09 12:03:10,260 DEBUG [Listener at localhost/42145] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38709 2023-02-09 12:03:10,260 DEBUG [Listener at localhost/42145] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38709 2023-02-09 12:03:10,271 INFO [Listener at localhost/42145] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 12:03:10,271 INFO [Listener at localhost/42145] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 12:03:10,271 INFO [Listener at localhost/42145] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 12:03:10,271 INFO [Listener at localhost/42145] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 12:03:10,271 INFO [Listener at localhost/42145] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 12:03:10,271 INFO [Listener at localhost/42145] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 12:03:10,271 INFO [Listener at localhost/42145] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 12:03:10,272 INFO [Listener at localhost/42145] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34509 2023-02-09 12:03:10,273 INFO [Listener at localhost/42145] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-09 12:03:10,273 DEBUG [Listener at localhost/42145] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 12:03:10,274 INFO [Listener at localhost/42145] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 12:03:10,275 INFO [Listener at localhost/42145] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 12:03:10,275 INFO [Listener at localhost/42145] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34509 connecting to ZooKeeper ensemble=127.0.0.1:55305 2023-02-09 12:03:10,278 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): regionserver:345090x0, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 12:03:10,280 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:34509-0x10038f6caa60002 connected 2023-02-09 12:03:10,280 DEBUG [Listener at localhost/42145] zookeeper.ZKUtil(164): regionserver:34509-0x10038f6caa60002, quorum=127.0.0.1:55305, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 12:03:10,280 DEBUG [Listener at localhost/42145] zookeeper.ZKUtil(164): regionserver:34509-0x10038f6caa60002, quorum=127.0.0.1:55305, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 12:03:10,281 DEBUG [Listener at localhost/42145] zookeeper.ZKUtil(164): regionserver:34509-0x10038f6caa60002, quorum=127.0.0.1:55305, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 12:03:10,284 DEBUG [Listener at localhost/42145] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34509 2023-02-09 12:03:10,284 DEBUG [Listener at localhost/42145] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34509 2023-02-09 12:03:10,284 DEBUG [Listener at localhost/42145] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34509 2023-02-09 12:03:10,287 DEBUG [Listener at localhost/42145] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34509 2023-02-09 12:03:10,287 DEBUG [Listener at localhost/42145] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34509 2023-02-09 12:03:10,288 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,41197,1675944190195 2023-02-09 12:03:10,290 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): master:41197-0x10038f6caa60000, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-09 12:03:10,291 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41197-0x10038f6caa60000, quorum=127.0.0.1:55305, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,41197,1675944190195 2023-02-09 12:03:10,292 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): regionserver:34509-0x10038f6caa60002, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 12:03:10,292 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): regionserver:38709-0x10038f6caa60001, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 12:03:10,292 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): master:41197-0x10038f6caa60000, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 12:03:10,293 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): master:41197-0x10038f6caa60000, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 12:03:10,294 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41197-0x10038f6caa60000, quorum=127.0.0.1:55305, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-09 12:03:10,295 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:41197-0x10038f6caa60000, quorum=127.0.0.1:55305, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-09 12:03:10,295 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,41197,1675944190195 from backup master directory 2023-02-09 12:03:10,296 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): master:41197-0x10038f6caa60000, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,41197,1675944190195 2023-02-09 12:03:10,296 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): master:41197-0x10038f6caa60000, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-09 12:03:10,296 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 12:03:10,296 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,41197,1675944190195 2023-02-09 12:03:10,310 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/hbase.id with ID: e29dd054-bea5-461a-97e0-026a2faf7ea5 2023-02-09 12:03:10,320 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 12:03:10,322 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): master:41197-0x10038f6caa60000, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 12:03:10,329 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x5697b87d to 127.0.0.1:55305 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 12:03:10,338 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1bdb509e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 12:03:10,338 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-09 12:03:10,338 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-09 12:03:10,338 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 12:03:10,340 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/MasterData/data/master/store-tmp 2023-02-09 12:03:10,349 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:10,349 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-09 12:03:10,349 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 12:03:10,349 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 12:03:10,349 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-09 12:03:10,349 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 12:03:10,349 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 12:03:10,349 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675944190349Disabling compacts and flushes for region at 1675944190349Disabling writes for close at 1675944190349Writing region close event to WAL at 1675944190349Closed at 1675944190349 2023-02-09 12:03:10,350 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/MasterData/WALs/jenkins-hbase4.apache.org,41197,1675944190195 2023-02-09 12:03:10,352 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41197%2C1675944190195, suffix=, logDir=hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/MasterData/WALs/jenkins-hbase4.apache.org,41197,1675944190195, archiveDir=hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/MasterData/oldWALs, maxLogs=10 2023-02-09 12:03:10,374 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40529,DS-6871f59e-874b-4210-9de7-27604d93f96b,DISK] 2023-02-09 12:03:10,375 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41831,DS-2538eef9-de8d-4478-a59e-d4efe09cd811,DISK] 2023-02-09 12:03:10,377 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/MasterData/WALs/jenkins-hbase4.apache.org,41197,1675944190195/jenkins-hbase4.apache.org%2C41197%2C1675944190195.1675944190353 2023-02-09 12:03:10,377 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40529,DS-6871f59e-874b-4210-9de7-27604d93f96b,DISK], DatanodeInfoWithStorage[127.0.0.1:41831,DS-2538eef9-de8d-4478-a59e-d4efe09cd811,DISK]] 2023-02-09 12:03:10,377 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-09 12:03:10,377 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:10,377 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 12:03:10,377 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 12:03:10,378 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-09 12:03:10,380 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-09 12:03:10,380 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-09 12:03:10,381 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:10,381 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-09 12:03:10,382 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-09 12:03:10,384 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 12:03:10,385 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 12:03:10,386 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72825174, jitterRate=0.0851796567440033}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 12:03:10,386 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1675944190377Initializing all the Stores at 1675944190378 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944190378Cleaning up temporary data from old regions at 1675944190382 (+4 ms)Cleaning up detritus from prior splits at 1675944190382Region opened successfully at 1675944190386 (+4 ms) 2023-02-09 12:03:10,386 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-09 12:03:10,387 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-09 12:03:10,387 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-09 12:03:10,387 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-09 12:03:10,388 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-09 12:03:10,388 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-09 12:03:10,388 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-09 12:03:10,391 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-09 12:03:10,392 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-09 12:03:10,402 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-09 12:03:10,402 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-09 12:03:10,403 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41197-0x10038f6caa60000, quorum=127.0.0.1:55305, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-09 12:03:10,403 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-09 12:03:10,403 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41197-0x10038f6caa60000, quorum=127.0.0.1:55305, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-09 12:03:10,405 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): master:41197-0x10038f6caa60000, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 12:03:10,405 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41197-0x10038f6caa60000, quorum=127.0.0.1:55305, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-09 12:03:10,406 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41197-0x10038f6caa60000, quorum=127.0.0.1:55305, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-09 12:03:10,406 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41197-0x10038f6caa60000, quorum=127.0.0.1:55305, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-09 12:03:10,408 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): master:41197-0x10038f6caa60000, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 12:03:10,408 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): regionserver:38709-0x10038f6caa60001, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 12:03:10,408 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): master:41197-0x10038f6caa60000, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 12:03:10,408 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): regionserver:34509-0x10038f6caa60002, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 12:03:10,408 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,41197,1675944190195, sessionid=0x10038f6caa60000, setting cluster-up flag (Was=false) 2023-02-09 12:03:10,413 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): master:41197-0x10038f6caa60000, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 12:03:10,416 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-09 12:03:10,417 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,41197,1675944190195 2023-02-09 12:03:10,426 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): master:41197-0x10038f6caa60000, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 12:03:10,430 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-09 12:03:10,431 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,41197,1675944190195 2023-02-09 12:03:10,431 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/.hbase-snapshot/.tmp 2023-02-09 12:03:10,433 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-09 12:03:10,433 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 12:03:10,433 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 12:03:10,433 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 12:03:10,433 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 12:03:10,433 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-09 12:03:10,433 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:10,433 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 12:03:10,433 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:10,435 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1675944220435 2023-02-09 12:03:10,435 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-09 12:03:10,436 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-09 12:03:10,436 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-09 12:03:10,436 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-09 12:03:10,436 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-09 12:03:10,436 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-09 12:03:10,436 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-09 12:03:10,436 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-09 12:03:10,437 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-09 12:03:10,440 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:10,442 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-09 12:03:10,442 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-09 12:03:10,442 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-09 12:03:10,442 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-09 12:03:10,443 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-09 12:03:10,443 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675944190443,5,FailOnTimeoutGroup] 2023-02-09 12:03:10,443 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675944190443,5,FailOnTimeoutGroup] 2023-02-09 12:03:10,443 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:10,443 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-09 12:03:10,443 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:10,443 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:10,451 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-09 12:03:10,451 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-09 12:03:10,451 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5 2023-02-09 12:03:10,460 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:10,461 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-09 12:03:10,462 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/data/hbase/meta/1588230740/info 2023-02-09 12:03:10,463 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-09 12:03:10,463 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:10,463 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-09 12:03:10,464 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/data/hbase/meta/1588230740/rep_barrier 2023-02-09 12:03:10,465 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-09 12:03:10,465 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:10,465 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-09 12:03:10,466 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/data/hbase/meta/1588230740/table 2023-02-09 12:03:10,466 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-09 12:03:10,466 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:10,467 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/data/hbase/meta/1588230740 2023-02-09 12:03:10,467 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/data/hbase/meta/1588230740 2023-02-09 12:03:10,469 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-09 12:03:10,470 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-09 12:03:10,471 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 12:03:10,472 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60463695, jitterRate=-0.09902073442935944}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-09 12:03:10,472 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1675944190460Initializing all the Stores at 1675944190461 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675944190461Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944190461Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675944190461Cleaning up temporary data from old regions at 1675944190468 (+7 ms)Cleaning up detritus from prior splits at 1675944190468Region opened successfully at 1675944190472 (+4 ms) 2023-02-09 12:03:10,472 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-09 12:03:10,472 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-09 12:03:10,472 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-09 12:03:10,472 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-09 12:03:10,472 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-09 12:03:10,472 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-09 12:03:10,472 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675944190472Disabling compacts and flushes for region at 1675944190472Disabling writes for close at 1675944190472Writing region close event to WAL at 1675944190472Closed at 1675944190472 2023-02-09 12:03:10,473 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-09 12:03:10,473 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-09 12:03:10,473 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-09 12:03:10,475 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-09 12:03:10,479 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-09 12:03:10,489 INFO [RS:0;jenkins-hbase4:38709] regionserver.HRegionServer(952): ClusterId : e29dd054-bea5-461a-97e0-026a2faf7ea5 2023-02-09 12:03:10,489 INFO [RS:1;jenkins-hbase4:34509] regionserver.HRegionServer(952): ClusterId : e29dd054-bea5-461a-97e0-026a2faf7ea5 2023-02-09 12:03:10,489 DEBUG [RS:0;jenkins-hbase4:38709] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-09 12:03:10,489 DEBUG [RS:1;jenkins-hbase4:34509] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-09 12:03:10,491 DEBUG [RS:0;jenkins-hbase4:38709] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-09 12:03:10,492 DEBUG [RS:0;jenkins-hbase4:38709] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-09 12:03:10,492 DEBUG [RS:1;jenkins-hbase4:34509] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-09 12:03:10,492 DEBUG [RS:1;jenkins-hbase4:34509] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-09 12:03:10,495 DEBUG [RS:0;jenkins-hbase4:38709] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-09 12:03:10,496 DEBUG [RS:0;jenkins-hbase4:38709] zookeeper.ReadOnlyZKClient(139): Connect 0x32cbc5cf to 127.0.0.1:55305 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 12:03:10,496 DEBUG [RS:1;jenkins-hbase4:34509] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-09 12:03:10,497 DEBUG [RS:1;jenkins-hbase4:34509] zookeeper.ReadOnlyZKClient(139): Connect 0x58c2741a to 127.0.0.1:55305 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 12:03:10,502 DEBUG [RS:0;jenkins-hbase4:38709] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3c0c3de6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 12:03:10,502 DEBUG [RS:1;jenkins-hbase4:34509] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@56059172, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 12:03:10,502 DEBUG [RS:0;jenkins-hbase4:38709] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3833aebf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 12:03:10,502 DEBUG [RS:1;jenkins-hbase4:34509] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@523a1f6a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 12:03:10,511 DEBUG [RS:1;jenkins-hbase4:34509] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:34509 2023-02-09 12:03:10,511 INFO [RS:1;jenkins-hbase4:34509] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-09 12:03:10,511 INFO [RS:1;jenkins-hbase4:34509] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-09 12:03:10,511 DEBUG [RS:1;jenkins-hbase4:34509] regionserver.HRegionServer(1023): About to register with Master. 2023-02-09 12:03:10,511 INFO [RS:1;jenkins-hbase4:34509] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,41197,1675944190195 with isa=jenkins-hbase4.apache.org/172.31.14.131:34509, startcode=1675944190270 2023-02-09 12:03:10,511 DEBUG [RS:1;jenkins-hbase4:34509] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-09 12:03:10,513 INFO [RS-EventLoopGroup-9-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54357, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.5 (auth:SIMPLE), service=RegionServerStatusService 2023-02-09 12:03:10,514 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41197] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,34509,1675944190270 2023-02-09 12:03:10,515 DEBUG [RS:1;jenkins-hbase4:34509] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5 2023-02-09 12:03:10,515 DEBUG [RS:1;jenkins-hbase4:34509] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:37835 2023-02-09 12:03:10,515 DEBUG [RS:1;jenkins-hbase4:34509] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-09 12:03:10,515 DEBUG [RS:0;jenkins-hbase4:38709] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:38709 2023-02-09 12:03:10,515 INFO [RS:0;jenkins-hbase4:38709] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-09 12:03:10,515 INFO [RS:0;jenkins-hbase4:38709] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-09 12:03:10,515 DEBUG [RS:0;jenkins-hbase4:38709] regionserver.HRegionServer(1023): About to register with Master. 2023-02-09 12:03:10,516 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): master:41197-0x10038f6caa60000, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 12:03:10,516 INFO [RS:0;jenkins-hbase4:38709] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,41197,1675944190195 with isa=jenkins-hbase4.apache.org/172.31.14.131:38709, startcode=1675944190239 2023-02-09 12:03:10,516 DEBUG [RS:0;jenkins-hbase4:38709] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-09 12:03:10,516 DEBUG [RS:1;jenkins-hbase4:34509] zookeeper.ZKUtil(162): regionserver:34509-0x10038f6caa60002, quorum=127.0.0.1:55305, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34509,1675944190270 2023-02-09 12:03:10,517 WARN [RS:1;jenkins-hbase4:34509] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 12:03:10,517 INFO [RS:1;jenkins-hbase4:34509] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 12:03:10,517 DEBUG [RS:1;jenkins-hbase4:34509] regionserver.HRegionServer(1947): logDir=hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/WALs/jenkins-hbase4.apache.org,34509,1675944190270 2023-02-09 12:03:10,517 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,34509,1675944190270] 2023-02-09 12:03:10,520 INFO [RS-EventLoopGroup-9-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59139, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.4 (auth:SIMPLE), service=RegionServerStatusService 2023-02-09 12:03:10,521 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41197] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,38709,1675944190239 2023-02-09 12:03:10,521 DEBUG [RS:1;jenkins-hbase4:34509] zookeeper.ZKUtil(162): regionserver:34509-0x10038f6caa60002, quorum=127.0.0.1:55305, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34509,1675944190270 2023-02-09 12:03:10,522 DEBUG [RS:1;jenkins-hbase4:34509] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-09 12:03:10,522 DEBUG [RS:0;jenkins-hbase4:38709] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5 2023-02-09 12:03:10,522 INFO [RS:1;jenkins-hbase4:34509] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-09 12:03:10,522 DEBUG [RS:0;jenkins-hbase4:38709] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:37835 2023-02-09 12:03:10,522 DEBUG [RS:0;jenkins-hbase4:38709] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-09 12:03:10,527 INFO [RS:1;jenkins-hbase4:34509] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-09 12:03:10,527 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): master:41197-0x10038f6caa60000, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 12:03:10,527 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): regionserver:34509-0x10038f6caa60002, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 12:03:10,527 INFO [RS:1;jenkins-hbase4:34509] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 12:03:10,527 INFO [RS:1;jenkins-hbase4:34509] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:10,527 INFO [RS:1;jenkins-hbase4:34509] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-09 12:03:10,527 DEBUG [RS:0;jenkins-hbase4:38709] zookeeper.ZKUtil(162): regionserver:38709-0x10038f6caa60001, quorum=127.0.0.1:55305, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38709,1675944190239 2023-02-09 12:03:10,528 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,38709,1675944190239] 2023-02-09 12:03:10,528 WARN [RS:0;jenkins-hbase4:38709] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 12:03:10,528 INFO [RS:0;jenkins-hbase4:38709] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 12:03:10,528 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:34509-0x10038f6caa60002, quorum=127.0.0.1:55305, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34509,1675944190270 2023-02-09 12:03:10,529 DEBUG [RS:0;jenkins-hbase4:38709] regionserver.HRegionServer(1947): logDir=hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/WALs/jenkins-hbase4.apache.org,38709,1675944190239 2023-02-09 12:03:10,529 INFO [RS:1;jenkins-hbase4:34509] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:10,529 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:34509-0x10038f6caa60002, quorum=127.0.0.1:55305, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38709,1675944190239 2023-02-09 12:03:10,529 DEBUG [RS:1;jenkins-hbase4:34509] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:10,529 DEBUG [RS:1;jenkins-hbase4:34509] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:10,529 DEBUG [RS:1;jenkins-hbase4:34509] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:10,529 DEBUG [RS:1;jenkins-hbase4:34509] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:10,529 DEBUG [RS:1;jenkins-hbase4:34509] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:10,529 DEBUG [RS:1;jenkins-hbase4:34509] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 12:03:10,529 DEBUG [RS:1;jenkins-hbase4:34509] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:10,529 DEBUG [RS:1;jenkins-hbase4:34509] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:10,529 DEBUG [RS:1;jenkins-hbase4:34509] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:10,529 DEBUG [RS:1;jenkins-hbase4:34509] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:10,536 INFO [RS:1;jenkins-hbase4:34509] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:10,536 INFO [RS:1;jenkins-hbase4:34509] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:10,537 INFO [RS:1;jenkins-hbase4:34509] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:10,538 DEBUG [RS:0;jenkins-hbase4:38709] zookeeper.ZKUtil(162): regionserver:38709-0x10038f6caa60001, quorum=127.0.0.1:55305, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34509,1675944190270 2023-02-09 12:03:10,539 DEBUG [RS:0;jenkins-hbase4:38709] zookeeper.ZKUtil(162): regionserver:38709-0x10038f6caa60001, quorum=127.0.0.1:55305, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38709,1675944190239 2023-02-09 12:03:10,539 DEBUG [RS:0;jenkins-hbase4:38709] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-09 12:03:10,540 INFO [RS:0;jenkins-hbase4:38709] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-09 12:03:10,541 INFO [RS:0;jenkins-hbase4:38709] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-09 12:03:10,541 INFO [RS:0;jenkins-hbase4:38709] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 12:03:10,541 INFO [RS:0;jenkins-hbase4:38709] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:10,544 INFO [RS:0;jenkins-hbase4:38709] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-09 12:03:10,545 INFO [RS:0;jenkins-hbase4:38709] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:10,546 DEBUG [RS:0;jenkins-hbase4:38709] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:10,546 DEBUG [RS:0;jenkins-hbase4:38709] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:10,546 DEBUG [RS:0;jenkins-hbase4:38709] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:10,546 DEBUG [RS:0;jenkins-hbase4:38709] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:10,546 DEBUG [RS:0;jenkins-hbase4:38709] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:10,546 DEBUG [RS:0;jenkins-hbase4:38709] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 12:03:10,546 DEBUG [RS:0;jenkins-hbase4:38709] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:10,546 DEBUG [RS:0;jenkins-hbase4:38709] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:10,546 DEBUG [RS:0;jenkins-hbase4:38709] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:10,546 DEBUG [RS:0;jenkins-hbase4:38709] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:10,548 INFO [RS:0;jenkins-hbase4:38709] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:10,548 INFO [RS:0;jenkins-hbase4:38709] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:10,548 INFO [RS:0;jenkins-hbase4:38709] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:10,550 INFO [RS:1;jenkins-hbase4:34509] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-09 12:03:10,550 INFO [RS:1;jenkins-hbase4:34509] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34509,1675944190270-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:10,558 INFO [RS:0;jenkins-hbase4:38709] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-09 12:03:10,558 INFO [RS:0;jenkins-hbase4:38709] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38709,1675944190239-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:10,566 INFO [RS:1;jenkins-hbase4:34509] regionserver.Replication(203): jenkins-hbase4.apache.org,34509,1675944190270 started 2023-02-09 12:03:10,566 INFO [RS:1;jenkins-hbase4:34509] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,34509,1675944190270, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:34509, sessionid=0x10038f6caa60002 2023-02-09 12:03:10,566 DEBUG [RS:1;jenkins-hbase4:34509] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-09 12:03:10,566 DEBUG [RS:1;jenkins-hbase4:34509] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,34509,1675944190270 2023-02-09 12:03:10,566 DEBUG [RS:1;jenkins-hbase4:34509] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34509,1675944190270' 2023-02-09 12:03:10,566 DEBUG [RS:1;jenkins-hbase4:34509] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 12:03:10,566 DEBUG [RS:1;jenkins-hbase4:34509] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 12:03:10,567 DEBUG [RS:1;jenkins-hbase4:34509] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-09 12:03:10,567 DEBUG [RS:1;jenkins-hbase4:34509] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-09 12:03:10,567 DEBUG [RS:1;jenkins-hbase4:34509] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,34509,1675944190270 2023-02-09 12:03:10,567 DEBUG [RS:1;jenkins-hbase4:34509] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34509,1675944190270' 2023-02-09 12:03:10,567 DEBUG [RS:1;jenkins-hbase4:34509] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 12:03:10,567 DEBUG [RS:1;jenkins-hbase4:34509] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 12:03:10,567 DEBUG [RS:1;jenkins-hbase4:34509] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-09 12:03:10,567 INFO [RS:1;jenkins-hbase4:34509] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-09 12:03:10,568 INFO [RS:1;jenkins-hbase4:34509] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-09 12:03:10,568 INFO [RS:0;jenkins-hbase4:38709] regionserver.Replication(203): jenkins-hbase4.apache.org,38709,1675944190239 started 2023-02-09 12:03:10,568 INFO [RS:0;jenkins-hbase4:38709] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,38709,1675944190239, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:38709, sessionid=0x10038f6caa60001 2023-02-09 12:03:10,568 DEBUG [RS:0;jenkins-hbase4:38709] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-09 12:03:10,568 DEBUG [RS:0;jenkins-hbase4:38709] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,38709,1675944190239 2023-02-09 12:03:10,568 DEBUG [RS:0;jenkins-hbase4:38709] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38709,1675944190239' 2023-02-09 12:03:10,568 DEBUG [RS:0;jenkins-hbase4:38709] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 12:03:10,568 DEBUG [RS:0;jenkins-hbase4:38709] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 12:03:10,569 DEBUG [RS:0;jenkins-hbase4:38709] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-09 12:03:10,569 DEBUG [RS:0;jenkins-hbase4:38709] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-09 12:03:10,569 DEBUG [RS:0;jenkins-hbase4:38709] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,38709,1675944190239 2023-02-09 12:03:10,569 DEBUG [RS:0;jenkins-hbase4:38709] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38709,1675944190239' 2023-02-09 12:03:10,569 DEBUG [RS:0;jenkins-hbase4:38709] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 12:03:10,569 DEBUG [RS:0;jenkins-hbase4:38709] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 12:03:10,569 DEBUG [RS:0;jenkins-hbase4:38709] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-09 12:03:10,569 INFO [RS:0;jenkins-hbase4:38709] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-09 12:03:10,569 INFO [RS:0;jenkins-hbase4:38709] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-09 12:03:10,630 DEBUG [jenkins-hbase4:41197] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-09 12:03:10,630 DEBUG [jenkins-hbase4:41197] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 12:03:10,631 DEBUG [jenkins-hbase4:41197] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 12:03:10,631 DEBUG [jenkins-hbase4:41197] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 12:03:10,631 DEBUG [jenkins-hbase4:41197] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 12:03:10,633 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38709,1675944190239, state=OPENING 2023-02-09 12:03:10,634 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-09 12:03:10,635 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): master:41197-0x10038f6caa60000, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 12:03:10,635 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-09 12:03:10,635 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38709,1675944190239}] 2023-02-09 12:03:10,789 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,38709,1675944190239 2023-02-09 12:03:10,789 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-09 12:03:10,791 INFO [RS-EventLoopGroup-10-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45940, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-09 12:03:10,797 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-09 12:03:10,797 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 12:03:10,798 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38709%2C1675944190239.meta, suffix=.meta, logDir=hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/WALs/jenkins-hbase4.apache.org,38709,1675944190239, archiveDir=hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/oldWALs, maxLogs=32 2023-02-09 12:03:10,816 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41831,DS-2538eef9-de8d-4478-a59e-d4efe09cd811,DISK] 2023-02-09 12:03:10,816 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40529,DS-6871f59e-874b-4210-9de7-27604d93f96b,DISK] 2023-02-09 12:03:10,818 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/WALs/jenkins-hbase4.apache.org,38709,1675944190239/jenkins-hbase4.apache.org%2C38709%2C1675944190239.meta.1675944190799.meta 2023-02-09 12:03:10,819 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41831,DS-2538eef9-de8d-4478-a59e-d4efe09cd811,DISK], DatanodeInfoWithStorage[127.0.0.1:40529,DS-6871f59e-874b-4210-9de7-27604d93f96b,DISK]] 2023-02-09 12:03:10,819 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-09 12:03:10,819 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-09 12:03:10,819 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-09 12:03:10,819 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-09 12:03:10,819 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-09 12:03:10,820 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:10,820 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-09 12:03:10,820 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-09 12:03:10,821 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-09 12:03:10,822 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/data/hbase/meta/1588230740/info 2023-02-09 12:03:10,822 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/data/hbase/meta/1588230740/info 2023-02-09 12:03:10,822 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-09 12:03:10,823 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:10,823 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-09 12:03:10,824 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/data/hbase/meta/1588230740/rep_barrier 2023-02-09 12:03:10,824 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/data/hbase/meta/1588230740/rep_barrier 2023-02-09 12:03:10,824 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-09 12:03:10,825 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:10,825 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-09 12:03:10,825 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/data/hbase/meta/1588230740/table 2023-02-09 12:03:10,825 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/data/hbase/meta/1588230740/table 2023-02-09 12:03:10,826 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-09 12:03:10,826 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:10,827 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/data/hbase/meta/1588230740 2023-02-09 12:03:10,827 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/data/hbase/meta/1588230740 2023-02-09 12:03:10,829 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-09 12:03:10,830 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-09 12:03:10,830 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65570143, jitterRate=-0.02292872965335846}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-09 12:03:10,830 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1675944190820Writing region info on filesystem at 1675944190820Initializing all the Stores at 1675944190821 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675944190821Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944190821Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675944190821Cleaning up temporary data from old regions at 1675944190828 (+7 ms)Cleaning up detritus from prior splits at 1675944190828Running coprocessor post-open hooks at 1675944190830 (+2 ms)Region opened successfully at 1675944190830 2023-02-09 12:03:10,831 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1675944190789 2023-02-09 12:03:10,834 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-09 12:03:10,835 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-09 12:03:10,835 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38709,1675944190239, state=OPEN 2023-02-09 12:03:10,837 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): master:41197-0x10038f6caa60000, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-09 12:03:10,837 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-09 12:03:10,838 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-09 12:03:10,838 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38709,1675944190239 in 202 msec 2023-02-09 12:03:10,840 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-09 12:03:10,840 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 365 msec 2023-02-09 12:03:10,841 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 408 msec 2023-02-09 12:03:10,841 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1675944190291, completionTime=-1 2023-02-09 12:03:10,841 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-09 12:03:10,841 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-09 12:03:10,844 DEBUG [hconnection-0x694435fa-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 12:03:10,848 INFO [RS-EventLoopGroup-10-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45950, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 12:03:10,850 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-09 12:03:10,850 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1675944250850 2023-02-09 12:03:10,850 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1675944310850 2023-02-09 12:03:10,850 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 8 msec 2023-02-09 12:03:10,858 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41197,1675944190195-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:10,858 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41197,1675944190195-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:10,859 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41197,1675944190195-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:10,859 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:41197, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:10,859 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:10,859 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-09 12:03:10,859 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-09 12:03:10,860 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-09 12:03:10,860 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-09 12:03:10,862 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 12:03:10,863 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 12:03:10,864 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/.tmp/data/hbase/namespace/ca7ddc2cae0c83bc058659e4a1accf8c 2023-02-09 12:03:10,865 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/.tmp/data/hbase/namespace/ca7ddc2cae0c83bc058659e4a1accf8c empty. 2023-02-09 12:03:10,865 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/.tmp/data/hbase/namespace/ca7ddc2cae0c83bc058659e4a1accf8c 2023-02-09 12:03:10,865 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-09 12:03:10,874 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-09 12:03:10,875 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => ca7ddc2cae0c83bc058659e4a1accf8c, NAME => 'hbase:namespace,,1675944190859.ca7ddc2cae0c83bc058659e4a1accf8c.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/.tmp 2023-02-09 12:03:10,882 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675944190859.ca7ddc2cae0c83bc058659e4a1accf8c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:10,882 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing ca7ddc2cae0c83bc058659e4a1accf8c, disabling compactions & flushes 2023-02-09 12:03:10,882 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675944190859.ca7ddc2cae0c83bc058659e4a1accf8c. 2023-02-09 12:03:10,882 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675944190859.ca7ddc2cae0c83bc058659e4a1accf8c. 2023-02-09 12:03:10,882 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675944190859.ca7ddc2cae0c83bc058659e4a1accf8c. after waiting 0 ms 2023-02-09 12:03:10,882 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675944190859.ca7ddc2cae0c83bc058659e4a1accf8c. 2023-02-09 12:03:10,882 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675944190859.ca7ddc2cae0c83bc058659e4a1accf8c. 2023-02-09 12:03:10,882 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for ca7ddc2cae0c83bc058659e4a1accf8c: Waiting for close lock at 1675944190882Disabling compacts and flushes for region at 1675944190882Disabling writes for close at 1675944190882Writing region close event to WAL at 1675944190882Closed at 1675944190882 2023-02-09 12:03:10,884 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 12:03:10,885 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1675944190859.ca7ddc2cae0c83bc058659e4a1accf8c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675944190885"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675944190885"}]},"ts":"1675944190885"} 2023-02-09 12:03:10,887 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-09 12:03:10,888 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 12:03:10,888 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675944190888"}]},"ts":"1675944190888"} 2023-02-09 12:03:10,889 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-09 12:03:10,892 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 12:03:10,893 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 12:03:10,893 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 12:03:10,893 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 12:03:10,893 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=ca7ddc2cae0c83bc058659e4a1accf8c, ASSIGN}] 2023-02-09 12:03:10,895 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=ca7ddc2cae0c83bc058659e4a1accf8c, ASSIGN 2023-02-09 12:03:10,895 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=ca7ddc2cae0c83bc058659e4a1accf8c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38709,1675944190239; forceNewPlan=false, retain=false 2023-02-09 12:03:11,046 INFO [jenkins-hbase4:41197] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-09 12:03:11,047 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=ca7ddc2cae0c83bc058659e4a1accf8c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38709,1675944190239 2023-02-09 12:03:11,047 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1675944190859.ca7ddc2cae0c83bc058659e4a1accf8c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675944191047"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675944191047"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675944191047"}]},"ts":"1675944191047"} 2023-02-09 12:03:11,049 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure ca7ddc2cae0c83bc058659e4a1accf8c, server=jenkins-hbase4.apache.org,38709,1675944190239}] 2023-02-09 12:03:11,204 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1675944190859.ca7ddc2cae0c83bc058659e4a1accf8c. 2023-02-09 12:03:11,206 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38709%2C1675944190239, suffix=, logDir=hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/WALs/jenkins-hbase4.apache.org,38709,1675944190239, archiveDir=hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/oldWALs, maxLogs=32 2023-02-09 12:03:11,220 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41831,DS-2538eef9-de8d-4478-a59e-d4efe09cd811,DISK] 2023-02-09 12:03:11,220 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40529,DS-6871f59e-874b-4210-9de7-27604d93f96b,DISK] 2023-02-09 12:03:11,222 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/WALs/jenkins-hbase4.apache.org,38709,1675944190239/jenkins-hbase4.apache.org%2C38709%2C1675944190239.1675944191206 2023-02-09 12:03:11,224 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41831,DS-2538eef9-de8d-4478-a59e-d4efe09cd811,DISK], DatanodeInfoWithStorage[127.0.0.1:40529,DS-6871f59e-874b-4210-9de7-27604d93f96b,DISK]] 2023-02-09 12:03:11,224 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ca7ddc2cae0c83bc058659e4a1accf8c, NAME => 'hbase:namespace,,1675944190859.ca7ddc2cae0c83bc058659e4a1accf8c.', STARTKEY => '', ENDKEY => ''} 2023-02-09 12:03:11,224 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace ca7ddc2cae0c83bc058659e4a1accf8c 2023-02-09 12:03:11,224 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675944190859.ca7ddc2cae0c83bc058659e4a1accf8c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:11,225 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for ca7ddc2cae0c83bc058659e4a1accf8c 2023-02-09 12:03:11,225 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for ca7ddc2cae0c83bc058659e4a1accf8c 2023-02-09 12:03:11,226 INFO [StoreOpener-ca7ddc2cae0c83bc058659e4a1accf8c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region ca7ddc2cae0c83bc058659e4a1accf8c 2023-02-09 12:03:11,227 DEBUG [StoreOpener-ca7ddc2cae0c83bc058659e4a1accf8c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/data/hbase/namespace/ca7ddc2cae0c83bc058659e4a1accf8c/info 2023-02-09 12:03:11,227 DEBUG [StoreOpener-ca7ddc2cae0c83bc058659e4a1accf8c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/data/hbase/namespace/ca7ddc2cae0c83bc058659e4a1accf8c/info 2023-02-09 12:03:11,227 INFO [StoreOpener-ca7ddc2cae0c83bc058659e4a1accf8c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ca7ddc2cae0c83bc058659e4a1accf8c columnFamilyName info 2023-02-09 12:03:11,228 INFO [StoreOpener-ca7ddc2cae0c83bc058659e4a1accf8c-1] regionserver.HStore(310): Store=ca7ddc2cae0c83bc058659e4a1accf8c/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:11,228 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/data/hbase/namespace/ca7ddc2cae0c83bc058659e4a1accf8c 2023-02-09 12:03:11,229 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/data/hbase/namespace/ca7ddc2cae0c83bc058659e4a1accf8c 2023-02-09 12:03:11,231 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for ca7ddc2cae0c83bc058659e4a1accf8c 2023-02-09 12:03:11,233 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/data/hbase/namespace/ca7ddc2cae0c83bc058659e4a1accf8c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 12:03:11,233 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened ca7ddc2cae0c83bc058659e4a1accf8c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75415024, jitterRate=0.12377142906188965}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 12:03:11,233 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for ca7ddc2cae0c83bc058659e4a1accf8c: Running coprocessor pre-open hook at 1675944191225Writing region info on filesystem at 1675944191225Initializing all the Stores at 1675944191225Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675944191225Cleaning up temporary data from old regions at 1675944191229 (+4 ms)Cleaning up detritus from prior splits at 1675944191229Running coprocessor post-open hooks at 1675944191233 (+4 ms)Region opened successfully at 1675944191233 2023-02-09 12:03:11,234 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1675944190859.ca7ddc2cae0c83bc058659e4a1accf8c., pid=6, masterSystemTime=1675944191201 2023-02-09 12:03:11,236 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1675944190859.ca7ddc2cae0c83bc058659e4a1accf8c. 2023-02-09 12:03:11,236 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1675944190859.ca7ddc2cae0c83bc058659e4a1accf8c. 2023-02-09 12:03:11,236 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=ca7ddc2cae0c83bc058659e4a1accf8c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38709,1675944190239 2023-02-09 12:03:11,237 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1675944190859.ca7ddc2cae0c83bc058659e4a1accf8c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675944191236"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675944191236"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675944191236"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675944191236"}]},"ts":"1675944191236"} 2023-02-09 12:03:11,240 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-09 12:03:11,240 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure ca7ddc2cae0c83bc058659e4a1accf8c, server=jenkins-hbase4.apache.org,38709,1675944190239 in 189 msec 2023-02-09 12:03:11,242 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-09 12:03:11,242 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=ca7ddc2cae0c83bc058659e4a1accf8c, ASSIGN in 347 msec 2023-02-09 12:03:11,242 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 12:03:11,242 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675944191242"}]},"ts":"1675944191242"} 2023-02-09 12:03:11,244 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-09 12:03:11,246 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 12:03:11,248 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 387 msec 2023-02-09 12:03:11,261 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41197-0x10038f6caa60000, quorum=127.0.0.1:55305, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-09 12:03:11,264 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): master:41197-0x10038f6caa60000, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-09 12:03:11,264 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): master:41197-0x10038f6caa60000, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 12:03:11,267 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-09 12:03:11,275 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): master:41197-0x10038f6caa60000, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-09 12:03:11,277 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 9 msec 2023-02-09 12:03:11,289 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-09 12:03:11,296 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): master:41197-0x10038f6caa60000, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-09 12:03:11,300 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 10 msec 2023-02-09 12:03:11,314 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): master:41197-0x10038f6caa60000, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-09 12:03:11,318 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): master:41197-0x10038f6caa60000, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-09 12:03:11,318 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 1.022sec 2023-02-09 12:03:11,318 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-09 12:03:11,318 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-09 12:03:11,318 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-09 12:03:11,318 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41197,1675944190195-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-09 12:03:11,319 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41197,1675944190195-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-09 12:03:11,320 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-09 12:03:11,390 DEBUG [Listener at localhost/42145] zookeeper.ReadOnlyZKClient(139): Connect 0x3f3ec1c9 to 127.0.0.1:55305 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 12:03:11,396 DEBUG [Listener at localhost/42145] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@28bbe80a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 12:03:11,398 DEBUG [hconnection-0x38b30264-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 12:03:11,400 INFO [RS-EventLoopGroup-10-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45966, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 12:03:11,401 INFO [Listener at localhost/42145] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,41197,1675944190195 2023-02-09 12:03:11,402 DEBUG [Listener at localhost/42145] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-09 12:03:11,402 INFO [Listener at localhost/42145] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:11,402 INFO [Listener at localhost/42145] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:11,404 DEBUG [Listener at localhost/42145] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-09 12:03:11,406 INFO [RS-EventLoopGroup-9-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54002, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-09 12:03:11,407 INFO [Listener at localhost/42145] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-09 12:03:11,407 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41197] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testInitTableSnapshotMapperJobConfig 2023-02-09 12:03:11,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41197] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-09 12:03:11,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41197] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 95 connection: 172.31.14.131:54002 deadline: 1675944251407, exception=org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig 2023-02-09 12:03:11,408 INFO [Listener at localhost/42145] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testInitTableSnapshotMapperJobConfig' 2023-02-09 12:03:11,409 INFO [Listener at localhost/42145] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:11,409 INFO [Listener at localhost/42145] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:11,412 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41197] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-09 12:03:11,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41197] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-09 12:03:11,416 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 12:03:11,416 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41197] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testInitTableSnapshotMapperJobConfig" procId is: 10 2023-02-09 12:03:11,416 INFO [Listener at localhost/42145] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:11,416 INFO [Listener at localhost/42145] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:11,417 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 12:03:11,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41197] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 12:03:11,418 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/.tmp/data/default/testInitTableSnapshotMapperJobConfig/07b31a22b55ccadb5db1b8527a9ec4b4 2023-02-09 12:03:11,419 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/.tmp/data/default/testInitTableSnapshotMapperJobConfig/07b31a22b55ccadb5db1b8527a9ec4b4 empty. 2023-02-09 12:03:11,419 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/.tmp/data/default/testInitTableSnapshotMapperJobConfig/07b31a22b55ccadb5db1b8527a9ec4b4 2023-02-09 12:03:11,419 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-09 12:03:11,434 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/.tmp/data/default/testInitTableSnapshotMapperJobConfig/.tabledesc/.tableinfo.0000000001 2023-02-09 12:03:11,436 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(7671): creating {ENCODED => 07b31a22b55ccadb5db1b8527a9ec4b4, NAME => 'testInitTableSnapshotMapperJobConfig,,1675944191412.07b31a22b55ccadb5db1b8527a9ec4b4.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/.tmp 2023-02-09 12:03:11,446 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1675944191412.07b31a22b55ccadb5db1b8527a9ec4b4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:11,446 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1603): Closing 07b31a22b55ccadb5db1b8527a9ec4b4, disabling compactions & flushes 2023-02-09 12:03:11,446 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1675944191412.07b31a22b55ccadb5db1b8527a9ec4b4. 2023-02-09 12:03:11,446 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1675944191412.07b31a22b55ccadb5db1b8527a9ec4b4. 2023-02-09 12:03:11,446 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1675944191412.07b31a22b55ccadb5db1b8527a9ec4b4. after waiting 0 ms 2023-02-09 12:03:11,446 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1675944191412.07b31a22b55ccadb5db1b8527a9ec4b4. 2023-02-09 12:03:11,446 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1675944191412.07b31a22b55ccadb5db1b8527a9ec4b4. 2023-02-09 12:03:11,446 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1557): Region close journal for 07b31a22b55ccadb5db1b8527a9ec4b4: Waiting for close lock at 1675944191446Disabling compacts and flushes for region at 1675944191446Disabling writes for close at 1675944191446Writing region close event to WAL at 1675944191446Closed at 1675944191446 2023-02-09 12:03:11,448 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 12:03:11,449 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1675944191412.07b31a22b55ccadb5db1b8527a9ec4b4.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1675944191449"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675944191449"}]},"ts":"1675944191449"} 2023-02-09 12:03:11,450 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-09 12:03:11,451 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 12:03:11,451 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675944191451"}]},"ts":"1675944191451"} 2023-02-09 12:03:11,452 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLING in hbase:meta 2023-02-09 12:03:11,455 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 12:03:11,456 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 12:03:11,456 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 12:03:11,456 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 12:03:11,456 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=07b31a22b55ccadb5db1b8527a9ec4b4, ASSIGN}] 2023-02-09 12:03:11,458 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=07b31a22b55ccadb5db1b8527a9ec4b4, ASSIGN 2023-02-09 12:03:11,459 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=07b31a22b55ccadb5db1b8527a9ec4b4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34509,1675944190270; forceNewPlan=false, retain=false 2023-02-09 12:03:11,518 INFO [Listener at localhost/42145] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:11,518 INFO [Listener at localhost/42145] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:11,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41197] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 12:03:11,569 INFO [RS:1;jenkins-hbase4:34509] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34509%2C1675944190270, suffix=, logDir=hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/WALs/jenkins-hbase4.apache.org,34509,1675944190270, archiveDir=hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/oldWALs, maxLogs=32 2023-02-09 12:03:11,587 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41831,DS-2538eef9-de8d-4478-a59e-d4efe09cd811,DISK] 2023-02-09 12:03:11,587 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40529,DS-6871f59e-874b-4210-9de7-27604d93f96b,DISK] 2023-02-09 12:03:11,589 INFO [RS:1;jenkins-hbase4:34509] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/WALs/jenkins-hbase4.apache.org,34509,1675944190270/jenkins-hbase4.apache.org%2C34509%2C1675944190270.1675944191570 2023-02-09 12:03:11,592 DEBUG [RS:1;jenkins-hbase4:34509] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41831,DS-2538eef9-de8d-4478-a59e-d4efe09cd811,DISK], DatanodeInfoWithStorage[127.0.0.1:40529,DS-6871f59e-874b-4210-9de7-27604d93f96b,DISK]] 2023-02-09 12:03:11,609 INFO [jenkins-hbase4:41197] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-09 12:03:11,610 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=07b31a22b55ccadb5db1b8527a9ec4b4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34509,1675944190270 2023-02-09 12:03:11,610 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1675944191412.07b31a22b55ccadb5db1b8527a9ec4b4.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1675944191610"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675944191610"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675944191610"}]},"ts":"1675944191610"} 2023-02-09 12:03:11,612 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 07b31a22b55ccadb5db1b8527a9ec4b4, server=jenkins-hbase4.apache.org,34509,1675944190270}] 2023-02-09 12:03:11,720 INFO [Listener at localhost/42145] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:11,720 INFO [Listener at localhost/42145] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:11,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41197] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 12:03:11,765 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,34509,1675944190270 2023-02-09 12:03:11,765 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-09 12:03:11,766 INFO [RS-EventLoopGroup-11-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48510, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-09 12:03:11,769 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testInitTableSnapshotMapperJobConfig,,1675944191412.07b31a22b55ccadb5db1b8527a9ec4b4. 2023-02-09 12:03:11,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 07b31a22b55ccadb5db1b8527a9ec4b4, NAME => 'testInitTableSnapshotMapperJobConfig,,1675944191412.07b31a22b55ccadb5db1b8527a9ec4b4.', STARTKEY => '', ENDKEY => ''} 2023-02-09 12:03:11,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testInitTableSnapshotMapperJobConfig 07b31a22b55ccadb5db1b8527a9ec4b4 2023-02-09 12:03:11,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1675944191412.07b31a22b55ccadb5db1b8527a9ec4b4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:11,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 07b31a22b55ccadb5db1b8527a9ec4b4 2023-02-09 12:03:11,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 07b31a22b55ccadb5db1b8527a9ec4b4 2023-02-09 12:03:11,771 INFO [StoreOpener-07b31a22b55ccadb5db1b8527a9ec4b4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 07b31a22b55ccadb5db1b8527a9ec4b4 2023-02-09 12:03:11,772 DEBUG [StoreOpener-07b31a22b55ccadb5db1b8527a9ec4b4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/data/default/testInitTableSnapshotMapperJobConfig/07b31a22b55ccadb5db1b8527a9ec4b4/f1 2023-02-09 12:03:11,772 DEBUG [StoreOpener-07b31a22b55ccadb5db1b8527a9ec4b4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/data/default/testInitTableSnapshotMapperJobConfig/07b31a22b55ccadb5db1b8527a9ec4b4/f1 2023-02-09 12:03:11,773 INFO [StoreOpener-07b31a22b55ccadb5db1b8527a9ec4b4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 07b31a22b55ccadb5db1b8527a9ec4b4 columnFamilyName f1 2023-02-09 12:03:11,773 INFO [StoreOpener-07b31a22b55ccadb5db1b8527a9ec4b4-1] regionserver.HStore(310): Store=07b31a22b55ccadb5db1b8527a9ec4b4/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:11,773 INFO [StoreOpener-07b31a22b55ccadb5db1b8527a9ec4b4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 07b31a22b55ccadb5db1b8527a9ec4b4 2023-02-09 12:03:11,774 DEBUG [StoreOpener-07b31a22b55ccadb5db1b8527a9ec4b4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/data/default/testInitTableSnapshotMapperJobConfig/07b31a22b55ccadb5db1b8527a9ec4b4/f2 2023-02-09 12:03:11,774 DEBUG [StoreOpener-07b31a22b55ccadb5db1b8527a9ec4b4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/data/default/testInitTableSnapshotMapperJobConfig/07b31a22b55ccadb5db1b8527a9ec4b4/f2 2023-02-09 12:03:11,774 INFO [StoreOpener-07b31a22b55ccadb5db1b8527a9ec4b4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 07b31a22b55ccadb5db1b8527a9ec4b4 columnFamilyName f2 2023-02-09 12:03:11,775 INFO [StoreOpener-07b31a22b55ccadb5db1b8527a9ec4b4-1] regionserver.HStore(310): Store=07b31a22b55ccadb5db1b8527a9ec4b4/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:11,775 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/data/default/testInitTableSnapshotMapperJobConfig/07b31a22b55ccadb5db1b8527a9ec4b4 2023-02-09 12:03:11,776 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/data/default/testInitTableSnapshotMapperJobConfig/07b31a22b55ccadb5db1b8527a9ec4b4 2023-02-09 12:03:11,777 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testInitTableSnapshotMapperJobConfig descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 12:03:11,778 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 07b31a22b55ccadb5db1b8527a9ec4b4 2023-02-09 12:03:11,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/data/default/testInitTableSnapshotMapperJobConfig/07b31a22b55ccadb5db1b8527a9ec4b4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 12:03:11,781 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 07b31a22b55ccadb5db1b8527a9ec4b4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61422171, jitterRate=-0.08473832905292511}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 12:03:11,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 07b31a22b55ccadb5db1b8527a9ec4b4: Running coprocessor pre-open hook at 1675944191770Writing region info on filesystem at 1675944191770Initializing all the Stores at 1675944191771 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944191771Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944191771Cleaning up temporary data from old regions at 1675944191776 (+5 ms)Cleaning up detritus from prior splits at 1675944191777 (+1 ms)Running coprocessor post-open hooks at 1675944191781 (+4 ms)Region opened successfully at 1675944191781 2023-02-09 12:03:11,782 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testInitTableSnapshotMapperJobConfig,,1675944191412.07b31a22b55ccadb5db1b8527a9ec4b4., pid=12, masterSystemTime=1675944191765 2023-02-09 12:03:11,785 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testInitTableSnapshotMapperJobConfig,,1675944191412.07b31a22b55ccadb5db1b8527a9ec4b4. 2023-02-09 12:03:11,786 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testInitTableSnapshotMapperJobConfig,,1675944191412.07b31a22b55ccadb5db1b8527a9ec4b4. 2023-02-09 12:03:11,786 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=07b31a22b55ccadb5db1b8527a9ec4b4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34509,1675944190270 2023-02-09 12:03:11,786 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testInitTableSnapshotMapperJobConfig,,1675944191412.07b31a22b55ccadb5db1b8527a9ec4b4.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1675944191786"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675944191786"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675944191786"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675944191786"}]},"ts":"1675944191786"} 2023-02-09 12:03:11,789 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-09 12:03:11,789 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 07b31a22b55ccadb5db1b8527a9ec4b4, server=jenkins-hbase4.apache.org,34509,1675944190270 in 176 msec 2023-02-09 12:03:11,791 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-09 12:03:11,791 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=07b31a22b55ccadb5db1b8527a9ec4b4, ASSIGN in 333 msec 2023-02-09 12:03:11,791 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 12:03:11,791 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675944191791"}]},"ts":"1675944191791"} 2023-02-09 12:03:11,793 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLED in hbase:meta 2023-02-09 12:03:11,796 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 12:03:11,797 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig in 384 msec 2023-02-09 12:03:12,022 INFO [Listener at localhost/42145] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:12,022 INFO [Listener at localhost/42145] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:12,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41197] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 12:03:12,024 INFO [Listener at localhost/42145] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 10 completed 2023-02-09 12:03:12,024 DEBUG [Listener at localhost/42145] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testInitTableSnapshotMapperJobConfig get assigned. Timeout = 60000ms 2023-02-09 12:03:12,024 INFO [Listener at localhost/42145] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-09 12:03:12,026 INFO [Listener at localhost/42145] hbase.HBaseTestingUtility(3484): All regions for table testInitTableSnapshotMapperJobConfig assigned to meta. Checking AM states. 2023-02-09 12:03:12,026 INFO [Listener at localhost/42145] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-09 12:03:12,026 INFO [Listener at localhost/42145] hbase.HBaseTestingUtility(3504): All regions for table testInitTableSnapshotMapperJobConfig assigned. 2023-02-09 12:03:12,027 INFO [Listener at localhost/42145] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-09 12:03:12,052 DEBUG [hconnection-0x38b30264-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 12:03:12,067 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48520, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 12:03:12,076 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34509] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testInitTableSnapshotMapperJobConfig,,1675944191412.07b31a22b55ccadb5db1b8527a9ec4b4. 2023-02-09 12:03:12,170 INFO [Listener at localhost/42145] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-09 12:03:12,170 INFO [Listener at localhost/42145] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-09 12:03:12,170 INFO [Listener at localhost/42145] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:12,170 INFO [Listener at localhost/42145] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:12,171 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41197] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-09 12:03:12,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41197] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1675944192171 (current time:1675944192171). 2023-02-09 12:03:12,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41197] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-09 12:03:12,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41197] zookeeper.ReadOnlyZKClient(139): Connect 0x6700a552 to 127.0.0.1:55305 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 12:03:12,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41197] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@49f09a4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 12:03:12,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41197] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 12:03:12,180 INFO [RS-EventLoopGroup-10-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45968, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 12:03:12,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41197] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6700a552 to 127.0.0.1:55305 2023-02-09 12:03:12,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41197] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 12:03:12,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41197] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-09 12:03:12,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41197] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-09 12:03:12,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41197] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-09 12:03:12,185 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-09 12:03:12,186 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE; timeout=600000, timestamp=1675944792186 2023-02-09 12:03:12,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41197] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-09 12:03:12,191 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig 2023-02-09 12:03:12,193 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-09 12:03:12,193 DEBUG [Listener at localhost/42145] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-09 12:03:12,193 DEBUG [Listener at localhost/42145] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-09 12:03:12,194 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-09 12:03:12,194 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE in 10 msec 2023-02-09 12:03:12,195 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-09 12:03:12,195 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED; timeout=600000, timestamp=1675944792195 2023-02-09 12:03:12,204 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-09 12:03:12,204 INFO [(jenkins-hbase4.apache.org,41197,1675944190195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-09 12:03:12,204 DEBUG [(jenkins-hbase4.apache.org,41197,1675944190195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 12:03:12,205 DEBUG [(jenkins-hbase4.apache.org,41197,1675944190195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-09 12:03:12,205 DEBUG [(jenkins-hbase4.apache.org,41197,1675944190195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-09 12:03:12,206 DEBUG [(jenkins-hbase4.apache.org,41197,1675944190195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41197-0x10038f6caa60000, quorum=127.0.0.1:55305, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-09 12:03:12,206 DEBUG [(jenkins-hbase4.apache.org,41197,1675944190195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-09 12:03:12,207 DEBUG [(jenkins-hbase4.apache.org,41197,1675944190195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,34509,1675944190270 2023-02-09 12:03:12,207 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): regionserver:34509-0x10038f6caa60002, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 12:03:12,207 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): regionserver:38709-0x10038f6caa60001, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 12:03:12,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 12:03:12,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 12:03:12,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 12:03:12,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 12:03:12,207 DEBUG [(jenkins-hbase4.apache.org,41197,1675944190195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41197-0x10038f6caa60000, quorum=127.0.0.1:55305, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,34509,1675944190270 2023-02-09 12:03:12,207 DEBUG [(jenkins-hbase4.apache.org,41197,1675944190195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 12:03:12,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-09 12:03:12,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-09 12:03:12,208 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38709-0x10038f6caa60001, quorum=127.0.0.1:55305, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-09 12:03:12,208 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34509-0x10038f6caa60002, quorum=127.0.0.1:55305, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-09 12:03:12,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-09 12:03:12,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-09 12:03:12,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-09 12:03:12,208 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-09 12:03:12,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-09 12:03:12,209 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-09 12:03:12,209 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-09 12:03:12,209 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-09 12:03:12,209 DEBUG [member: 'jenkins-hbase4.apache.org,38709,1675944190239' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-09 12:03:12,209 DEBUG [member: 'jenkins-hbase4.apache.org,38709,1675944190239' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 12:03:12,209 DEBUG [member: 'jenkins-hbase4.apache.org,34509,1675944190270' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-09 12:03:12,210 DEBUG [member: 'jenkins-hbase4.apache.org,38709,1675944190239' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-09 12:03:12,210 DEBUG [member: 'jenkins-hbase4.apache.org,38709,1675944190239' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-09 12:03:12,210 DEBUG [member: 'jenkins-hbase4.apache.org,38709,1675944190239' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38709,1675944190239' joining acquired barrier for procedure (foo) in zk 2023-02-09 12:03:12,210 DEBUG [member: 'jenkins-hbase4.apache.org,34509,1675944190270' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 12:03:12,210 DEBUG [member: 'jenkins-hbase4.apache.org,34509,1675944190270' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-09 12:03:12,210 DEBUG [member: 'jenkins-hbase4.apache.org,34509,1675944190270' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-09 12:03:12,210 DEBUG [member: 'jenkins-hbase4.apache.org,34509,1675944190270' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34509,1675944190270' joining acquired barrier for procedure (foo) in zk 2023-02-09 12:03:12,212 DEBUG [member: 'jenkins-hbase4.apache.org,38709,1675944190239' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-09 12:03:12,213 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): master:41197-0x10038f6caa60000, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,34509,1675944190270 2023-02-09 12:03:12,213 DEBUG [member: 'jenkins-hbase4.apache.org,34509,1675944190270' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-09 12:03:12,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,34509,1675944190270 2023-02-09 12:03:12,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 12:03:12,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 12:03:12,213 DEBUG [member: 'jenkins-hbase4.apache.org,38709,1675944190239' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38709-0x10038f6caa60001, quorum=127.0.0.1:55305, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-09 12:03:12,213 DEBUG [member: 'jenkins-hbase4.apache.org,38709,1675944190239' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 12:03:12,214 DEBUG [member: 'jenkins-hbase4.apache.org,34509,1675944190270' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34509-0x10038f6caa60002, quorum=127.0.0.1:55305, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-09 12:03:12,214 DEBUG [member: 'jenkins-hbase4.apache.org,34509,1675944190270' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 12:03:12,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 12:03:12,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 12:03:12,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-09 12:03:12,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34509,1675944190270 2023-02-09 12:03:12,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38709,1675944190239 2023-02-09 12:03:12,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 12:03:12,215 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34509,1675944190270' joining acquired barrier for procedure 'foo' on coordinator 2023-02-09 12:03:12,215 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7cdf9fb8[Count = 0] remaining members to acquire global barrier 2023-02-09 12:03:12,215 DEBUG [(jenkins-hbase4.apache.org,41197,1675944190195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-09 12:03:12,215 DEBUG [(jenkins-hbase4.apache.org,41197,1675944190195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-09 12:03:12,217 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): regionserver:38709-0x10038f6caa60001, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-09 12:03:12,217 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): regionserver:34509-0x10038f6caa60002, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-09 12:03:12,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-09 12:03:12,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-09 12:03:12,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-09 12:03:12,217 DEBUG [member: 'jenkins-hbase4.apache.org,38709,1675944190239' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-09 12:03:12,217 DEBUG [(jenkins-hbase4.apache.org,41197,1675944190195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41197-0x10038f6caa60000, quorum=127.0.0.1:55305, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,34509,1675944190270 2023-02-09 12:03:12,217 DEBUG [member: 'jenkins-hbase4.apache.org,38709,1675944190239' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-09 12:03:12,217 DEBUG [(jenkins-hbase4.apache.org,41197,1675944190195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 12:03:12,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-09 12:03:12,217 DEBUG [member: 'jenkins-hbase4.apache.org,38709,1675944190239' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,38709,1675944190239' in zk 2023-02-09 12:03:12,217 DEBUG [member: 'jenkins-hbase4.apache.org,34509,1675944190270' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-09 12:03:12,217 DEBUG [member: 'jenkins-hbase4.apache.org,34509,1675944190270' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-09 12:03:12,217 DEBUG [member: 'jenkins-hbase4.apache.org,34509,1675944190270' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-09 12:03:12,217 DEBUG [rs(jenkins-hbase4.apache.org,34509,1675944190270)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testInitTableSnapshotMapperJobConfig,,1675944191412.07b31a22b55ccadb5db1b8527a9ec4b4. 2023-02-09 12:03:12,218 DEBUG [rs(jenkins-hbase4.apache.org,34509,1675944190270)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1675944191412.07b31a22b55ccadb5db1b8527a9ec4b4. started... 2023-02-09 12:03:12,218 INFO [rs(jenkins-hbase4.apache.org,34509,1675944190270)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 07b31a22b55ccadb5db1b8527a9ec4b4 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-09 12:03:12,219 DEBUG [member: 'jenkins-hbase4.apache.org,38709,1675944190239' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-09 12:03:12,219 DEBUG [member: 'jenkins-hbase4.apache.org,38709,1675944190239' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 12:03:12,219 DEBUG [member: 'jenkins-hbase4.apache.org,38709,1675944190239' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-09 12:03:12,234 INFO [rs(jenkins-hbase4.apache.org,34509,1675944190270)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/data/default/testInitTableSnapshotMapperJobConfig/07b31a22b55ccadb5db1b8527a9ec4b4/.tmp/f1/ea5cc82460fb46b8b9173863a49b299e 2023-02-09 12:03:12,254 INFO [rs(jenkins-hbase4.apache.org,34509,1675944190270)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/data/default/testInitTableSnapshotMapperJobConfig/07b31a22b55ccadb5db1b8527a9ec4b4/.tmp/f2/26dc370555914cbd9caa5bb12eb82154 2023-02-09 12:03:12,259 DEBUG [rs(jenkins-hbase4.apache.org,34509,1675944190270)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/data/default/testInitTableSnapshotMapperJobConfig/07b31a22b55ccadb5db1b8527a9ec4b4/.tmp/f1/ea5cc82460fb46b8b9173863a49b299e as hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/data/default/testInitTableSnapshotMapperJobConfig/07b31a22b55ccadb5db1b8527a9ec4b4/f1/ea5cc82460fb46b8b9173863a49b299e 2023-02-09 12:03:12,263 INFO [rs(jenkins-hbase4.apache.org,34509,1675944190270)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/data/default/testInitTableSnapshotMapperJobConfig/07b31a22b55ccadb5db1b8527a9ec4b4/f1/ea5cc82460fb46b8b9173863a49b299e, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-09 12:03:12,264 DEBUG [rs(jenkins-hbase4.apache.org,34509,1675944190270)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/data/default/testInitTableSnapshotMapperJobConfig/07b31a22b55ccadb5db1b8527a9ec4b4/.tmp/f2/26dc370555914cbd9caa5bb12eb82154 as hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/data/default/testInitTableSnapshotMapperJobConfig/07b31a22b55ccadb5db1b8527a9ec4b4/f2/26dc370555914cbd9caa5bb12eb82154 2023-02-09 12:03:12,268 INFO [rs(jenkins-hbase4.apache.org,34509,1675944190270)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/data/default/testInitTableSnapshotMapperJobConfig/07b31a22b55ccadb5db1b8527a9ec4b4/f2/26dc370555914cbd9caa5bb12eb82154, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-09 12:03:12,269 INFO [rs(jenkins-hbase4.apache.org,34509,1675944190270)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 07b31a22b55ccadb5db1b8527a9ec4b4 in 51ms, sequenceid=5, compaction requested=false 2023-02-09 12:03:12,269 DEBUG [rs(jenkins-hbase4.apache.org,34509,1675944190270)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testInitTableSnapshotMapperJobConfig' 2023-02-09 12:03:12,269 DEBUG [rs(jenkins-hbase4.apache.org,34509,1675944190270)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 07b31a22b55ccadb5db1b8527a9ec4b4: 2023-02-09 12:03:12,269 DEBUG [rs(jenkins-hbase4.apache.org,34509,1675944190270)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testInitTableSnapshotMapperJobConfig,,1675944191412.07b31a22b55ccadb5db1b8527a9ec4b4.' region-info for snapshot=foo 2023-02-09 12:03:12,269 DEBUG [rs(jenkins-hbase4.apache.org,34509,1675944190270)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 12:03:12,269 DEBUG [rs(jenkins-hbase4.apache.org,34509,1675944190270)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/data/default/testInitTableSnapshotMapperJobConfig/07b31a22b55ccadb5db1b8527a9ec4b4/f1/ea5cc82460fb46b8b9173863a49b299e] hfiles 2023-02-09 12:03:12,269 DEBUG [rs(jenkins-hbase4.apache.org,34509,1675944190270)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/data/default/testInitTableSnapshotMapperJobConfig/07b31a22b55ccadb5db1b8527a9ec4b4/f1/ea5cc82460fb46b8b9173863a49b299e for snapshot=foo 2023-02-09 12:03:12,269 DEBUG [rs(jenkins-hbase4.apache.org,34509,1675944190270)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/data/default/testInitTableSnapshotMapperJobConfig/07b31a22b55ccadb5db1b8527a9ec4b4/f2/26dc370555914cbd9caa5bb12eb82154] hfiles 2023-02-09 12:03:12,269 DEBUG [rs(jenkins-hbase4.apache.org,34509,1675944190270)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/data/default/testInitTableSnapshotMapperJobConfig/07b31a22b55ccadb5db1b8527a9ec4b4/f2/26dc370555914cbd9caa5bb12eb82154 for snapshot=foo 2023-02-09 12:03:12,278 DEBUG [rs(jenkins-hbase4.apache.org,34509,1675944190270)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1675944191412.07b31a22b55ccadb5db1b8527a9ec4b4. completed. 2023-02-09 12:03:12,278 DEBUG [rs(jenkins-hbase4.apache.org,34509,1675944190270)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testInitTableSnapshotMapperJobConfig,,1675944191412.07b31a22b55ccadb5db1b8527a9ec4b4. 2023-02-09 12:03:12,278 DEBUG [member: 'jenkins-hbase4.apache.org,34509,1675944190270' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-09 12:03:12,278 DEBUG [member: 'jenkins-hbase4.apache.org,34509,1675944190270' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-09 12:03:12,278 DEBUG [member: 'jenkins-hbase4.apache.org,34509,1675944190270' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34509,1675944190270 2023-02-09 12:03:12,278 DEBUG [member: 'jenkins-hbase4.apache.org,34509,1675944190270' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-09 12:03:12,279 DEBUG [member: 'jenkins-hbase4.apache.org,34509,1675944190270' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,34509,1675944190270' in zk 2023-02-09 12:03:12,282 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): master:41197-0x10038f6caa60000, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,34509,1675944190270 2023-02-09 12:03:12,282 DEBUG [member: 'jenkins-hbase4.apache.org,34509,1675944190270' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-09 12:03:12,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,34509,1675944190270 2023-02-09 12:03:12,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 12:03:12,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 12:03:12,282 DEBUG [member: 'jenkins-hbase4.apache.org,34509,1675944190270' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 12:03:12,282 DEBUG [member: 'jenkins-hbase4.apache.org,34509,1675944190270' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-09 12:03:12,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 12:03:12,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 12:03:12,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-09 12:03:12,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34509,1675944190270 2023-02-09 12:03:12,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38709,1675944190239 2023-02-09 12:03:12,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 12:03:12,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-09 12:03:12,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34509,1675944190270 2023-02-09 12:03:12,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38709,1675944190239 2023-02-09 12:03:12,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase4.apache.org,34509,1675944190270': 2023-02-09 12:03:12,286 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34509,1675944190270' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-09 12:03:12,286 INFO [(jenkins-hbase4.apache.org,41197,1675944190195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-09 12:03:12,286 DEBUG [(jenkins-hbase4.apache.org,41197,1675944190195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 12:03:12,286 DEBUG [(jenkins-hbase4.apache.org,41197,1675944190195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 12:03:12,287 DEBUG [(jenkins-hbase4.apache.org,41197,1675944190195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-09 12:03:12,287 INFO [(jenkins-hbase4.apache.org,41197,1675944190195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-09 12:03:12,288 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): regionserver:38709-0x10038f6caa60001, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-09 12:03:12,288 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): regionserver:34509-0x10038f6caa60002, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-09 12:03:12,288 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): master:41197-0x10038f6caa60000, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-09 12:03:12,288 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): regionserver:34509-0x10038f6caa60002, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 12:03:12,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-09 12:03:12,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 12:03:12,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 12:03:12,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-09 12:03:12,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-09 12:03:12,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-09 12:03:12,288 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): regionserver:38709-0x10038f6caa60001, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 12:03:12,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-09 12:03:12,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 12:03:12,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 12:03:12,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 12:03:12,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 12:03:12,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 12:03:12,289 DEBUG [(jenkins-hbase4.apache.org,41197,1675944190195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41197-0x10038f6caa60000, quorum=127.0.0.1:55305, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,34509,1675944190270 2023-02-09 12:03:12,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-09 12:03:12,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-09 12:03:12,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-09 12:03:12,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 12:03:12,290 DEBUG [(jenkins-hbase4.apache.org,41197,1675944190195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41197-0x10038f6caa60000, quorum=127.0.0.1:55305, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,38709,1675944190239 2023-02-09 12:03:12,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-09 12:03:12,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34509,1675944190270 2023-02-09 12:03:12,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38709,1675944190239 2023-02-09 12:03:12,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 12:03:12,292 DEBUG [(jenkins-hbase4.apache.org,41197,1675944190195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41197-0x10038f6caa60000, quorum=127.0.0.1:55305, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,34509,1675944190270 2023-02-09 12:03:12,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-09 12:03:12,292 DEBUG [(jenkins-hbase4.apache.org,41197,1675944190195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41197-0x10038f6caa60000, quorum=127.0.0.1:55305, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,38709,1675944190239 2023-02-09 12:03:12,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34509,1675944190270 2023-02-09 12:03:12,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38709,1675944190239 2023-02-09 12:03:12,293 DEBUG [Listener at localhost/42145] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 12:03:12,293 INFO [Listener at localhost/42145] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:12,293 INFO [Listener at localhost/42145] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:12,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41197] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-09 12:03:12,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41197] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' is still in progress! 2023-02-09 12:03:12,295 DEBUG [Listener at localhost/42145] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-09 12:03:12,301 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): regionserver:38709-0x10038f6caa60001, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 12:03:12,301 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): master:41197-0x10038f6caa60000, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,38709,1675944190239 2023-02-09 12:03:12,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 12:03:12,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 12:03:12,302 DEBUG [(jenkins-hbase4.apache.org,41197,1675944190195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 12:03:12,302 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): regionserver:38709-0x10038f6caa60001, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 12:03:12,301 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): regionserver:34509-0x10038f6caa60002, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 12:03:12,302 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-09 12:03:12,302 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): master:41197-0x10038f6caa60000, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-09 12:03:12,303 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 12:03:12,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 12:03:12,303 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-09 12:03:12,303 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): regionserver:34509-0x10038f6caa60002, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 12:03:12,303 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): master:41197-0x10038f6caa60000, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,34509,1675944190270 2023-02-09 12:03:12,303 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 12:03:12,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 12:03:12,303 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): master:41197-0x10038f6caa60000, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-09 12:03:12,303 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): master:41197-0x10038f6caa60000, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,38709,1675944190239 2023-02-09 12:03:12,303 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): master:41197-0x10038f6caa60000, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-09 12:03:12,303 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): master:41197-0x10038f6caa60000, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,34509,1675944190270 2023-02-09 12:03:12,303 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): master:41197-0x10038f6caa60000, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-09 12:03:12,303 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): master:41197-0x10038f6caa60000, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-09 12:03:12,304 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 12:03:12,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 12:03:12,304 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/.hbase-snapshot/.tmp/foo 2023-02-09 12:03:12,325 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/.hbase-snapshot/.tmp/foo to hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/.hbase-snapshot/foo 2023-02-09 12:03:12,341 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testInitTableSnapshotMapperJobConfig completed 2023-02-09 12:03:12,341 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/.hbase-snapshot/.tmp/foo 2023-02-09 12:03:12,342 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/.hbase-snapshot/.tmp/foo 2023-02-09 12:03:12,342 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig at 1675944192191Consolidate snapshot: foo at 1675944192303 (+112 ms)Loading Region manifests for foo at 1675944192303Writing data manifest for foo at 1675944192309 (+6 ms)Verifying snapshot: foo at 1675944192318 (+9 ms)Snapshot foo of table testInitTableSnapshotMapperJobConfig completed at 1675944192341 (+23 ms) 2023-02-09 12:03:12,343 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-09 12:03:12,344 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED in 151 msec 2023-02-09 12:03:12,482 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-09 12:03:12,495 DEBUG [Listener at localhost/42145] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 12:03:12,495 INFO [Listener at localhost/42145] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:12,495 INFO [Listener at localhost/42145] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:12,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41197] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-09 12:03:12,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41197] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-09 12:03:12,497 INFO [Listener at localhost/42145] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-09 12:03:12,497 INFO [Listener at localhost/42145] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:12,497 INFO [Listener at localhost/42145] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:12,504 INFO [Listener at localhost/42145] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-09 12:03:12,512 INFO [Listener at localhost/42145] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-09 12:03:12,568 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34509] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testInitTableSnapshotMapperJobConfig,,1675944191412.07b31a22b55ccadb5db1b8527a9ec4b4. 2023-02-09 12:03:12,714 INFO [Listener at localhost/42145] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-09 12:03:12,719 INFO [Listener at localhost/42145] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:12,719 INFO [Listener at localhost/42145] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:12,721 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41197] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 12:03:12,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41197] procedure.ProcedureCoordinator(165): Submitting procedure testInitTableSnapshotMapperJobConfig 2023-02-09 12:03:12,723 INFO [(jenkins-hbase4.apache.org,41197,1675944190195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testInitTableSnapshotMapperJobConfig' 2023-02-09 12:03:12,723 DEBUG [(jenkins-hbase4.apache.org,41197,1675944190195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 12:03:12,724 DEBUG [(jenkins-hbase4.apache.org,41197,1675944190195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' 2023-02-09 12:03:12,724 DEBUG [(jenkins-hbase4.apache.org,41197,1675944190195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testInitTableSnapshotMapperJobConfig', kicking off acquire phase on members. 2023-02-09 12:03:12,725 DEBUG [(jenkins-hbase4.apache.org,41197,1675944190195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41197-0x10038f6caa60000, quorum=127.0.0.1:55305, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-09 12:03:12,725 DEBUG [(jenkins-hbase4.apache.org,41197,1675944190195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-09 12:03:12,727 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): regionserver:34509-0x10038f6caa60002, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 12:03:12,727 DEBUG [(jenkins-hbase4.apache.org,41197,1675944190195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,34509,1675944190270 2023-02-09 12:03:12,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 12:03:12,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 12:03:12,727 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): regionserver:38709-0x10038f6caa60001, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 12:03:12,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 12:03:12,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 12:03:12,728 DEBUG [(jenkins-hbase4.apache.org,41197,1675944190195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41197-0x10038f6caa60000, quorum=127.0.0.1:55305, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,34509,1675944190270 2023-02-09 12:03:12,728 DEBUG [(jenkins-hbase4.apache.org,41197,1675944190195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 12:03:12,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-09 12:03:12,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-09 12:03:12,728 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34509-0x10038f6caa60002, quorum=127.0.0.1:55305, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-09 12:03:12,728 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38709-0x10038f6caa60001, quorum=127.0.0.1:55305, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-09 12:03:12,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 12:03:12,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-09 12:03:12,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 12:03:12,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-09 12:03:12,729 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-09 12:03:12,729 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-09 12:03:12,729 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-09 12:03:12,729 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-09 12:03:12,730 DEBUG [member: 'jenkins-hbase4.apache.org,34509,1675944190270' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-09 12:03:12,730 DEBUG [member: 'jenkins-hbase4.apache.org,34509,1675944190270' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 12:03:12,730 DEBUG [member: 'jenkins-hbase4.apache.org,38709,1675944190239' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-09 12:03:12,731 DEBUG [member: 'jenkins-hbase4.apache.org,34509,1675944190270' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-09 12:03:12,731 DEBUG [member: 'jenkins-hbase4.apache.org,38709,1675944190239' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 12:03:12,731 DEBUG [member: 'jenkins-hbase4.apache.org,34509,1675944190270' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 12:03:12,731 DEBUG [member: 'jenkins-hbase4.apache.org,38709,1675944190239' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-09 12:03:12,731 DEBUG [rs(jenkins-hbase4.apache.org,34509,1675944190270)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testInitTableSnapshotMapperJobConfig,,1675944191412.07b31a22b55ccadb5db1b8527a9ec4b4. 2023-02-09 12:03:12,731 DEBUG [member: 'jenkins-hbase4.apache.org,34509,1675944190270' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 12:03:12,732 DEBUG [rs(jenkins-hbase4.apache.org,34509,1675944190270)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testInitTableSnapshotMapperJobConfig,,1675944191412.07b31a22b55ccadb5db1b8527a9ec4b4. started... 2023-02-09 12:03:12,732 DEBUG [member: 'jenkins-hbase4.apache.org,38709,1675944190239' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-09 12:03:12,732 DEBUG [member: 'jenkins-hbase4.apache.org,38709,1675944190239' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38709,1675944190239' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-09 12:03:12,732 INFO [rs(jenkins-hbase4.apache.org,34509,1675944190270)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 07b31a22b55ccadb5db1b8527a9ec4b4 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-09 12:03:12,734 DEBUG [member: 'jenkins-hbase4.apache.org,38709,1675944190239' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-09 12:03:12,734 DEBUG [member: 'jenkins-hbase4.apache.org,38709,1675944190239' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38709-0x10038f6caa60001, quorum=127.0.0.1:55305, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-09 12:03:12,735 DEBUG [member: 'jenkins-hbase4.apache.org,38709,1675944190239' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 12:03:12,753 INFO [rs(jenkins-hbase4.apache.org,34509,1675944190270)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/data/default/testInitTableSnapshotMapperJobConfig/07b31a22b55ccadb5db1b8527a9ec4b4/.tmp/f1/28a9ed1269bf4a92b8e481c329708e53 2023-02-09 12:03:12,773 INFO [rs(jenkins-hbase4.apache.org,34509,1675944190270)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/data/default/testInitTableSnapshotMapperJobConfig/07b31a22b55ccadb5db1b8527a9ec4b4/.tmp/f2/95ebfcb5250f409b8d329719d00c2407 2023-02-09 12:03:12,778 DEBUG [rs(jenkins-hbase4.apache.org,34509,1675944190270)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/data/default/testInitTableSnapshotMapperJobConfig/07b31a22b55ccadb5db1b8527a9ec4b4/.tmp/f1/28a9ed1269bf4a92b8e481c329708e53 as hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/data/default/testInitTableSnapshotMapperJobConfig/07b31a22b55ccadb5db1b8527a9ec4b4/f1/28a9ed1269bf4a92b8e481c329708e53 2023-02-09 12:03:12,782 INFO [rs(jenkins-hbase4.apache.org,34509,1675944190270)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/data/default/testInitTableSnapshotMapperJobConfig/07b31a22b55ccadb5db1b8527a9ec4b4/f1/28a9ed1269bf4a92b8e481c329708e53, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-09 12:03:12,782 DEBUG [rs(jenkins-hbase4.apache.org,34509,1675944190270)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/data/default/testInitTableSnapshotMapperJobConfig/07b31a22b55ccadb5db1b8527a9ec4b4/.tmp/f2/95ebfcb5250f409b8d329719d00c2407 as hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/data/default/testInitTableSnapshotMapperJobConfig/07b31a22b55ccadb5db1b8527a9ec4b4/f2/95ebfcb5250f409b8d329719d00c2407 2023-02-09 12:03:12,787 INFO [rs(jenkins-hbase4.apache.org,34509,1675944190270)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/data/default/testInitTableSnapshotMapperJobConfig/07b31a22b55ccadb5db1b8527a9ec4b4/f2/95ebfcb5250f409b8d329719d00c2407, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-09 12:03:12,788 INFO [rs(jenkins-hbase4.apache.org,34509,1675944190270)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 07b31a22b55ccadb5db1b8527a9ec4b4 in 56ms, sequenceid=9, compaction requested=false 2023-02-09 12:03:12,788 DEBUG [rs(jenkins-hbase4.apache.org,34509,1675944190270)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 07b31a22b55ccadb5db1b8527a9ec4b4: 2023-02-09 12:03:12,788 DEBUG [rs(jenkins-hbase4.apache.org,34509,1675944190270)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testInitTableSnapshotMapperJobConfig,,1675944191412.07b31a22b55ccadb5db1b8527a9ec4b4. 2023-02-09 12:03:12,788 DEBUG [member: 'jenkins-hbase4.apache.org,34509,1675944190270' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 12:03:12,788 DEBUG [member: 'jenkins-hbase4.apache.org,34509,1675944190270' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 12:03:12,788 DEBUG [member: 'jenkins-hbase4.apache.org,34509,1675944190270' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,34509,1675944190270 2023-02-09 12:03:12,788 DEBUG [member: 'jenkins-hbase4.apache.org,34509,1675944190270' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-09 12:03:12,788 DEBUG [member: 'jenkins-hbase4.apache.org,34509,1675944190270' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34509,1675944190270' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-09 12:03:12,790 DEBUG [member: 'jenkins-hbase4.apache.org,34509,1675944190270' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-09 12:03:12,790 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): master:41197-0x10038f6caa60000, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,34509,1675944190270 2023-02-09 12:03:12,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,34509,1675944190270 2023-02-09 12:03:12,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 12:03:12,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 12:03:12,790 DEBUG [member: 'jenkins-hbase4.apache.org,34509,1675944190270' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34509-0x10038f6caa60002, quorum=127.0.0.1:55305, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-09 12:03:12,790 DEBUG [member: 'jenkins-hbase4.apache.org,34509,1675944190270' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 12:03:12,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 12:03:12,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 12:03:12,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-09 12:03:12,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34509,1675944190270 2023-02-09 12:03:12,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38709,1675944190239 2023-02-09 12:03:12,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 12:03:12,792 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34509,1675944190270' joining acquired barrier for procedure 'testInitTableSnapshotMapperJobConfig' on coordinator 2023-02-09 12:03:12,792 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@78e014fb[Count = 0] remaining members to acquire global barrier 2023-02-09 12:03:12,792 DEBUG [(jenkins-hbase4.apache.org,41197,1675944190195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'in-barrier' execution. 2023-02-09 12:03:12,792 DEBUG [(jenkins-hbase4.apache.org,41197,1675944190195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-09 12:03:12,793 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): regionserver:34509-0x10038f6caa60002, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-09 12:03:12,793 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): regionserver:38709-0x10038f6caa60001, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-09 12:03:12,793 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-09 12:03:12,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-09 12:03:12,793 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-09 12:03:12,793 DEBUG [member: 'jenkins-hbase4.apache.org,34509,1675944190270' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-09 12:03:12,794 DEBUG [member: 'jenkins-hbase4.apache.org,34509,1675944190270' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-09 12:03:12,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-09 12:03:12,794 DEBUG [(jenkins-hbase4.apache.org,41197,1675944190195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41197-0x10038f6caa60000, quorum=127.0.0.1:55305, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,34509,1675944190270 2023-02-09 12:03:12,794 DEBUG [member: 'jenkins-hbase4.apache.org,38709,1675944190239' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-09 12:03:12,794 DEBUG [(jenkins-hbase4.apache.org,41197,1675944190195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 12:03:12,794 DEBUG [member: 'jenkins-hbase4.apache.org,38709,1675944190239' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-09 12:03:12,794 DEBUG [member: 'jenkins-hbase4.apache.org,38709,1675944190239' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase4.apache.org,38709,1675944190239' in zk 2023-02-09 12:03:12,794 DEBUG [member: 'jenkins-hbase4.apache.org,34509,1675944190270' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase4.apache.org,34509,1675944190270' in zk 2023-02-09 12:03:12,797 DEBUG [member: 'jenkins-hbase4.apache.org,38709,1675944190239' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-09 12:03:12,798 DEBUG [member: 'jenkins-hbase4.apache.org,38709,1675944190239' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 12:03:12,798 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): master:41197-0x10038f6caa60000, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,34509,1675944190270 2023-02-09 12:03:12,798 DEBUG [member: 'jenkins-hbase4.apache.org,38709,1675944190239' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-09 12:03:12,798 DEBUG [member: 'jenkins-hbase4.apache.org,34509,1675944190270' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-09 12:03:12,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,34509,1675944190270 2023-02-09 12:03:12,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 12:03:12,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 12:03:12,799 DEBUG [member: 'jenkins-hbase4.apache.org,34509,1675944190270' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 12:03:12,799 DEBUG [member: 'jenkins-hbase4.apache.org,34509,1675944190270' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-09 12:03:12,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 12:03:12,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 12:03:12,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-09 12:03:12,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34509,1675944190270 2023-02-09 12:03:12,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38709,1675944190239 2023-02-09 12:03:12,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 12:03:12,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-09 12:03:12,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34509,1675944190270 2023-02-09 12:03:12,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38709,1675944190239 2023-02-09 12:03:12,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testInitTableSnapshotMapperJobConfig' member 'jenkins-hbase4.apache.org,34509,1675944190270': 2023-02-09 12:03:12,802 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34509,1675944190270' released barrier for procedure'testInitTableSnapshotMapperJobConfig', counting down latch. Waiting for 0 more 2023-02-09 12:03:12,802 INFO [(jenkins-hbase4.apache.org,41197,1675944190195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testInitTableSnapshotMapperJobConfig' execution completed 2023-02-09 12:03:12,802 DEBUG [(jenkins-hbase4.apache.org,41197,1675944190195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 12:03:12,802 DEBUG [(jenkins-hbase4.apache.org,41197,1675944190195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 12:03:12,802 DEBUG [(jenkins-hbase4.apache.org,41197,1675944190195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testInitTableSnapshotMapperJobConfig 2023-02-09 12:03:12,802 INFO [(jenkins-hbase4.apache.org,41197,1675944190195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testInitTableSnapshotMapperJobConfigincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 12:03:12,804 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): regionserver:34509-0x10038f6caa60002, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-09 12:03:12,804 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): master:41197-0x10038f6caa60000, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-09 12:03:12,804 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-09 12:03:12,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-09 12:03:12,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 12:03:12,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 12:03:12,804 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): regionserver:38709-0x10038f6caa60001, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-09 12:03:12,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-09 12:03:12,804 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): regionserver:34509-0x10038f6caa60002, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 12:03:12,804 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-09 12:03:12,804 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): regionserver:38709-0x10038f6caa60001, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 12:03:12,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-09 12:03:12,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 12:03:12,804 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 12:03:12,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 12:03:12,804 DEBUG [(jenkins-hbase4.apache.org,41197,1675944190195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41197-0x10038f6caa60000, quorum=127.0.0.1:55305, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,34509,1675944190270 2023-02-09 12:03:12,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 12:03:12,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 12:03:12,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-09 12:03:12,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-09 12:03:12,805 DEBUG [(jenkins-hbase4.apache.org,41197,1675944190195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41197-0x10038f6caa60000, quorum=127.0.0.1:55305, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,38709,1675944190239 2023-02-09 12:03:12,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-09 12:03:12,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 12:03:12,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-09 12:03:12,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34509,1675944190270 2023-02-09 12:03:12,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38709,1675944190239 2023-02-09 12:03:12,806 DEBUG [(jenkins-hbase4.apache.org,41197,1675944190195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41197-0x10038f6caa60000, quorum=127.0.0.1:55305, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,34509,1675944190270 2023-02-09 12:03:12,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 12:03:12,806 DEBUG [(jenkins-hbase4.apache.org,41197,1675944190195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41197-0x10038f6caa60000, quorum=127.0.0.1:55305, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,38709,1675944190239 2023-02-09 12:03:12,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-09 12:03:12,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34509,1675944190270 2023-02-09 12:03:12,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38709,1675944190239 2023-02-09 12:03:12,809 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): master:41197-0x10038f6caa60000, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,38709,1675944190239 2023-02-09 12:03:12,809 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): regionserver:38709-0x10038f6caa60001, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 12:03:12,809 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): master:41197-0x10038f6caa60000, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-09 12:03:12,809 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 12:03:12,809 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): master:41197-0x10038f6caa60000, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,34509,1675944190270 2023-02-09 12:03:12,809 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): regionserver:34509-0x10038f6caa60002, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 12:03:12,809 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): master:41197-0x10038f6caa60000, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-09 12:03:12,809 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): regionserver:38709-0x10038f6caa60001, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 12:03:12,809 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41197] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testInitTableSnapshotMapperJobConfig' 2023-02-09 12:03:12,809 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41197] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 12:03:12,809 DEBUG [(jenkins-hbase4.apache.org,41197,1675944190195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 12:03:12,809 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): master:41197-0x10038f6caa60000, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,38709,1675944190239 2023-02-09 12:03:12,809 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 12:03:12,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 12:03:12,809 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): regionserver:34509-0x10038f6caa60002, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 12:03:12,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 12:03:12,809 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): master:41197-0x10038f6caa60000, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-09 12:03:12,810 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): master:41197-0x10038f6caa60000, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,34509,1675944190270 2023-02-09 12:03:12,810 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): master:41197-0x10038f6caa60000, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-09 12:03:12,810 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): master:41197-0x10038f6caa60000, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-09 12:03:12,810 DEBUG [Listener at localhost/42145] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testInitTableSnapshotMapperJobConfig'' to complete. (max 20000 ms per retry) 2023-02-09 12:03:12,810 DEBUG [Listener at localhost/42145] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 12:03:12,810 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 12:03:12,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 12:03:12,810 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 12:03:12,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 12:03:12,911 DEBUG [Listener at localhost/42145] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 12:03:12,911 INFO [Listener at localhost/42145] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:12,911 INFO [Listener at localhost/42145] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:12,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41197] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 12:03:12,918 INFO [Listener at localhost/42145] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1675944192171 type: FLUSH version: 2 ttl: 0 2023-02-09 12:03:12,918 DEBUG [Listener at localhost/42145] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:37835/user/jenkins/test-data/ce8a350a-5bc7-c072-c50e-5bb44ffebfd5/foo/e9a5a4e6-af62-4b9e-a3df-12730a97cad3/data/default/testInitTableSnapshotMapperJobConfig 2023-02-09 12:03:12,918 INFO [Listener at localhost/42145] snapshot.RestoreSnapshotHelper(239): region to add: 07b31a22b55ccadb5db1b8527a9ec4b4 2023-02-09 12:03:12,918 INFO [Listener at localhost/42145] snapshot.RestoreSnapshotHelper(585): clone region=07b31a22b55ccadb5db1b8527a9ec4b4 as 07b31a22b55ccadb5db1b8527a9ec4b4 in snapshot foo 2023-02-09 12:03:12,919 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 07b31a22b55ccadb5db1b8527a9ec4b4, NAME => 'testInitTableSnapshotMapperJobConfig,,1675944191412.07b31a22b55ccadb5db1b8527a9ec4b4.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37835/user/jenkins/test-data/ce8a350a-5bc7-c072-c50e-5bb44ffebfd5/foo/e9a5a4e6-af62-4b9e-a3df-12730a97cad3 2023-02-09 12:03:12,930 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1675944191412.07b31a22b55ccadb5db1b8527a9ec4b4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:12,930 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink ea5cc82460fb46b8b9173863a49b299e from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-09 12:03:12,932 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 26dc370555914cbd9caa5bb12eb82154 from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-09 12:03:12,934 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 07b31a22b55ccadb5db1b8527a9ec4b4, disabling compactions & flushes 2023-02-09 12:03:12,934 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1675944191412.07b31a22b55ccadb5db1b8527a9ec4b4. 2023-02-09 12:03:12,934 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1675944191412.07b31a22b55ccadb5db1b8527a9ec4b4. 2023-02-09 12:03:12,934 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1675944191412.07b31a22b55ccadb5db1b8527a9ec4b4. after waiting 0 ms 2023-02-09 12:03:12,934 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1675944191412.07b31a22b55ccadb5db1b8527a9ec4b4. 2023-02-09 12:03:12,934 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1675944191412.07b31a22b55ccadb5db1b8527a9ec4b4. 2023-02-09 12:03:12,934 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 07b31a22b55ccadb5db1b8527a9ec4b4: Waiting for close lock at 1675944192934Disabling compacts and flushes for region at 1675944192934Disabling writes for close at 1675944192934Writing region close event to WAL at 1675944192934Closed at 1675944192934 2023-02-09 12:03:12,934 INFO [Listener at localhost/42145] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1675944192171 type: FLUSH version: 2 ttl: 0 2023-02-09 12:03:12,934 DEBUG [Listener at localhost/42145] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:37835/user/jenkins/test-data/ce8a350a-5bc7-c072-c50e-5bb44ffebfd5/foo/e9a5a4e6-af62-4b9e-a3df-12730a97cad3 2023-02-09 12:03:12,934 DEBUG [Listener at localhost/42145] util.CommonFSUtils(682): File system contents for path hdfs://localhost:37835/user/jenkins/test-data/ce8a350a-5bc7-c072-c50e-5bb44ffebfd5/foo/e9a5a4e6-af62-4b9e-a3df-12730a97cad3 2023-02-09 12:03:12,935 DEBUG [Listener at localhost/42145] util.CommonFSUtils(699): |-data/ 2023-02-09 12:03:12,935 DEBUG [Listener at localhost/42145] util.CommonFSUtils(699): |----default/ 2023-02-09 12:03:12,936 DEBUG [Listener at localhost/42145] util.CommonFSUtils(699): |-------testInitTableSnapshotMapperJobConfig/ 2023-02-09 12:03:12,936 DEBUG [Listener at localhost/42145] util.CommonFSUtils(699): |----------07b31a22b55ccadb5db1b8527a9ec4b4/ 2023-02-09 12:03:12,937 DEBUG [Listener at localhost/42145] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 12:03:12,937 DEBUG [Listener at localhost/42145] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 12:03:12,937 DEBUG [Listener at localhost/42145] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=07b31a22b55ccadb5db1b8527a9ec4b4-ea5cc82460fb46b8b9173863a49b299e 2023-02-09 12:03:12,937 DEBUG [Listener at localhost/42145] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 12:03:12,937 DEBUG [Listener at localhost/42145] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=07b31a22b55ccadb5db1b8527a9ec4b4-26dc370555914cbd9caa5bb12eb82154 2023-02-09 12:03:12,938 INFO [Listener at localhost/42145] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:12,938 INFO [Listener at localhost/42145] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:12,939 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41197] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "foo" 2023-02-09 12:03:12,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41197] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-09 12:03:12,941 INFO [Listener at localhost/42145] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:12,942 INFO [Listener at localhost/42145] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:12,942 INFO [Listener at localhost/42145] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-09 12:03:12,942 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41197] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testInitTableSnapshotMapperJobConfig 2023-02-09 12:03:12,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41197] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-09 12:03:12,945 INFO [Listener at localhost/42145] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:12,945 INFO [Listener at localhost/42145] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:12,946 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675944192946"}]},"ts":"1675944192946"} 2023-02-09 12:03:12,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41197] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-09 12:03:12,947 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLING in hbase:meta 2023-02-09 12:03:12,948 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testInitTableSnapshotMapperJobConfig to state=DISABLING 2023-02-09 12:03:12,949 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=07b31a22b55ccadb5db1b8527a9ec4b4, UNASSIGN}] 2023-02-09 12:03:12,950 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=07b31a22b55ccadb5db1b8527a9ec4b4, UNASSIGN 2023-02-09 12:03:12,951 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=07b31a22b55ccadb5db1b8527a9ec4b4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34509,1675944190270 2023-02-09 12:03:12,951 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1675944191412.07b31a22b55ccadb5db1b8527a9ec4b4.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1675944192951"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675944192951"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675944192951"}]},"ts":"1675944192951"} 2023-02-09 12:03:12,952 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 07b31a22b55ccadb5db1b8527a9ec4b4, server=jenkins-hbase4.apache.org,34509,1675944190270}] 2023-02-09 12:03:13,046 INFO [Listener at localhost/42145] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:13,047 INFO [Listener at localhost/42145] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:13,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41197] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-09 12:03:13,104 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 07b31a22b55ccadb5db1b8527a9ec4b4 2023-02-09 12:03:13,105 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 07b31a22b55ccadb5db1b8527a9ec4b4, disabling compactions & flushes 2023-02-09 12:03:13,105 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1675944191412.07b31a22b55ccadb5db1b8527a9ec4b4. 2023-02-09 12:03:13,105 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1675944191412.07b31a22b55ccadb5db1b8527a9ec4b4. 2023-02-09 12:03:13,105 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1675944191412.07b31a22b55ccadb5db1b8527a9ec4b4. after waiting 0 ms 2023-02-09 12:03:13,105 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1675944191412.07b31a22b55ccadb5db1b8527a9ec4b4. 2023-02-09 12:03:13,109 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/data/default/testInitTableSnapshotMapperJobConfig/07b31a22b55ccadb5db1b8527a9ec4b4/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 12:03:13,110 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1675944191412.07b31a22b55ccadb5db1b8527a9ec4b4. 2023-02-09 12:03:13,110 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 07b31a22b55ccadb5db1b8527a9ec4b4: Waiting for close lock at 1675944193105Running coprocessor pre-close hooks at 1675944193105Disabling compacts and flushes for region at 1675944193105Disabling writes for close at 1675944193105Writing region close event to WAL at 1675944193106 (+1 ms)Running coprocessor post-close hooks at 1675944193109 (+3 ms)Closed at 1675944193110 (+1 ms) 2023-02-09 12:03:13,112 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 07b31a22b55ccadb5db1b8527a9ec4b4 2023-02-09 12:03:13,112 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=07b31a22b55ccadb5db1b8527a9ec4b4, regionState=CLOSED 2023-02-09 12:03:13,112 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1675944191412.07b31a22b55ccadb5db1b8527a9ec4b4.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1675944193112"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675944193112"}]},"ts":"1675944193112"} 2023-02-09 12:03:13,115 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-09 12:03:13,115 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 07b31a22b55ccadb5db1b8527a9ec4b4, server=jenkins-hbase4.apache.org,34509,1675944190270 in 162 msec 2023-02-09 12:03:13,116 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-09 12:03:13,116 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=07b31a22b55ccadb5db1b8527a9ec4b4, UNASSIGN in 166 msec 2023-02-09 12:03:13,117 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675944193117"}]},"ts":"1675944193117"} 2023-02-09 12:03:13,118 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLED in hbase:meta 2023-02-09 12:03:13,121 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testInitTableSnapshotMapperJobConfig to state=DISABLED 2023-02-09 12:03:13,122 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig in 179 msec 2023-02-09 12:03:13,248 INFO [Listener at localhost/42145] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:13,248 INFO [Listener at localhost/42145] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:13,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41197] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-09 12:03:13,250 INFO [Listener at localhost/42145] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 15 completed 2023-02-09 12:03:13,250 INFO [Listener at localhost/42145] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:13,250 INFO [Listener at localhost/42145] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:13,251 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41197] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testInitTableSnapshotMapperJobConfig 2023-02-09 12:03:13,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41197] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-09 12:03:13,254 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-09 12:03:13,254 INFO [Listener at localhost/42145] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:13,254 INFO [Listener at localhost/42145] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:13,254 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-09 12:03:13,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41197] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-09 12:03:13,258 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/.tmp/data/default/testInitTableSnapshotMapperJobConfig/07b31a22b55ccadb5db1b8527a9ec4b4 2023-02-09 12:03:13,260 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/.tmp/data/default/testInitTableSnapshotMapperJobConfig/07b31a22b55ccadb5db1b8527a9ec4b4/f1, FileablePath, hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/.tmp/data/default/testInitTableSnapshotMapperJobConfig/07b31a22b55ccadb5db1b8527a9ec4b4/f2, FileablePath, hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/.tmp/data/default/testInitTableSnapshotMapperJobConfig/07b31a22b55ccadb5db1b8527a9ec4b4/recovered.edits] 2023-02-09 12:03:13,264 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/.tmp/data/default/testInitTableSnapshotMapperJobConfig/07b31a22b55ccadb5db1b8527a9ec4b4/f1/28a9ed1269bf4a92b8e481c329708e53 to hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/archive/data/default/testInitTableSnapshotMapperJobConfig/07b31a22b55ccadb5db1b8527a9ec4b4/f1/28a9ed1269bf4a92b8e481c329708e53 2023-02-09 12:03:13,265 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/.tmp/data/default/testInitTableSnapshotMapperJobConfig/07b31a22b55ccadb5db1b8527a9ec4b4/f1/ea5cc82460fb46b8b9173863a49b299e to hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/archive/data/default/testInitTableSnapshotMapperJobConfig/07b31a22b55ccadb5db1b8527a9ec4b4/f1/ea5cc82460fb46b8b9173863a49b299e 2023-02-09 12:03:13,267 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/.tmp/data/default/testInitTableSnapshotMapperJobConfig/07b31a22b55ccadb5db1b8527a9ec4b4/f2/26dc370555914cbd9caa5bb12eb82154 to hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/archive/data/default/testInitTableSnapshotMapperJobConfig/07b31a22b55ccadb5db1b8527a9ec4b4/f2/26dc370555914cbd9caa5bb12eb82154 2023-02-09 12:03:13,269 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/.tmp/data/default/testInitTableSnapshotMapperJobConfig/07b31a22b55ccadb5db1b8527a9ec4b4/f2/95ebfcb5250f409b8d329719d00c2407 to hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/archive/data/default/testInitTableSnapshotMapperJobConfig/07b31a22b55ccadb5db1b8527a9ec4b4/f2/95ebfcb5250f409b8d329719d00c2407 2023-02-09 12:03:13,271 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/.tmp/data/default/testInitTableSnapshotMapperJobConfig/07b31a22b55ccadb5db1b8527a9ec4b4/recovered.edits/12.seqid to hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/archive/data/default/testInitTableSnapshotMapperJobConfig/07b31a22b55ccadb5db1b8527a9ec4b4/recovered.edits/12.seqid 2023-02-09 12:03:13,272 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/.tmp/data/default/testInitTableSnapshotMapperJobConfig/07b31a22b55ccadb5db1b8527a9ec4b4 2023-02-09 12:03:13,272 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-09 12:03:13,274 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-09 12:03:13,276 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testInitTableSnapshotMapperJobConfig from hbase:meta 2023-02-09 12:03:13,278 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testInitTableSnapshotMapperJobConfig' descriptor. 2023-02-09 12:03:13,279 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-09 12:03:13,279 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testInitTableSnapshotMapperJobConfig' from region states. 2023-02-09 12:03:13,279 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig,,1675944191412.07b31a22b55ccadb5db1b8527a9ec4b4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675944193279"}]},"ts":"9223372036854775807"} 2023-02-09 12:03:13,281 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-09 12:03:13,281 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 07b31a22b55ccadb5db1b8527a9ec4b4, NAME => 'testInitTableSnapshotMapperJobConfig,,1675944191412.07b31a22b55ccadb5db1b8527a9ec4b4.', STARTKEY => '', ENDKEY => ''}] 2023-02-09 12:03:13,281 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testInitTableSnapshotMapperJobConfig' as deleted. 2023-02-09 12:03:13,281 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1675944193281"}]},"ts":"9223372036854775807"} 2023-02-09 12:03:13,284 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testInitTableSnapshotMapperJobConfig state from META 2023-02-09 12:03:13,286 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-09 12:03:13,287 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig in 35 msec 2023-02-09 12:03:13,355 INFO [Listener at localhost/42145] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:13,355 INFO [Listener at localhost/42145] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:13,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41197] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-09 12:03:13,357 INFO [Listener at localhost/42145] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 18 completed 2023-02-09 12:03:13,357 INFO [Listener at localhost/42145] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-09 12:03:13,357 INFO [Listener at localhost/42145] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-09 12:03:13,358 DEBUG [Listener at localhost/42145] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3f3ec1c9 to 127.0.0.1:55305 2023-02-09 12:03:13,358 DEBUG [Listener at localhost/42145] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 12:03:13,358 DEBUG [Listener at localhost/42145] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-09 12:03:13,358 DEBUG [Listener at localhost/42145] util.JVMClusterUtil(257): Found active master hash=652064783, stopped=false 2023-02-09 12:03:13,358 INFO [Listener at localhost/42145] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,41197,1675944190195 2023-02-09 12:03:13,360 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): master:41197-0x10038f6caa60000, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 12:03:13,360 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): regionserver:38709-0x10038f6caa60001, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 12:03:13,360 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): regionserver:34509-0x10038f6caa60002, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 12:03:13,360 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): master:41197-0x10038f6caa60000, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 12:03:13,360 INFO [Listener at localhost/42145] procedure2.ProcedureExecutor(629): Stopping 2023-02-09 12:03:13,360 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38709-0x10038f6caa60001, quorum=127.0.0.1:55305, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 12:03:13,360 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34509-0x10038f6caa60002, quorum=127.0.0.1:55305, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 12:03:13,360 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41197-0x10038f6caa60000, quorum=127.0.0.1:55305, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 12:03:13,362 DEBUG [Listener at localhost/42145] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5697b87d to 127.0.0.1:55305 2023-02-09 12:03:13,362 DEBUG [Listener at localhost/42145] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 12:03:13,362 INFO [Listener at localhost/42145] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,38709,1675944190239' ***** 2023-02-09 12:03:13,362 INFO [Listener at localhost/42145] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-09 12:03:13,362 INFO [Listener at localhost/42145] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,34509,1675944190270' ***** 2023-02-09 12:03:13,362 INFO [Listener at localhost/42145] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-09 12:03:13,362 INFO [RS:1;jenkins-hbase4:34509] regionserver.HeapMemoryManager(220): Stopping 2023-02-09 12:03:13,362 INFO [RS:1;jenkins-hbase4:34509] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-09 12:03:13,362 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-09 12:03:13,362 INFO [RS:0;jenkins-hbase4:38709] regionserver.HeapMemoryManager(220): Stopping 2023-02-09 12:03:13,362 INFO [RS:1;jenkins-hbase4:34509] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-09 12:03:13,363 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-09 12:03:13,363 INFO [RS:1;jenkins-hbase4:34509] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,34509,1675944190270 2023-02-09 12:03:13,363 INFO [RS:0;jenkins-hbase4:38709] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-09 12:03:13,364 DEBUG [RS:1;jenkins-hbase4:34509] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x58c2741a to 127.0.0.1:55305 2023-02-09 12:03:13,364 INFO [RS:0;jenkins-hbase4:38709] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-09 12:03:13,365 DEBUG [RS:1;jenkins-hbase4:34509] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 12:03:13,365 INFO [RS:0;jenkins-hbase4:38709] regionserver.HRegionServer(3304): Received CLOSE for ca7ddc2cae0c83bc058659e4a1accf8c 2023-02-09 12:03:13,365 INFO [RS:1;jenkins-hbase4:34509] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,34509,1675944190270; all regions closed. 2023-02-09 12:03:13,365 INFO [RS:0;jenkins-hbase4:38709] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,38709,1675944190239 2023-02-09 12:03:13,365 DEBUG [RS:0;jenkins-hbase4:38709] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x32cbc5cf to 127.0.0.1:55305 2023-02-09 12:03:13,366 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing ca7ddc2cae0c83bc058659e4a1accf8c, disabling compactions & flushes 2023-02-09 12:03:13,366 DEBUG [RS:0;jenkins-hbase4:38709] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 12:03:13,366 INFO [RS:0;jenkins-hbase4:38709] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-09 12:03:13,366 INFO [RS:0;jenkins-hbase4:38709] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-09 12:03:13,366 INFO [RS:0;jenkins-hbase4:38709] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-09 12:03:13,366 INFO [RS:0;jenkins-hbase4:38709] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-09 12:03:13,366 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675944190859.ca7ddc2cae0c83bc058659e4a1accf8c. 2023-02-09 12:03:13,366 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675944190859.ca7ddc2cae0c83bc058659e4a1accf8c. 2023-02-09 12:03:13,366 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675944190859.ca7ddc2cae0c83bc058659e4a1accf8c. after waiting 0 ms 2023-02-09 12:03:13,366 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675944190859.ca7ddc2cae0c83bc058659e4a1accf8c. 2023-02-09 12:03:13,366 INFO [RS:0;jenkins-hbase4:38709] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-09 12:03:13,366 DEBUG [RS:0;jenkins-hbase4:38709] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740, ca7ddc2cae0c83bc058659e4a1accf8c=hbase:namespace,,1675944190859.ca7ddc2cae0c83bc058659e4a1accf8c.} 2023-02-09 12:03:13,366 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing ca7ddc2cae0c83bc058659e4a1accf8c 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-09 12:03:13,367 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-09 12:03:13,367 DEBUG [RS:0;jenkins-hbase4:38709] regionserver.HRegionServer(1505): Waiting on 1588230740, ca7ddc2cae0c83bc058659e4a1accf8c 2023-02-09 12:03:13,368 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-09 12:03:13,368 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-09 12:03:13,368 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-09 12:03:13,368 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-09 12:03:13,368 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.24 KB heapSize=7.64 KB 2023-02-09 12:03:13,372 DEBUG [RS:1;jenkins-hbase4:34509] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/oldWALs 2023-02-09 12:03:13,372 INFO [RS:1;jenkins-hbase4:34509] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34509%2C1675944190270:(num 1675944191570) 2023-02-09 12:03:13,372 DEBUG [RS:1;jenkins-hbase4:34509] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 12:03:13,372 INFO [RS:1;jenkins-hbase4:34509] regionserver.LeaseManager(133): Closed leases 2023-02-09 12:03:13,372 INFO [RS:1;jenkins-hbase4:34509] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-09 12:03:13,372 INFO [RS:1;jenkins-hbase4:34509] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-09 12:03:13,372 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 12:03:13,372 INFO [RS:1;jenkins-hbase4:34509] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-09 12:03:13,372 INFO [RS:1;jenkins-hbase4:34509] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-09 12:03:13,373 INFO [RS:1;jenkins-hbase4:34509] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34509 2023-02-09 12:03:13,374 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): regionserver:34509-0x10038f6caa60002, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34509,1675944190270 2023-02-09 12:03:13,374 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): regionserver:34509-0x10038f6caa60002, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 12:03:13,374 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): regionserver:38709-0x10038f6caa60001, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34509,1675944190270 2023-02-09 12:03:13,374 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): master:41197-0x10038f6caa60000, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 12:03:13,374 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): regionserver:38709-0x10038f6caa60001, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 12:03:13,375 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,34509,1675944190270] 2023-02-09 12:03:13,375 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,34509,1675944190270; numProcessing=1 2023-02-09 12:03:13,378 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,34509,1675944190270 already deleted, retry=false 2023-02-09 12:03:13,378 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,34509,1675944190270 expired; onlineServers=1 2023-02-09 12:03:13,386 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/data/hbase/namespace/ca7ddc2cae0c83bc058659e4a1accf8c/.tmp/info/cdcf19a326e34e0aa01b038cc13eb5c4 2023-02-09 12:03:13,387 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.60 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/data/hbase/meta/1588230740/.tmp/info/89bd8eb52d6245dcbfbe12b495a17e91 2023-02-09 12:03:13,391 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 89bd8eb52d6245dcbfbe12b495a17e91 2023-02-09 12:03:13,392 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/data/hbase/namespace/ca7ddc2cae0c83bc058659e4a1accf8c/.tmp/info/cdcf19a326e34e0aa01b038cc13eb5c4 as hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/data/hbase/namespace/ca7ddc2cae0c83bc058659e4a1accf8c/info/cdcf19a326e34e0aa01b038cc13eb5c4 2023-02-09 12:03:13,396 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/data/hbase/namespace/ca7ddc2cae0c83bc058659e4a1accf8c/info/cdcf19a326e34e0aa01b038cc13eb5c4, entries=2, sequenceid=6, filesize=4.8 K 2023-02-09 12:03:13,397 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for ca7ddc2cae0c83bc058659e4a1accf8c in 31ms, sequenceid=6, compaction requested=false 2023-02-09 12:03:13,399 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=116 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/data/hbase/meta/1588230740/.tmp/rep_barrier/43e952525dca4d929eab99b256fd26ab 2023-02-09 12:03:13,400 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/data/hbase/namespace/ca7ddc2cae0c83bc058659e4a1accf8c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-09 12:03:13,402 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675944190859.ca7ddc2cae0c83bc058659e4a1accf8c. 2023-02-09 12:03:13,402 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for ca7ddc2cae0c83bc058659e4a1accf8c: Waiting for close lock at 1675944193365Running coprocessor pre-close hooks at 1675944193365Disabling compacts and flushes for region at 1675944193365Disabling writes for close at 1675944193366 (+1 ms)Obtaining lock to block concurrent updates at 1675944193367 (+1 ms)Preparing flush snapshotting stores in ca7ddc2cae0c83bc058659e4a1accf8c at 1675944193367Finished memstore snapshotting hbase:namespace,,1675944190859.ca7ddc2cae0c83bc058659e4a1accf8c., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1675944193368 (+1 ms)Flushing stores of hbase:namespace,,1675944190859.ca7ddc2cae0c83bc058659e4a1accf8c. at 1675944193370 (+2 ms)Flushing ca7ddc2cae0c83bc058659e4a1accf8c/info: creating writer at 1675944193370Flushing ca7ddc2cae0c83bc058659e4a1accf8c/info: appending metadata at 1675944193374 (+4 ms)Flushing ca7ddc2cae0c83bc058659e4a1accf8c/info: closing flushed file at 1675944193374Flushing ca7ddc2cae0c83bc058659e4a1accf8c/info: reopening flushed file at 1675944193392 (+18 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for ca7ddc2cae0c83bc058659e4a1accf8c in 31ms, sequenceid=6, compaction requested=false at 1675944193397 (+5 ms)Writing region close event to WAL at 1675944193398 (+1 ms)Running coprocessor post-close hooks at 1675944193401 (+3 ms)Closed at 1675944193402 (+1 ms) 2023-02-09 12:03:13,402 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1675944190859.ca7ddc2cae0c83bc058659e4a1accf8c. 2023-02-09 12:03:13,404 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 43e952525dca4d929eab99b256fd26ab 2023-02-09 12:03:13,411 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=542 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/data/hbase/meta/1588230740/.tmp/table/60f9d797c9ee470397a5d57f5842f912 2023-02-09 12:03:13,414 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 60f9d797c9ee470397a5d57f5842f912 2023-02-09 12:03:13,415 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/data/hbase/meta/1588230740/.tmp/info/89bd8eb52d6245dcbfbe12b495a17e91 as hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/data/hbase/meta/1588230740/info/89bd8eb52d6245dcbfbe12b495a17e91 2023-02-09 12:03:13,419 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 89bd8eb52d6245dcbfbe12b495a17e91 2023-02-09 12:03:13,419 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/data/hbase/meta/1588230740/info/89bd8eb52d6245dcbfbe12b495a17e91, entries=12, sequenceid=21, filesize=6.3 K 2023-02-09 12:03:13,420 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/data/hbase/meta/1588230740/.tmp/rep_barrier/43e952525dca4d929eab99b256fd26ab as hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/data/hbase/meta/1588230740/rep_barrier/43e952525dca4d929eab99b256fd26ab 2023-02-09 12:03:13,424 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 43e952525dca4d929eab99b256fd26ab 2023-02-09 12:03:13,424 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/data/hbase/meta/1588230740/rep_barrier/43e952525dca4d929eab99b256fd26ab, entries=1, sequenceid=21, filesize=5.0 K 2023-02-09 12:03:13,425 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/data/hbase/meta/1588230740/.tmp/table/60f9d797c9ee470397a5d57f5842f912 as hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/data/hbase/meta/1588230740/table/60f9d797c9ee470397a5d57f5842f912 2023-02-09 12:03:13,429 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 60f9d797c9ee470397a5d57f5842f912 2023-02-09 12:03:13,429 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/data/hbase/meta/1588230740/table/60f9d797c9ee470397a5d57f5842f912, entries=4, sequenceid=21, filesize=5.1 K 2023-02-09 12:03:13,430 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.24 KB/4340, heapSize ~7.59 KB/7776, currentSize=0 B/0 for 1588230740 in 62ms, sequenceid=21, compaction requested=false 2023-02-09 12:03:13,433 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-09 12:03:13,434 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-09 12:03:13,435 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-09 12:03:13,435 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675944193366Running coprocessor pre-close hooks at 1675944193366Disabling compacts and flushes for region at 1675944193366Disabling writes for close at 1675944193368 (+2 ms)Obtaining lock to block concurrent updates at 1675944193368Preparing flush snapshotting stores in 1588230740 at 1675944193368Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=4340, getHeapSize=7776, getOffHeapSize=0, getCellsCount=36 at 1675944193369 (+1 ms)Flushing stores of hbase:meta,,1.1588230740 at 1675944193371 (+2 ms)Flushing 1588230740/info: creating writer at 1675944193371Flushing 1588230740/info: appending metadata at 1675944193374 (+3 ms)Flushing 1588230740/info: closing flushed file at 1675944193374Flushing 1588230740/rep_barrier: creating writer at 1675944193392 (+18 ms)Flushing 1588230740/rep_barrier: appending metadata at 1675944193394 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1675944193394Flushing 1588230740/table: creating writer at 1675944193404 (+10 ms)Flushing 1588230740/table: appending metadata at 1675944193406 (+2 ms)Flushing 1588230740/table: closing flushed file at 1675944193406Flushing 1588230740/info: reopening flushed file at 1675944193415 (+9 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1675944193420 (+5 ms)Flushing 1588230740/table: reopening flushed file at 1675944193425 (+5 ms)Finished flush of dataSize ~4.24 KB/4340, heapSize ~7.59 KB/7776, currentSize=0 B/0 for 1588230740 in 62ms, sequenceid=21, compaction requested=false at 1675944193430 (+5 ms)Writing region close event to WAL at 1675944193431 (+1 ms)Running coprocessor post-close hooks at 1675944193434 (+3 ms)Closed at 1675944193435 (+1 ms) 2023-02-09 12:03:13,435 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-09 12:03:13,456 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-09 12:03:13,456 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-09 12:03:13,548 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-09 12:03:13,548 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-09 12:03:13,560 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): regionserver:34509-0x10038f6caa60002, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 12:03:13,560 INFO [RS:1;jenkins-hbase4:34509] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,34509,1675944190270; zookeeper connection closed. 2023-02-09 12:03:13,560 ERROR [Listener at localhost/42145-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2aeaa49c rejected from java.util.concurrent.ThreadPoolExecutor@2ed53519[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 12:03:13,560 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): regionserver:34509-0x10038f6caa60002, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 12:03:13,560 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@291eae7d] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@291eae7d 2023-02-09 12:03:13,560 ERROR [Listener at localhost/42145-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@25477ba2 rejected from java.util.concurrent.ThreadPoolExecutor@2ed53519[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 12:03:13,568 INFO [RS:0;jenkins-hbase4:38709] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,38709,1675944190239; all regions closed. 2023-02-09 12:03:13,574 DEBUG [RS:0;jenkins-hbase4:38709] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/oldWALs 2023-02-09 12:03:13,574 INFO [RS:0;jenkins-hbase4:38709] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38709%2C1675944190239.meta:.meta(num 1675944190799) 2023-02-09 12:03:13,579 DEBUG [RS:0;jenkins-hbase4:38709] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/oldWALs 2023-02-09 12:03:13,579 INFO [RS:0;jenkins-hbase4:38709] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38709%2C1675944190239:(num 1675944191206) 2023-02-09 12:03:13,579 DEBUG [RS:0;jenkins-hbase4:38709] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 12:03:13,579 INFO [RS:0;jenkins-hbase4:38709] regionserver.LeaseManager(133): Closed leases 2023-02-09 12:03:13,579 INFO [RS:0;jenkins-hbase4:38709] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-09 12:03:13,579 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 12:03:13,580 INFO [RS:0;jenkins-hbase4:38709] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38709 2023-02-09 12:03:13,581 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): master:41197-0x10038f6caa60000, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 12:03:13,581 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): regionserver:38709-0x10038f6caa60001, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38709,1675944190239 2023-02-09 12:03:13,582 ERROR [Listener at localhost/42145-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@50a7f96f rejected from java.util.concurrent.ThreadPoolExecutor@549877a3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 12:03:13,583 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,38709,1675944190239] 2023-02-09 12:03:13,583 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,38709,1675944190239; numProcessing=2 2023-02-09 12:03:13,585 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,38709,1675944190239 already deleted, retry=false 2023-02-09 12:03:13,585 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,38709,1675944190239 expired; onlineServers=0 2023-02-09 12:03:13,585 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,41197,1675944190195' ***** 2023-02-09 12:03:13,585 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-09 12:03:13,586 DEBUG [M:0;jenkins-hbase4:41197] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@22e2280c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 12:03:13,586 INFO [M:0;jenkins-hbase4:41197] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,41197,1675944190195 2023-02-09 12:03:13,586 INFO [M:0;jenkins-hbase4:41197] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,41197,1675944190195; all regions closed. 2023-02-09 12:03:13,586 DEBUG [M:0;jenkins-hbase4:41197] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 12:03:13,586 DEBUG [M:0;jenkins-hbase4:41197] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-09 12:03:13,586 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-09 12:03:13,586 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675944190443] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675944190443,5,FailOnTimeoutGroup] 2023-02-09 12:03:13,586 DEBUG [M:0;jenkins-hbase4:41197] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-09 12:03:13,586 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675944190443] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675944190443,5,FailOnTimeoutGroup] 2023-02-09 12:03:13,587 INFO [M:0;jenkins-hbase4:41197] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-09 12:03:13,588 INFO [M:0;jenkins-hbase4:41197] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-09 12:03:13,588 INFO [M:0;jenkins-hbase4:41197] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-09 12:03:13,588 DEBUG [M:0;jenkins-hbase4:41197] master.HMaster(1502): Stopping service threads 2023-02-09 12:03:13,588 INFO [M:0;jenkins-hbase4:41197] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-09 12:03:13,588 ERROR [M:0;jenkins-hbase4:41197] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-09 12:03:13,589 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): master:41197-0x10038f6caa60000, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-09 12:03:13,589 INFO [M:0;jenkins-hbase4:41197] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-09 12:03:13,589 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): master:41197-0x10038f6caa60000, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 12:03:13,589 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-09 12:03:13,589 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41197-0x10038f6caa60000, quorum=127.0.0.1:55305, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 12:03:13,589 DEBUG [M:0;jenkins-hbase4:41197] zookeeper.ZKUtil(398): master:41197-0x10038f6caa60000, quorum=127.0.0.1:55305, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-09 12:03:13,589 WARN [M:0;jenkins-hbase4:41197] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-09 12:03:13,589 INFO [M:0;jenkins-hbase4:41197] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-09 12:03:13,590 INFO [M:0;jenkins-hbase4:41197] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-09 12:03:13,591 DEBUG [M:0;jenkins-hbase4:41197] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-09 12:03:13,591 INFO [M:0;jenkins-hbase4:41197] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 12:03:13,591 DEBUG [M:0;jenkins-hbase4:41197] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 12:03:13,591 DEBUG [M:0;jenkins-hbase4:41197] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-09 12:03:13,591 DEBUG [M:0;jenkins-hbase4:41197] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 12:03:13,591 INFO [M:0;jenkins-hbase4:41197] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=55.87 KB heapSize=66.80 KB 2023-02-09 12:03:13,600 INFO [M:0;jenkins-hbase4:41197] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=55.87 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/456c8ee3adb446818201449a5291af64 2023-02-09 12:03:13,605 DEBUG [M:0;jenkins-hbase4:41197] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/456c8ee3adb446818201449a5291af64 as hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/456c8ee3adb446818201449a5291af64 2023-02-09 12:03:13,609 INFO [M:0;jenkins-hbase4:41197] regionserver.HStore(1080): Added hdfs://localhost:37835/user/jenkins/test-data/ddfce0af-badb-fcf2-fbff-a1794eb114e5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/456c8ee3adb446818201449a5291af64, entries=17, sequenceid=132, filesize=8.7 K 2023-02-09 12:03:13,610 INFO [M:0;jenkins-hbase4:41197] regionserver.HRegion(2947): Finished flush of dataSize ~55.87 KB/57209, heapSize ~66.79 KB/68392, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 19ms, sequenceid=132, compaction requested=false 2023-02-09 12:03:13,611 INFO [M:0;jenkins-hbase4:41197] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 12:03:13,611 DEBUG [M:0;jenkins-hbase4:41197] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675944193590Disabling compacts and flushes for region at 1675944193590Disabling writes for close at 1675944193591 (+1 ms)Obtaining lock to block concurrent updates at 1675944193591Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1675944193591Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=57209, getHeapSize=68392, getOffHeapSize=0, getCellsCount=145 at 1675944193591Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1675944193592 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1675944193592Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1675944193594 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1675944193594Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1675944193606 (+12 ms)Finished flush of dataSize ~55.87 KB/57209, heapSize ~66.79 KB/68392, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 19ms, sequenceid=132, compaction requested=false at 1675944193610 (+4 ms)Writing region close event to WAL at 1675944193611 (+1 ms)Closed at 1675944193611 2023-02-09 12:03:13,615 INFO [M:0;jenkins-hbase4:41197] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-09 12:03:13,615 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 12:03:13,616 INFO [M:0;jenkins-hbase4:41197] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41197 2023-02-09 12:03:13,617 DEBUG [M:0;jenkins-hbase4:41197] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,41197,1675944190195 already deleted, retry=false 2023-02-09 12:03:13,961 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): master:41197-0x10038f6caa60000, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 12:03:13,961 INFO [M:0;jenkins-hbase4:41197] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,41197,1675944190195; zookeeper connection closed. 2023-02-09 12:03:13,961 ERROR [Listener at localhost/42145-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7340f29f rejected from java.util.concurrent.ThreadPoolExecutor@777f682f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 52] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 12:03:13,963 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): master:41197-0x10038f6caa60000, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 12:03:13,963 ERROR [Listener at localhost/42145-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@77a5884f rejected from java.util.concurrent.ThreadPoolExecutor@777f682f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 52] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 12:03:14,061 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): regionserver:38709-0x10038f6caa60001, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 12:03:14,061 INFO [RS:0;jenkins-hbase4:38709] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,38709,1675944190239; zookeeper connection closed. 2023-02-09 12:03:14,061 ERROR [Listener at localhost/42145-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4fc2f330 rejected from java.util.concurrent.ThreadPoolExecutor@549877a3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 12:03:14,061 DEBUG [Listener at localhost/42145-EventThread] zookeeper.ZKWatcher(600): regionserver:38709-0x10038f6caa60001, quorum=127.0.0.1:55305, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 12:03:14,061 ERROR [Listener at localhost/42145-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@377359f2 rejected from java.util.concurrent.ThreadPoolExecutor@549877a3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 12:03:14,061 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2c70b0f5] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2c70b0f5 2023-02-09 12:03:14,062 INFO [Listener at localhost/42145] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-09 12:03:14,062 WARN [Listener at localhost/42145] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-09 12:03:14,066 INFO [Listener at localhost/42145] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 12:03:14,171 WARN [BP-182373890-172.31.14.131-1675944189619 heartbeating to localhost/127.0.0.1:37835] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-09 12:03:14,171 WARN [BP-182373890-172.31.14.131-1675944189619 heartbeating to localhost/127.0.0.1:37835] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-182373890-172.31.14.131-1675944189619 (Datanode Uuid 5e030390-a5e3-46ff-93c3-52b6043f4f12) service to localhost/127.0.0.1:37835 2023-02-09 12:03:14,172 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6e44d3da-277b-421d-1f0e-72ff66653ed5/cluster_1899341e-5259-892b-3d81-c2edd2de3898/dfs/data/data3/current/BP-182373890-172.31.14.131-1675944189619] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 12:03:14,173 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6e44d3da-277b-421d-1f0e-72ff66653ed5/cluster_1899341e-5259-892b-3d81-c2edd2de3898/dfs/data/data4/current/BP-182373890-172.31.14.131-1675944189619] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 12:03:14,174 WARN [Listener at localhost/42145] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-09 12:03:14,247 INFO [Listener at localhost/42145] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 12:03:14,252 WARN [BP-182373890-172.31.14.131-1675944189619 heartbeating to localhost/127.0.0.1:37835] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-09 12:03:14,252 WARN [BP-182373890-172.31.14.131-1675944189619 heartbeating to localhost/127.0.0.1:37835] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-182373890-172.31.14.131-1675944189619 (Datanode Uuid a24f0230-e059-4a22-8aab-cfeca300bda5) service to localhost/127.0.0.1:37835 2023-02-09 12:03:14,254 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6e44d3da-277b-421d-1f0e-72ff66653ed5/cluster_1899341e-5259-892b-3d81-c2edd2de3898/dfs/data/data1/current/BP-182373890-172.31.14.131-1675944189619] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 12:03:14,254 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6e44d3da-277b-421d-1f0e-72ff66653ed5/cluster_1899341e-5259-892b-3d81-c2edd2de3898/dfs/data/data2/current/BP-182373890-172.31.14.131-1675944189619] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 12:03:14,267 INFO [Listener at localhost/42145] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 12:03:14,395 INFO [Listener at localhost/42145] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-09 12:03:14,442 INFO [Listener at localhost/42145] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-09 12:03:14,481 INFO [Listener at localhost/42145] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=180 (was 157) Potentially hanging thread: nioEventLoopGroup-12-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:37835 from jenkins.hfs.4 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-13-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.4@localhost:37835 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:37835 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins.hfs.5@localhost:37835 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/42145 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,41197,1675944190195)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:37835 from jenkins.hfs.5 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-10-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-8 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:37835 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-9 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:37835 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-11-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=570 (was 540) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=318 (was 275) - SystemLoadAverage LEAK? -, ProcessCount=166 (was 166), AvailableMemoryMB=3337 (was 3556) 2023-02-09 12:03:14,491 INFO [Listener at localhost/42145] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=180, OpenFileDescriptor=570, MaxFileDescriptor=60000, SystemLoadAverage=318, ProcessCount=166, AvailableMemoryMB=3334 2023-02-09 12:03:14,502 INFO [Listener at localhost/42145] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6e44d3da-277b-421d-1f0e-72ff66653ed5/hadoop.log.dir so I do NOT create it in target/test-data/35ed02a8-f559-1c2d-13a8-c134fd0b88e5 2023-02-09 12:03:14,502 WARN [Listener at localhost/42145] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6e44d3da-277b-421d-1f0e-72ff66653ed5/hadoop.log.dir Erasing configuration value by system value. 2023-02-09 12:03:14,502 INFO [Listener at localhost/42145] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6e44d3da-277b-421d-1f0e-72ff66653ed5/hadoop.tmp.dir so I do NOT create it in target/test-data/35ed02a8-f559-1c2d-13a8-c134fd0b88e5 2023-02-09 12:03:14,502 WARN [Listener at localhost/42145] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6e44d3da-277b-421d-1f0e-72ff66653ed5/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-09 12:03:14,502 DEBUG [Listener at localhost/42145] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/35ed02a8-f559-1c2d-13a8-c134fd0b88e5 2023-02-09 12:03:14,502 INFO [Listener at localhost/42145] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-09 12:03:14,502 INFO [Listener at localhost/42145] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/35ed02a8-f559-1c2d-13a8-c134fd0b88e5/cluster_c27b68cd-a75b-1a1f-0532-0158b09d8a10, deleteOnExit=true 2023-02-09 12:03:14,502 INFO [Listener at localhost/42145] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-09 12:03:14,502 INFO [Listener at localhost/42145] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/35ed02a8-f559-1c2d-13a8-c134fd0b88e5/test.cache.data in system properties and HBase conf 2023-02-09 12:03:14,502 INFO [Listener at localhost/42145] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/35ed02a8-f559-1c2d-13a8-c134fd0b88e5/hadoop.tmp.dir in system properties and HBase conf 2023-02-09 12:03:14,502 INFO [Listener at localhost/42145] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/35ed02a8-f559-1c2d-13a8-c134fd0b88e5/hadoop.log.dir in system properties and HBase conf 2023-02-09 12:03:14,503 INFO [Listener at localhost/42145] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/35ed02a8-f559-1c2d-13a8-c134fd0b88e5/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-09 12:03:14,503 INFO [Listener at localhost/42145] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/35ed02a8-f559-1c2d-13a8-c134fd0b88e5/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-09 12:03:14,503 INFO [Listener at localhost/42145] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-09 12:03:14,503 DEBUG [Listener at localhost/42145] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-09 12:03:14,503 INFO [Listener at localhost/42145] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/35ed02a8-f559-1c2d-13a8-c134fd0b88e5/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-09 12:03:14,503 INFO [Listener at localhost/42145] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/35ed02a8-f559-1c2d-13a8-c134fd0b88e5/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-09 12:03:14,503 INFO [Listener at localhost/42145] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/35ed02a8-f559-1c2d-13a8-c134fd0b88e5/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-09 12:03:14,503 INFO [Listener at localhost/42145] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/35ed02a8-f559-1c2d-13a8-c134fd0b88e5/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-09 12:03:14,503 INFO [Listener at localhost/42145] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/35ed02a8-f559-1c2d-13a8-c134fd0b88e5/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-09 12:03:14,503 INFO [Listener at localhost/42145] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/35ed02a8-f559-1c2d-13a8-c134fd0b88e5/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-09 12:03:14,503 INFO [Listener at localhost/42145] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/35ed02a8-f559-1c2d-13a8-c134fd0b88e5/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-09 12:03:14,504 INFO [Listener at localhost/42145] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/35ed02a8-f559-1c2d-13a8-c134fd0b88e5/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-09 12:03:14,504 INFO [Listener at localhost/42145] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/35ed02a8-f559-1c2d-13a8-c134fd0b88e5/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-09 12:03:14,504 INFO [Listener at localhost/42145] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/35ed02a8-f559-1c2d-13a8-c134fd0b88e5/nfs.dump.dir in system properties and HBase conf 2023-02-09 12:03:14,504 INFO [Listener at localhost/42145] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/35ed02a8-f559-1c2d-13a8-c134fd0b88e5/java.io.tmpdir in system properties and HBase conf 2023-02-09 12:03:14,504 INFO [Listener at localhost/42145] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/35ed02a8-f559-1c2d-13a8-c134fd0b88e5/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-09 12:03:14,504 INFO [Listener at localhost/42145] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/35ed02a8-f559-1c2d-13a8-c134fd0b88e5/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-09 12:03:14,504 INFO [Listener at localhost/42145] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/35ed02a8-f559-1c2d-13a8-c134fd0b88e5/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-09 12:03:14,508 WARN [Listener at localhost/42145] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-09 12:03:14,508 WARN [Listener at localhost/42145] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-09 12:03:14,552 WARN [Listener at localhost/42145] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 12:03:14,554 INFO [Listener at localhost/42145] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 12:03:14,559 INFO [Listener at localhost/42145] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/35ed02a8-f559-1c2d-13a8-c134fd0b88e5/java.io.tmpdir/Jetty_localhost_43855_hdfs____2nnm3n/webapp 2023-02-09 12:03:14,650 INFO [Listener at localhost/42145] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43855 2023-02-09 12:03:14,655 WARN [Listener at localhost/42145] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-09 12:03:14,655 WARN [Listener at localhost/42145] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-09 12:03:14,696 WARN [Listener at localhost/37789] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 12:03:14,711 WARN [Listener at localhost/37789] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-09 12:03:14,713 WARN [Listener at localhost/37789] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 12:03:14,714 INFO [Listener at localhost/37789] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 12:03:14,720 INFO [Listener at localhost/37789] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/35ed02a8-f559-1c2d-13a8-c134fd0b88e5/java.io.tmpdir/Jetty_localhost_44319_datanode____24pegy/webapp 2023-02-09 12:03:14,811 INFO [Listener at localhost/37789] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44319 2023-02-09 12:03:14,818 WARN [Listener at localhost/44019] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 12:03:14,834 WARN [Listener at localhost/44019] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-09 12:03:14,836 WARN [Listener at localhost/44019] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 12:03:14,837 INFO [Listener at localhost/44019] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 12:03:14,840 INFO [Listener at localhost/44019] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/35ed02a8-f559-1c2d-13a8-c134fd0b88e5/java.io.tmpdir/Jetty_localhost_42409_datanode____.ipxo62/webapp 2023-02-09 12:03:14,930 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3895e38b0aa8f07: Processing first storage report for DS-1afc4939-ac87-4206-91c8-54ad7838ee96 from datanode 7dad4d72-e2b9-4796-a947-b9c64057bbde 2023-02-09 12:03:14,930 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3895e38b0aa8f07: from storage DS-1afc4939-ac87-4206-91c8-54ad7838ee96 node DatanodeRegistration(127.0.0.1:44921, datanodeUuid=7dad4d72-e2b9-4796-a947-b9c64057bbde, infoPort=41925, infoSecurePort=0, ipcPort=44019, storageInfo=lv=-57;cid=testClusterID;nsid=430360787;c=1675944194511), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 12:03:14,930 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3895e38b0aa8f07: Processing first storage report for DS-d5b820a3-553e-47d7-bf70-41eca896384d from datanode 7dad4d72-e2b9-4796-a947-b9c64057bbde 2023-02-09 12:03:14,930 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3895e38b0aa8f07: from storage DS-d5b820a3-553e-47d7-bf70-41eca896384d node DatanodeRegistration(127.0.0.1:44921, datanodeUuid=7dad4d72-e2b9-4796-a947-b9c64057bbde, infoPort=41925, infoSecurePort=0, ipcPort=44019, storageInfo=lv=-57;cid=testClusterID;nsid=430360787;c=1675944194511), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 12:03:14,942 INFO [Listener at localhost/44019] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42409 2023-02-09 12:03:14,951 WARN [Listener at localhost/45917] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 12:03:15,049 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3eabd21362d44cb4: Processing first storage report for DS-02e5afc0-53bc-483d-97c2-eb8d24f6549f from datanode 9e7edff9-9630-4e84-88ac-8475f0716e48 2023-02-09 12:03:15,050 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3eabd21362d44cb4: from storage DS-02e5afc0-53bc-483d-97c2-eb8d24f6549f node DatanodeRegistration(127.0.0.1:33109, datanodeUuid=9e7edff9-9630-4e84-88ac-8475f0716e48, infoPort=38061, infoSecurePort=0, ipcPort=45917, storageInfo=lv=-57;cid=testClusterID;nsid=430360787;c=1675944194511), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-09 12:03:15,050 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3eabd21362d44cb4: Processing first storage report for DS-387b0449-d2bf-46cc-8221-841328a222cb from datanode 9e7edff9-9630-4e84-88ac-8475f0716e48 2023-02-09 12:03:15,050 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3eabd21362d44cb4: from storage DS-387b0449-d2bf-46cc-8221-841328a222cb node DatanodeRegistration(127.0.0.1:33109, datanodeUuid=9e7edff9-9630-4e84-88ac-8475f0716e48, infoPort=38061, infoSecurePort=0, ipcPort=45917, storageInfo=lv=-57;cid=testClusterID;nsid=430360787;c=1675944194511), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 12:03:15,065 DEBUG [Listener at localhost/45917] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/35ed02a8-f559-1c2d-13a8-c134fd0b88e5 2023-02-09 12:03:15,067 INFO [Listener at localhost/45917] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/35ed02a8-f559-1c2d-13a8-c134fd0b88e5/cluster_c27b68cd-a75b-1a1f-0532-0158b09d8a10/zookeeper_0, clientPort=62567, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/35ed02a8-f559-1c2d-13a8-c134fd0b88e5/cluster_c27b68cd-a75b-1a1f-0532-0158b09d8a10/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/35ed02a8-f559-1c2d-13a8-c134fd0b88e5/cluster_c27b68cd-a75b-1a1f-0532-0158b09d8a10/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-09 12:03:15,067 INFO [Listener at localhost/45917] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=62567 2023-02-09 12:03:15,068 INFO [Listener at localhost/45917] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 12:03:15,069 INFO [Listener at localhost/45917] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 12:03:15,087 INFO [Listener at localhost/45917] util.FSUtils(479): Created version file at hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5 with version=8 2023-02-09 12:03:15,087 INFO [Listener at localhost/45917] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 12:03:15,088 INFO [Listener at localhost/45917] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 12:03:15,089 INFO [Listener at localhost/45917] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:37789/user/jenkins/test-data/12ba8186-be0f-7e8f-11c9-39faac04ac44/hbase-staging 2023-02-09 12:03:15,091 INFO [Listener at localhost/45917] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 12:03:15,091 INFO [Listener at localhost/45917] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 12:03:15,091 INFO [Listener at localhost/45917] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 12:03:15,091 INFO [Listener at localhost/45917] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 12:03:15,091 INFO [Listener at localhost/45917] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 12:03:15,092 INFO [Listener at localhost/45917] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 12:03:15,092 INFO [Listener at localhost/45917] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 12:03:15,092 INFO [Listener at localhost/45917] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36247 2023-02-09 12:03:15,093 INFO [Listener at localhost/45917] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 12:03:15,093 INFO [Listener at localhost/45917] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 12:03:15,094 INFO [Listener at localhost/45917] zookeeper.RecoverableZooKeeper(93): Process identifier=master:36247 connecting to ZooKeeper ensemble=127.0.0.1:62567 2023-02-09 12:03:15,101 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): master:362470x0, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 12:03:15,102 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:36247-0x10038f6ddbf0000 connected 2023-02-09 12:03:15,125 DEBUG [Listener at localhost/45917] zookeeper.ZKUtil(164): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 12:03:15,125 DEBUG [Listener at localhost/45917] zookeeper.ZKUtil(164): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 12:03:15,125 DEBUG [Listener at localhost/45917] zookeeper.ZKUtil(164): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 12:03:15,128 DEBUG [Listener at localhost/45917] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36247 2023-02-09 12:03:15,128 DEBUG [Listener at localhost/45917] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36247 2023-02-09 12:03:15,128 DEBUG [Listener at localhost/45917] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36247 2023-02-09 12:03:15,132 DEBUG [Listener at localhost/45917] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36247 2023-02-09 12:03:15,132 DEBUG [Listener at localhost/45917] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36247 2023-02-09 12:03:15,132 INFO [Listener at localhost/45917] master.HMaster(439): hbase.rootdir=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5, hbase.cluster.distributed=false 2023-02-09 12:03:15,144 INFO [Listener at localhost/45917] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 12:03:15,144 INFO [Listener at localhost/45917] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 12:03:15,144 INFO [Listener at localhost/45917] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 12:03:15,144 INFO [Listener at localhost/45917] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 12:03:15,144 INFO [Listener at localhost/45917] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 12:03:15,144 INFO [Listener at localhost/45917] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 12:03:15,144 INFO [Listener at localhost/45917] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 12:03:15,148 INFO [Listener at localhost/45917] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36427 2023-02-09 12:03:15,148 INFO [Listener at localhost/45917] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-09 12:03:15,149 DEBUG [Listener at localhost/45917] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 12:03:15,149 INFO [Listener at localhost/45917] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 12:03:15,150 INFO [Listener at localhost/45917] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 12:03:15,151 INFO [Listener at localhost/45917] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36427 connecting to ZooKeeper ensemble=127.0.0.1:62567 2023-02-09 12:03:15,155 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): regionserver:364270x0, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 12:03:15,156 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:36427-0x10038f6ddbf0001 connected 2023-02-09 12:03:15,156 DEBUG [Listener at localhost/45917] zookeeper.ZKUtil(164): regionserver:36427-0x10038f6ddbf0001, quorum=127.0.0.1:62567, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 12:03:15,157 DEBUG [Listener at localhost/45917] zookeeper.ZKUtil(164): regionserver:36427-0x10038f6ddbf0001, quorum=127.0.0.1:62567, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 12:03:15,157 DEBUG [Listener at localhost/45917] zookeeper.ZKUtil(164): regionserver:36427-0x10038f6ddbf0001, quorum=127.0.0.1:62567, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 12:03:15,160 DEBUG [Listener at localhost/45917] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36427 2023-02-09 12:03:15,160 DEBUG [Listener at localhost/45917] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36427 2023-02-09 12:03:15,161 DEBUG [Listener at localhost/45917] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36427 2023-02-09 12:03:15,163 DEBUG [Listener at localhost/45917] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36427 2023-02-09 12:03:15,163 DEBUG [Listener at localhost/45917] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36427 2023-02-09 12:03:15,174 INFO [Listener at localhost/45917] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 12:03:15,174 INFO [Listener at localhost/45917] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 12:03:15,174 INFO [Listener at localhost/45917] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 12:03:15,174 INFO [Listener at localhost/45917] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 12:03:15,174 INFO [Listener at localhost/45917] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 12:03:15,174 INFO [Listener at localhost/45917] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 12:03:15,174 INFO [Listener at localhost/45917] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 12:03:15,175 INFO [Listener at localhost/45917] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36313 2023-02-09 12:03:15,175 INFO [Listener at localhost/45917] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-09 12:03:15,176 DEBUG [Listener at localhost/45917] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 12:03:15,177 INFO [Listener at localhost/45917] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 12:03:15,178 INFO [Listener at localhost/45917] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 12:03:15,178 INFO [Listener at localhost/45917] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36313 connecting to ZooKeeper ensemble=127.0.0.1:62567 2023-02-09 12:03:15,182 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): regionserver:363130x0, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 12:03:15,183 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:36313-0x10038f6ddbf0002 connected 2023-02-09 12:03:15,183 DEBUG [Listener at localhost/45917] zookeeper.ZKUtil(164): regionserver:36313-0x10038f6ddbf0002, quorum=127.0.0.1:62567, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 12:03:15,184 DEBUG [Listener at localhost/45917] zookeeper.ZKUtil(164): regionserver:36313-0x10038f6ddbf0002, quorum=127.0.0.1:62567, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 12:03:15,184 DEBUG [Listener at localhost/45917] zookeeper.ZKUtil(164): regionserver:36313-0x10038f6ddbf0002, quorum=127.0.0.1:62567, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 12:03:15,187 DEBUG [Listener at localhost/45917] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36313 2023-02-09 12:03:15,188 DEBUG [Listener at localhost/45917] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36313 2023-02-09 12:03:15,188 DEBUG [Listener at localhost/45917] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36313 2023-02-09 12:03:15,189 DEBUG [Listener at localhost/45917] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36313 2023-02-09 12:03:15,189 DEBUG [Listener at localhost/45917] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36313 2023-02-09 12:03:15,191 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,36247,1675944195090 2023-02-09 12:03:15,193 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-09 12:03:15,193 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,36247,1675944195090 2023-02-09 12:03:15,194 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 12:03:15,194 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): regionserver:36313-0x10038f6ddbf0002, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 12:03:15,195 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): regionserver:36427-0x10038f6ddbf0001, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 12:03:15,194 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 12:03:15,196 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-09 12:03:15,197 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,36247,1675944195090 from backup master directory 2023-02-09 12:03:15,197 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-09 12:03:15,198 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,36247,1675944195090 2023-02-09 12:03:15,198 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-09 12:03:15,198 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 12:03:15,198 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,36247,1675944195090 2023-02-09 12:03:15,212 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/hbase.id with ID: f516d608-631b-4335-bc90-dba7af51c9a1 2023-02-09 12:03:15,220 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 12:03:15,222 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 12:03:15,232 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x687f995a to 127.0.0.1:62567 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 12:03:15,240 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@118be2f0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 12:03:15,240 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-09 12:03:15,241 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-09 12:03:15,241 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 12:03:15,242 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/MasterData/data/master/store-tmp 2023-02-09 12:03:15,248 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:15,249 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-09 12:03:15,249 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 12:03:15,249 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 12:03:15,249 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-09 12:03:15,249 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 12:03:15,249 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 12:03:15,249 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675944195249Disabling compacts and flushes for region at 1675944195249Disabling writes for close at 1675944195249Writing region close event to WAL at 1675944195249Closed at 1675944195249 2023-02-09 12:03:15,249 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/MasterData/WALs/jenkins-hbase4.apache.org,36247,1675944195090 2023-02-09 12:03:15,252 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36247%2C1675944195090, suffix=, logDir=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/MasterData/WALs/jenkins-hbase4.apache.org,36247,1675944195090, archiveDir=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/MasterData/oldWALs, maxLogs=10 2023-02-09 12:03:15,268 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33109,DS-02e5afc0-53bc-483d-97c2-eb8d24f6549f,DISK] 2023-02-09 12:03:15,268 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44921,DS-1afc4939-ac87-4206-91c8-54ad7838ee96,DISK] 2023-02-09 12:03:15,271 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/MasterData/WALs/jenkins-hbase4.apache.org,36247,1675944195090/jenkins-hbase4.apache.org%2C36247%2C1675944195090.1675944195252 2023-02-09 12:03:15,272 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33109,DS-02e5afc0-53bc-483d-97c2-eb8d24f6549f,DISK], DatanodeInfoWithStorage[127.0.0.1:44921,DS-1afc4939-ac87-4206-91c8-54ad7838ee96,DISK]] 2023-02-09 12:03:15,272 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-09 12:03:15,272 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:15,272 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 12:03:15,272 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 12:03:15,277 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-09 12:03:15,279 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-09 12:03:15,279 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-09 12:03:15,280 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:15,280 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-09 12:03:15,281 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-09 12:03:15,283 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 12:03:15,285 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 12:03:15,285 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64074200, jitterRate=-0.045220017433166504}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 12:03:15,285 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1675944195272Initializing all the Stores at 1675944195273 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944195273Cleaning up temporary data from old regions at 1675944195281 (+8 ms)Cleaning up detritus from prior splits at 1675944195281Region opened successfully at 1675944195285 (+4 ms) 2023-02-09 12:03:15,288 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-09 12:03:15,289 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-09 12:03:15,289 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-09 12:03:15,289 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-09 12:03:15,290 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-09 12:03:15,290 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-09 12:03:15,290 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-09 12:03:15,293 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-09 12:03:15,294 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-09 12:03:15,304 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-09 12:03:15,304 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-09 12:03:15,304 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-09 12:03:15,304 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-09 12:03:15,305 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-09 12:03:15,308 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 12:03:15,309 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-09 12:03:15,309 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-09 12:03:15,310 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-09 12:03:15,311 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 12:03:15,311 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): regionserver:36427-0x10038f6ddbf0001, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 12:03:15,311 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 12:03:15,311 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): regionserver:36313-0x10038f6ddbf0002, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 12:03:15,314 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,36247,1675944195090, sessionid=0x10038f6ddbf0000, setting cluster-up flag (Was=false) 2023-02-09 12:03:15,320 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 12:03:15,323 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-09 12:03:15,324 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,36247,1675944195090 2023-02-09 12:03:15,327 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 12:03:15,331 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-09 12:03:15,332 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,36247,1675944195090 2023-02-09 12:03:15,333 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.hbase-snapshot/.tmp 2023-02-09 12:03:15,334 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-09 12:03:15,335 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 12:03:15,335 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 12:03:15,335 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 12:03:15,335 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 12:03:15,335 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-09 12:03:15,335 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:15,335 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 12:03:15,335 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:15,341 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1675944225341 2023-02-09 12:03:15,341 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-09 12:03:15,341 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-09 12:03:15,341 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-09 12:03:15,341 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-09 12:03:15,341 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-09 12:03:15,341 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-09 12:03:15,341 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-09 12:03:15,341 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:15,341 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-09 12:03:15,342 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-09 12:03:15,342 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-09 12:03:15,342 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-09 12:03:15,342 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-09 12:03:15,342 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-09 12:03:15,343 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675944195342,5,FailOnTimeoutGroup] 2023-02-09 12:03:15,343 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675944195343,5,FailOnTimeoutGroup] 2023-02-09 12:03:15,343 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:15,343 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-09 12:03:15,343 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:15,343 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:15,343 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-09 12:03:15,356 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-09 12:03:15,357 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-09 12:03:15,357 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5 2023-02-09 12:03:15,366 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:15,367 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-09 12:03:15,368 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/hbase/meta/1588230740/info 2023-02-09 12:03:15,368 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-09 12:03:15,369 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:15,369 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-09 12:03:15,370 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/hbase/meta/1588230740/rep_barrier 2023-02-09 12:03:15,370 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-09 12:03:15,371 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:15,371 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-09 12:03:15,372 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/hbase/meta/1588230740/table 2023-02-09 12:03:15,372 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-09 12:03:15,373 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:15,374 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/hbase/meta/1588230740 2023-02-09 12:03:15,374 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/hbase/meta/1588230740 2023-02-09 12:03:15,376 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-09 12:03:15,377 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-09 12:03:15,378 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 12:03:15,379 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68080424, jitterRate=0.014477372169494629}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-09 12:03:15,379 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1675944195366Initializing all the Stores at 1675944195367 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675944195367Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944195367Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675944195367Cleaning up temporary data from old regions at 1675944195375 (+8 ms)Cleaning up detritus from prior splits at 1675944195375Region opened successfully at 1675944195379 (+4 ms) 2023-02-09 12:03:15,379 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-09 12:03:15,379 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-09 12:03:15,379 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-09 12:03:15,379 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-09 12:03:15,379 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-09 12:03:15,379 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-09 12:03:15,379 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675944195379Disabling compacts and flushes for region at 1675944195379Disabling writes for close at 1675944195379Writing region close event to WAL at 1675944195379Closed at 1675944195379 2023-02-09 12:03:15,380 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-09 12:03:15,380 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-09 12:03:15,380 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-09 12:03:15,381 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-09 12:03:15,383 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-09 12:03:15,391 INFO [RS:0;jenkins-hbase4:36427] regionserver.HRegionServer(952): ClusterId : f516d608-631b-4335-bc90-dba7af51c9a1 2023-02-09 12:03:15,391 INFO [RS:1;jenkins-hbase4:36313] regionserver.HRegionServer(952): ClusterId : f516d608-631b-4335-bc90-dba7af51c9a1 2023-02-09 12:03:15,392 DEBUG [RS:0;jenkins-hbase4:36427] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-09 12:03:15,392 DEBUG [RS:1;jenkins-hbase4:36313] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-09 12:03:15,393 DEBUG [RS:1;jenkins-hbase4:36313] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-09 12:03:15,393 DEBUG [RS:0;jenkins-hbase4:36427] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-09 12:03:15,393 DEBUG [RS:0;jenkins-hbase4:36427] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-09 12:03:15,393 DEBUG [RS:1;jenkins-hbase4:36313] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-09 12:03:15,395 DEBUG [RS:0;jenkins-hbase4:36427] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-09 12:03:15,397 DEBUG [RS:1;jenkins-hbase4:36313] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-09 12:03:15,398 DEBUG [RS:0;jenkins-hbase4:36427] zookeeper.ReadOnlyZKClient(139): Connect 0x49d184ca to 127.0.0.1:62567 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 12:03:15,398 DEBUG [RS:1;jenkins-hbase4:36313] zookeeper.ReadOnlyZKClient(139): Connect 0x502eb045 to 127.0.0.1:62567 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 12:03:15,406 DEBUG [RS:0;jenkins-hbase4:36427] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@47167380, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 12:03:15,406 DEBUG [RS:1;jenkins-hbase4:36313] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5ee95430, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 12:03:15,406 DEBUG [RS:0;jenkins-hbase4:36427] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4329efba, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 12:03:15,406 DEBUG [RS:1;jenkins-hbase4:36313] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5ad6db35, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 12:03:15,415 DEBUG [RS:1;jenkins-hbase4:36313] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:36313 2023-02-09 12:03:15,415 INFO [RS:1;jenkins-hbase4:36313] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-09 12:03:15,415 INFO [RS:1;jenkins-hbase4:36313] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-09 12:03:15,415 DEBUG [RS:1;jenkins-hbase4:36313] regionserver.HRegionServer(1023): About to register with Master. 2023-02-09 12:03:15,415 INFO [RS:1;jenkins-hbase4:36313] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,36247,1675944195090 with isa=jenkins-hbase4.apache.org/172.31.14.131:36313, startcode=1675944195173 2023-02-09 12:03:15,415 DEBUG [RS:1;jenkins-hbase4:36313] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-09 12:03:15,417 INFO [RS-EventLoopGroup-12-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58359, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.7 (auth:SIMPLE), service=RegionServerStatusService 2023-02-09 12:03:15,418 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36247] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,36313,1675944195173 2023-02-09 12:03:15,419 DEBUG [RS:1;jenkins-hbase4:36313] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5 2023-02-09 12:03:15,419 DEBUG [RS:1;jenkins-hbase4:36313] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:37789 2023-02-09 12:03:15,419 DEBUG [RS:1;jenkins-hbase4:36313] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-09 12:03:15,419 DEBUG [RS:0;jenkins-hbase4:36427] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:36427 2023-02-09 12:03:15,419 INFO [RS:0;jenkins-hbase4:36427] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-09 12:03:15,419 INFO [RS:0;jenkins-hbase4:36427] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-09 12:03:15,419 DEBUG [RS:0;jenkins-hbase4:36427] regionserver.HRegionServer(1023): About to register with Master. 2023-02-09 12:03:15,420 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 12:03:15,420 INFO [RS:0;jenkins-hbase4:36427] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,36247,1675944195090 with isa=jenkins-hbase4.apache.org/172.31.14.131:36427, startcode=1675944195143 2023-02-09 12:03:15,421 DEBUG [RS:1;jenkins-hbase4:36313] zookeeper.ZKUtil(162): regionserver:36313-0x10038f6ddbf0002, quorum=127.0.0.1:62567, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36313,1675944195173 2023-02-09 12:03:15,421 DEBUG [RS:0;jenkins-hbase4:36427] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-09 12:03:15,421 WARN [RS:1;jenkins-hbase4:36313] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 12:03:15,421 INFO [RS:1;jenkins-hbase4:36313] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 12:03:15,421 DEBUG [RS:1;jenkins-hbase4:36313] regionserver.HRegionServer(1947): logDir=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/WALs/jenkins-hbase4.apache.org,36313,1675944195173 2023-02-09 12:03:15,421 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,36313,1675944195173] 2023-02-09 12:03:15,424 INFO [RS-EventLoopGroup-12-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54267, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.6 (auth:SIMPLE), service=RegionServerStatusService 2023-02-09 12:03:15,425 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36247] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,36427,1675944195143 2023-02-09 12:03:15,425 DEBUG [RS:0;jenkins-hbase4:36427] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5 2023-02-09 12:03:15,425 DEBUG [RS:0;jenkins-hbase4:36427] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:37789 2023-02-09 12:03:15,425 DEBUG [RS:0;jenkins-hbase4:36427] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-09 12:03:15,433 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): regionserver:36313-0x10038f6ddbf0002, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 12:03:15,433 DEBUG [RS:1;jenkins-hbase4:36313] zookeeper.ZKUtil(162): regionserver:36313-0x10038f6ddbf0002, quorum=127.0.0.1:62567, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36313,1675944195173 2023-02-09 12:03:15,433 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 12:03:15,433 DEBUG [RS:0;jenkins-hbase4:36427] zookeeper.ZKUtil(162): regionserver:36427-0x10038f6ddbf0001, quorum=127.0.0.1:62567, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36427,1675944195143 2023-02-09 12:03:15,434 WARN [RS:0;jenkins-hbase4:36427] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 12:03:15,434 INFO [RS:0;jenkins-hbase4:36427] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 12:03:15,434 DEBUG [RS:0;jenkins-hbase4:36427] regionserver.HRegionServer(1947): logDir=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/WALs/jenkins-hbase4.apache.org,36427,1675944195143 2023-02-09 12:03:15,434 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,36427,1675944195143] 2023-02-09 12:03:15,434 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:36313-0x10038f6ddbf0002, quorum=127.0.0.1:62567, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36427,1675944195143 2023-02-09 12:03:15,434 DEBUG [RS:1;jenkins-hbase4:36313] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-09 12:03:15,434 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:36313-0x10038f6ddbf0002, quorum=127.0.0.1:62567, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36313,1675944195173 2023-02-09 12:03:15,435 INFO [RS:1;jenkins-hbase4:36313] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-09 12:03:15,437 INFO [RS:1;jenkins-hbase4:36313] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-09 12:03:15,437 INFO [RS:1;jenkins-hbase4:36313] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 12:03:15,438 INFO [RS:1;jenkins-hbase4:36313] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:15,438 INFO [RS:1;jenkins-hbase4:36313] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-09 12:03:15,439 INFO [RS:1;jenkins-hbase4:36313] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:15,439 DEBUG [RS:1;jenkins-hbase4:36313] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:15,439 DEBUG [RS:1;jenkins-hbase4:36313] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:15,439 DEBUG [RS:1;jenkins-hbase4:36313] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:15,439 DEBUG [RS:1;jenkins-hbase4:36313] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:15,440 DEBUG [RS:1;jenkins-hbase4:36313] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:15,440 DEBUG [RS:1;jenkins-hbase4:36313] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 12:03:15,440 DEBUG [RS:1;jenkins-hbase4:36313] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:15,440 DEBUG [RS:1;jenkins-hbase4:36313] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:15,440 DEBUG [RS:1;jenkins-hbase4:36313] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:15,440 DEBUG [RS:1;jenkins-hbase4:36313] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:15,440 DEBUG [RS:0;jenkins-hbase4:36427] zookeeper.ZKUtil(162): regionserver:36427-0x10038f6ddbf0001, quorum=127.0.0.1:62567, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36427,1675944195143 2023-02-09 12:03:15,440 DEBUG [RS:0;jenkins-hbase4:36427] zookeeper.ZKUtil(162): regionserver:36427-0x10038f6ddbf0001, quorum=127.0.0.1:62567, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36313,1675944195173 2023-02-09 12:03:15,441 DEBUG [RS:0;jenkins-hbase4:36427] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-09 12:03:15,441 INFO [RS:0;jenkins-hbase4:36427] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-09 12:03:15,444 INFO [RS:0;jenkins-hbase4:36427] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-09 12:03:15,444 INFO [RS:1;jenkins-hbase4:36313] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:15,444 INFO [RS:1;jenkins-hbase4:36313] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:15,444 INFO [RS:1;jenkins-hbase4:36313] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:15,445 INFO [RS:0;jenkins-hbase4:36427] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 12:03:15,445 INFO [RS:0;jenkins-hbase4:36427] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:15,446 INFO [RS:0;jenkins-hbase4:36427] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-09 12:03:15,447 INFO [RS:0;jenkins-hbase4:36427] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:15,447 DEBUG [RS:0;jenkins-hbase4:36427] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:15,447 DEBUG [RS:0;jenkins-hbase4:36427] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:15,448 DEBUG [RS:0;jenkins-hbase4:36427] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:15,448 DEBUG [RS:0;jenkins-hbase4:36427] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:15,448 DEBUG [RS:0;jenkins-hbase4:36427] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:15,448 DEBUG [RS:0;jenkins-hbase4:36427] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 12:03:15,448 DEBUG [RS:0;jenkins-hbase4:36427] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:15,448 DEBUG [RS:0;jenkins-hbase4:36427] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:15,448 DEBUG [RS:0;jenkins-hbase4:36427] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:15,448 DEBUG [RS:0;jenkins-hbase4:36427] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:15,452 INFO [RS:0;jenkins-hbase4:36427] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:15,452 INFO [RS:0;jenkins-hbase4:36427] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:15,453 INFO [RS:0;jenkins-hbase4:36427] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:15,460 INFO [RS:1;jenkins-hbase4:36313] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-09 12:03:15,460 INFO [RS:1;jenkins-hbase4:36313] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36313,1675944195173-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:15,467 INFO [RS:0;jenkins-hbase4:36427] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-09 12:03:15,467 INFO [RS:0;jenkins-hbase4:36427] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36427,1675944195143-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:15,470 INFO [RS:1;jenkins-hbase4:36313] regionserver.Replication(203): jenkins-hbase4.apache.org,36313,1675944195173 started 2023-02-09 12:03:15,470 INFO [RS:1;jenkins-hbase4:36313] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,36313,1675944195173, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:36313, sessionid=0x10038f6ddbf0002 2023-02-09 12:03:15,471 DEBUG [RS:1;jenkins-hbase4:36313] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-09 12:03:15,471 DEBUG [RS:1;jenkins-hbase4:36313] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,36313,1675944195173 2023-02-09 12:03:15,471 DEBUG [RS:1;jenkins-hbase4:36313] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36313,1675944195173' 2023-02-09 12:03:15,471 DEBUG [RS:1;jenkins-hbase4:36313] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 12:03:15,471 DEBUG [RS:1;jenkins-hbase4:36313] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 12:03:15,471 DEBUG [RS:1;jenkins-hbase4:36313] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-09 12:03:15,471 DEBUG [RS:1;jenkins-hbase4:36313] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-09 12:03:15,471 DEBUG [RS:1;jenkins-hbase4:36313] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,36313,1675944195173 2023-02-09 12:03:15,471 DEBUG [RS:1;jenkins-hbase4:36313] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36313,1675944195173' 2023-02-09 12:03:15,471 DEBUG [RS:1;jenkins-hbase4:36313] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 12:03:15,472 DEBUG [RS:1;jenkins-hbase4:36313] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 12:03:15,472 DEBUG [RS:1;jenkins-hbase4:36313] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-09 12:03:15,472 INFO [RS:1;jenkins-hbase4:36313] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-09 12:03:15,472 INFO [RS:1;jenkins-hbase4:36313] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-09 12:03:15,477 INFO [RS:0;jenkins-hbase4:36427] regionserver.Replication(203): jenkins-hbase4.apache.org,36427,1675944195143 started 2023-02-09 12:03:15,477 INFO [RS:0;jenkins-hbase4:36427] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,36427,1675944195143, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:36427, sessionid=0x10038f6ddbf0001 2023-02-09 12:03:15,478 DEBUG [RS:0;jenkins-hbase4:36427] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-09 12:03:15,478 DEBUG [RS:0;jenkins-hbase4:36427] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,36427,1675944195143 2023-02-09 12:03:15,478 DEBUG [RS:0;jenkins-hbase4:36427] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36427,1675944195143' 2023-02-09 12:03:15,478 DEBUG [RS:0;jenkins-hbase4:36427] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 12:03:15,478 DEBUG [RS:0;jenkins-hbase4:36427] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 12:03:15,478 DEBUG [RS:0;jenkins-hbase4:36427] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-09 12:03:15,478 DEBUG [RS:0;jenkins-hbase4:36427] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-09 12:03:15,478 DEBUG [RS:0;jenkins-hbase4:36427] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,36427,1675944195143 2023-02-09 12:03:15,478 DEBUG [RS:0;jenkins-hbase4:36427] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36427,1675944195143' 2023-02-09 12:03:15,478 DEBUG [RS:0;jenkins-hbase4:36427] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 12:03:15,478 DEBUG [RS:0;jenkins-hbase4:36427] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 12:03:15,479 DEBUG [RS:0;jenkins-hbase4:36427] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-09 12:03:15,479 INFO [RS:0;jenkins-hbase4:36427] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-09 12:03:15,479 INFO [RS:0;jenkins-hbase4:36427] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-09 12:03:15,533 DEBUG [jenkins-hbase4:36247] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-09 12:03:15,533 DEBUG [jenkins-hbase4:36247] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 12:03:15,535 DEBUG [jenkins-hbase4:36247] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 12:03:15,535 DEBUG [jenkins-hbase4:36247] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 12:03:15,535 DEBUG [jenkins-hbase4:36247] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 12:03:15,536 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,36313,1675944195173, state=OPENING 2023-02-09 12:03:15,537 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-09 12:03:15,538 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 12:03:15,539 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,36313,1675944195173}] 2023-02-09 12:03:15,539 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-09 12:03:15,693 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,36313,1675944195173 2023-02-09 12:03:15,693 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-09 12:03:15,695 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33646, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-09 12:03:15,698 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-09 12:03:15,698 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 12:03:15,700 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36313%2C1675944195173.meta, suffix=.meta, logDir=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/WALs/jenkins-hbase4.apache.org,36313,1675944195173, archiveDir=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/oldWALs, maxLogs=32 2023-02-09 12:03:15,716 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33109,DS-02e5afc0-53bc-483d-97c2-eb8d24f6549f,DISK] 2023-02-09 12:03:15,716 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44921,DS-1afc4939-ac87-4206-91c8-54ad7838ee96,DISK] 2023-02-09 12:03:15,718 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/WALs/jenkins-hbase4.apache.org,36313,1675944195173/jenkins-hbase4.apache.org%2C36313%2C1675944195173.meta.1675944195700.meta 2023-02-09 12:03:15,718 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33109,DS-02e5afc0-53bc-483d-97c2-eb8d24f6549f,DISK], DatanodeInfoWithStorage[127.0.0.1:44921,DS-1afc4939-ac87-4206-91c8-54ad7838ee96,DISK]] 2023-02-09 12:03:15,718 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-09 12:03:15,718 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-09 12:03:15,718 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-09 12:03:15,719 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-09 12:03:15,719 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-09 12:03:15,719 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:15,719 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-09 12:03:15,719 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-09 12:03:15,720 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-09 12:03:15,720 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/hbase/meta/1588230740/info 2023-02-09 12:03:15,721 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/hbase/meta/1588230740/info 2023-02-09 12:03:15,721 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-09 12:03:15,721 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:15,721 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-09 12:03:15,722 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/hbase/meta/1588230740/rep_barrier 2023-02-09 12:03:15,722 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/hbase/meta/1588230740/rep_barrier 2023-02-09 12:03:15,722 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-09 12:03:15,723 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:15,723 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-09 12:03:15,724 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/hbase/meta/1588230740/table 2023-02-09 12:03:15,724 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/hbase/meta/1588230740/table 2023-02-09 12:03:15,724 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-09 12:03:15,724 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:15,725 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/hbase/meta/1588230740 2023-02-09 12:03:15,726 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/hbase/meta/1588230740 2023-02-09 12:03:15,729 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-09 12:03:15,731 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-09 12:03:15,731 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74790146, jitterRate=0.11446002125740051}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-09 12:03:15,731 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1675944195719Writing region info on filesystem at 1675944195719Initializing all the Stores at 1675944195719Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675944195719Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944195720 (+1 ms)Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675944195720Cleaning up temporary data from old regions at 1675944195727 (+7 ms)Cleaning up detritus from prior splits at 1675944195729 (+2 ms)Running coprocessor post-open hooks at 1675944195731 (+2 ms)Region opened successfully at 1675944195731 2023-02-09 12:03:15,732 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1675944195693 2023-02-09 12:03:15,737 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-09 12:03:15,737 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-09 12:03:15,737 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,36313,1675944195173, state=OPEN 2023-02-09 12:03:15,739 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-09 12:03:15,739 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-09 12:03:15,740 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-09 12:03:15,740 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,36313,1675944195173 in 200 msec 2023-02-09 12:03:15,741 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-09 12:03:15,741 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 360 msec 2023-02-09 12:03:15,742 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 408 msec 2023-02-09 12:03:15,742 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1675944195193, completionTime=-1 2023-02-09 12:03:15,743 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-09 12:03:15,743 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-09 12:03:15,745 DEBUG [hconnection-0x6880919b-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 12:03:15,746 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33650, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 12:03:15,747 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-09 12:03:15,747 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1675944255747 2023-02-09 12:03:15,748 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1675944315748 2023-02-09 12:03:15,748 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 4 msec 2023-02-09 12:03:15,754 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36247,1675944195090-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:15,754 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36247,1675944195090-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:15,754 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36247,1675944195090-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:15,754 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:36247, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:15,754 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:15,754 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-09 12:03:15,755 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-09 12:03:15,755 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-09 12:03:15,756 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-09 12:03:15,757 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 12:03:15,757 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 12:03:15,759 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/hbase/namespace/12fbf7cab2a9a9b03d763d819172cf87 2023-02-09 12:03:15,760 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/hbase/namespace/12fbf7cab2a9a9b03d763d819172cf87 empty. 2023-02-09 12:03:15,760 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/hbase/namespace/12fbf7cab2a9a9b03d763d819172cf87 2023-02-09 12:03:15,760 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-09 12:03:15,771 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-09 12:03:15,773 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 12fbf7cab2a9a9b03d763d819172cf87, NAME => 'hbase:namespace,,1675944195755.12fbf7cab2a9a9b03d763d819172cf87.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp 2023-02-09 12:03:15,788 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675944195755.12fbf7cab2a9a9b03d763d819172cf87.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:15,788 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 12fbf7cab2a9a9b03d763d819172cf87, disabling compactions & flushes 2023-02-09 12:03:15,788 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675944195755.12fbf7cab2a9a9b03d763d819172cf87. 2023-02-09 12:03:15,788 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675944195755.12fbf7cab2a9a9b03d763d819172cf87. 2023-02-09 12:03:15,788 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675944195755.12fbf7cab2a9a9b03d763d819172cf87. after waiting 0 ms 2023-02-09 12:03:15,788 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675944195755.12fbf7cab2a9a9b03d763d819172cf87. 2023-02-09 12:03:15,788 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675944195755.12fbf7cab2a9a9b03d763d819172cf87. 2023-02-09 12:03:15,788 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 12fbf7cab2a9a9b03d763d819172cf87: Waiting for close lock at 1675944195788Disabling compacts and flushes for region at 1675944195788Disabling writes for close at 1675944195788Writing region close event to WAL at 1675944195788Closed at 1675944195788 2023-02-09 12:03:15,791 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 12:03:15,792 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1675944195755.12fbf7cab2a9a9b03d763d819172cf87.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675944195791"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675944195791"}]},"ts":"1675944195791"} 2023-02-09 12:03:15,794 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-09 12:03:15,795 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 12:03:15,795 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675944195795"}]},"ts":"1675944195795"} 2023-02-09 12:03:15,796 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-09 12:03:15,799 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 12:03:15,800 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 12:03:15,800 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 12:03:15,800 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 12:03:15,803 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=12fbf7cab2a9a9b03d763d819172cf87, ASSIGN}] 2023-02-09 12:03:15,808 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=12fbf7cab2a9a9b03d763d819172cf87, ASSIGN 2023-02-09 12:03:15,809 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=12fbf7cab2a9a9b03d763d819172cf87, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36427,1675944195143; forceNewPlan=false, retain=false 2023-02-09 12:03:15,959 INFO [jenkins-hbase4:36247] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-09 12:03:15,960 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=12fbf7cab2a9a9b03d763d819172cf87, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36427,1675944195143 2023-02-09 12:03:15,961 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1675944195755.12fbf7cab2a9a9b03d763d819172cf87.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675944195960"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675944195960"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675944195960"}]},"ts":"1675944195960"} 2023-02-09 12:03:15,963 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 12fbf7cab2a9a9b03d763d819172cf87, server=jenkins-hbase4.apache.org,36427,1675944195143}] 2023-02-09 12:03:16,116 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,36427,1675944195143 2023-02-09 12:03:16,116 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-09 12:03:16,118 INFO [RS-EventLoopGroup-13-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36924, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-09 12:03:16,124 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1675944195755.12fbf7cab2a9a9b03d763d819172cf87. 2023-02-09 12:03:16,125 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36427%2C1675944195143, suffix=, logDir=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/WALs/jenkins-hbase4.apache.org,36427,1675944195143, archiveDir=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/oldWALs, maxLogs=32 2023-02-09 12:03:16,138 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44921,DS-1afc4939-ac87-4206-91c8-54ad7838ee96,DISK] 2023-02-09 12:03:16,138 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33109,DS-02e5afc0-53bc-483d-97c2-eb8d24f6549f,DISK] 2023-02-09 12:03:16,140 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/WALs/jenkins-hbase4.apache.org,36427,1675944195143/jenkins-hbase4.apache.org%2C36427%2C1675944195143.1675944196126 2023-02-09 12:03:16,140 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44921,DS-1afc4939-ac87-4206-91c8-54ad7838ee96,DISK], DatanodeInfoWithStorage[127.0.0.1:33109,DS-02e5afc0-53bc-483d-97c2-eb8d24f6549f,DISK]] 2023-02-09 12:03:16,140 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 12fbf7cab2a9a9b03d763d819172cf87, NAME => 'hbase:namespace,,1675944195755.12fbf7cab2a9a9b03d763d819172cf87.', STARTKEY => '', ENDKEY => ''} 2023-02-09 12:03:16,141 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 12fbf7cab2a9a9b03d763d819172cf87 2023-02-09 12:03:16,141 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675944195755.12fbf7cab2a9a9b03d763d819172cf87.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:16,141 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 12fbf7cab2a9a9b03d763d819172cf87 2023-02-09 12:03:16,141 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 12fbf7cab2a9a9b03d763d819172cf87 2023-02-09 12:03:16,142 INFO [StoreOpener-12fbf7cab2a9a9b03d763d819172cf87-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 12fbf7cab2a9a9b03d763d819172cf87 2023-02-09 12:03:16,143 DEBUG [StoreOpener-12fbf7cab2a9a9b03d763d819172cf87-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/hbase/namespace/12fbf7cab2a9a9b03d763d819172cf87/info 2023-02-09 12:03:16,143 DEBUG [StoreOpener-12fbf7cab2a9a9b03d763d819172cf87-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/hbase/namespace/12fbf7cab2a9a9b03d763d819172cf87/info 2023-02-09 12:03:16,144 INFO [StoreOpener-12fbf7cab2a9a9b03d763d819172cf87-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 12fbf7cab2a9a9b03d763d819172cf87 columnFamilyName info 2023-02-09 12:03:16,144 INFO [StoreOpener-12fbf7cab2a9a9b03d763d819172cf87-1] regionserver.HStore(310): Store=12fbf7cab2a9a9b03d763d819172cf87/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:16,145 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/hbase/namespace/12fbf7cab2a9a9b03d763d819172cf87 2023-02-09 12:03:16,145 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/hbase/namespace/12fbf7cab2a9a9b03d763d819172cf87 2023-02-09 12:03:16,148 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 12fbf7cab2a9a9b03d763d819172cf87 2023-02-09 12:03:16,149 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/hbase/namespace/12fbf7cab2a9a9b03d763d819172cf87/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 12:03:16,150 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 12fbf7cab2a9a9b03d763d819172cf87; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63808281, jitterRate=-0.04918251931667328}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 12:03:16,150 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 12fbf7cab2a9a9b03d763d819172cf87: Running coprocessor pre-open hook at 1675944196141Writing region info on filesystem at 1675944196141Initializing all the Stores at 1675944196142 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675944196142Cleaning up temporary data from old regions at 1675944196146 (+4 ms)Cleaning up detritus from prior splits at 1675944196146Running coprocessor post-open hooks at 1675944196150 (+4 ms)Region opened successfully at 1675944196150 2023-02-09 12:03:16,151 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1675944195755.12fbf7cab2a9a9b03d763d819172cf87., pid=6, masterSystemTime=1675944196116 2023-02-09 12:03:16,156 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1675944195755.12fbf7cab2a9a9b03d763d819172cf87. 2023-02-09 12:03:16,157 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1675944195755.12fbf7cab2a9a9b03d763d819172cf87. 2023-02-09 12:03:16,157 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=12fbf7cab2a9a9b03d763d819172cf87, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36427,1675944195143 2023-02-09 12:03:16,157 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1675944195755.12fbf7cab2a9a9b03d763d819172cf87.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675944196157"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675944196157"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675944196157"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675944196157"}]},"ts":"1675944196157"} 2023-02-09 12:03:16,160 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-09 12:03:16,160 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 12fbf7cab2a9a9b03d763d819172cf87, server=jenkins-hbase4.apache.org,36427,1675944195143 in 196 msec 2023-02-09 12:03:16,162 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-09 12:03:16,162 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=12fbf7cab2a9a9b03d763d819172cf87, ASSIGN in 360 msec 2023-02-09 12:03:16,162 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 12:03:16,162 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675944196162"}]},"ts":"1675944196162"} 2023-02-09 12:03:16,164 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-09 12:03:16,166 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 12:03:16,168 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 411 msec 2023-02-09 12:03:16,257 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-09 12:03:16,258 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-09 12:03:16,258 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 12:03:16,260 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 12:03:16,261 INFO [RS-EventLoopGroup-13-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36930, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 12:03:16,264 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-09 12:03:16,271 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-09 12:03:16,274 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 10 msec 2023-02-09 12:03:16,285 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-09 12:03:16,291 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-09 12:03:16,293 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 8 msec 2023-02-09 12:03:16,300 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-09 12:03:16,302 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-09 12:03:16,302 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 1.104sec 2023-02-09 12:03:16,302 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-09 12:03:16,302 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-09 12:03:16,302 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-09 12:03:16,302 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36247,1675944195090-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-09 12:03:16,302 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36247,1675944195090-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-09 12:03:16,303 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-09 12:03:16,392 DEBUG [Listener at localhost/45917] zookeeper.ReadOnlyZKClient(139): Connect 0x1e849cf9 to 127.0.0.1:62567 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 12:03:16,397 DEBUG [Listener at localhost/45917] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@58ce421d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 12:03:16,399 DEBUG [hconnection-0x34bbc11e-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 12:03:16,400 INFO [RS-EventLoopGroup-14-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33654, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 12:03:16,401 INFO [Listener at localhost/45917] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,36247,1675944195090 2023-02-09 12:03:16,402 DEBUG [Listener at localhost/45917] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-09 12:03:16,402 INFO [Listener at localhost/45917] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:16,402 INFO [Listener at localhost/45917] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:16,403 DEBUG [Listener at localhost/45917] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-09 12:03:16,404 INFO [RS-EventLoopGroup-12-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36256, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-09 12:03:16,405 INFO [Listener at localhost/45917] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-09 12:03:16,405 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36247] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceMultiRegion 2023-02-09 12:03:16,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36247] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-09 12:03:16,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36247] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 94 connection: 172.31.14.131:36256 deadline: 1675944256405, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion 2023-02-09 12:03:16,406 INFO [Listener at localhost/45917] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceMultiRegion' 2023-02-09 12:03:16,406 INFO [Listener at localhost/45917] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:16,406 INFO [Listener at localhost/45917] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:16,408 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36247] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-09 12:03:16,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36247] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-09 12:03:16,411 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 12:03:16,411 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36247] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceMultiRegion" procId is: 10 2023-02-09 12:03:16,411 INFO [Listener at localhost/45917] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:16,411 INFO [Listener at localhost/45917] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:16,411 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 12:03:16,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36247] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 12:03:16,418 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/fc93a9dbe44dab8e3d7c7b74ab677eef 2023-02-09 12:03:16,418 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/c9287bd8c1c12cde6a38f884d6d1fbbb 2023-02-09 12:03:16,418 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/47f38db786eccf0b6b5d6e2a84049446 2023-02-09 12:03:16,418 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/0f9ec56206c8a4a22ea16c5e609aa91e 2023-02-09 12:03:16,418 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/fa5605bcfd9107cd3d59527f4cebc62e 2023-02-09 12:03:16,418 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/afaa39f80fc4e48681467bdcafa36d2f 2023-02-09 12:03:16,418 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/63c860f86a4badc3807b95d70675d9f2 2023-02-09 12:03:16,418 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/e9940616385adfef1b4a360461e5f6aa 2023-02-09 12:03:16,419 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/fc93a9dbe44dab8e3d7c7b74ab677eef empty. 2023-02-09 12:03:16,419 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/fa5605bcfd9107cd3d59527f4cebc62e empty. 2023-02-09 12:03:16,419 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/63c860f86a4badc3807b95d70675d9f2 empty. 2023-02-09 12:03:16,419 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/0f9ec56206c8a4a22ea16c5e609aa91e empty. 2023-02-09 12:03:16,419 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/47f38db786eccf0b6b5d6e2a84049446 empty. 2023-02-09 12:03:16,419 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/c9287bd8c1c12cde6a38f884d6d1fbbb empty. 2023-02-09 12:03:16,420 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/e9940616385adfef1b4a360461e5f6aa empty. 2023-02-09 12:03:16,420 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/afaa39f80fc4e48681467bdcafa36d2f empty. 2023-02-09 12:03:16,420 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/fc93a9dbe44dab8e3d7c7b74ab677eef 2023-02-09 12:03:16,420 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/0f9ec56206c8a4a22ea16c5e609aa91e 2023-02-09 12:03:16,420 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/b99c55f7f2e0c44b0df4935d019d297c 2023-02-09 12:03:16,420 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/f16214bbc54fdfa480400f03bb3486f8 2023-02-09 12:03:16,420 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/63c860f86a4badc3807b95d70675d9f2 2023-02-09 12:03:16,420 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/fa5605bcfd9107cd3d59527f4cebc62e 2023-02-09 12:03:16,420 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/afaa39f80fc4e48681467bdcafa36d2f 2023-02-09 12:03:16,420 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/e9940616385adfef1b4a360461e5f6aa 2023-02-09 12:03:16,420 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/c9287bd8c1c12cde6a38f884d6d1fbbb 2023-02-09 12:03:16,420 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/47f38db786eccf0b6b5d6e2a84049446 2023-02-09 12:03:16,420 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/f16214bbc54fdfa480400f03bb3486f8 empty. 2023-02-09 12:03:16,420 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/b99c55f7f2e0c44b0df4935d019d297c empty. 2023-02-09 12:03:16,421 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/f16214bbc54fdfa480400f03bb3486f8 2023-02-09 12:03:16,421 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/b99c55f7f2e0c44b0df4935d019d297c 2023-02-09 12:03:16,421 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-09 12:03:16,429 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/.tabledesc/.tableinfo.0000000001 2023-02-09 12:03:16,430 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 63c860f86a4badc3807b95d70675d9f2, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1675944196408.63c860f86a4badc3807b95d70675d9f2.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp 2023-02-09 12:03:16,431 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => e9940616385adfef1b4a360461e5f6aa, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1675944196408.e9940616385adfef1b4a360461e5f6aa.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp 2023-02-09 12:03:16,431 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => fc93a9dbe44dab8e3d7c7b74ab677eef, NAME => 'testWithMockedMapReduceMultiRegion,,1675944196408.fc93a9dbe44dab8e3d7c7b74ab677eef.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp 2023-02-09 12:03:16,438 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1675944196408.63c860f86a4badc3807b95d70675d9f2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:16,438 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 63c860f86a4badc3807b95d70675d9f2, disabling compactions & flushes 2023-02-09 12:03:16,438 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1675944196408.63c860f86a4badc3807b95d70675d9f2. 2023-02-09 12:03:16,438 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1675944196408.63c860f86a4badc3807b95d70675d9f2. 2023-02-09 12:03:16,438 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1675944196408.63c860f86a4badc3807b95d70675d9f2. after waiting 0 ms 2023-02-09 12:03:16,438 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1675944196408.63c860f86a4badc3807b95d70675d9f2. 2023-02-09 12:03:16,438 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1675944196408.63c860f86a4badc3807b95d70675d9f2. 2023-02-09 12:03:16,438 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 63c860f86a4badc3807b95d70675d9f2: Waiting for close lock at 1675944196438Disabling compacts and flushes for region at 1675944196438Disabling writes for close at 1675944196438Writing region close event to WAL at 1675944196438Closed at 1675944196438 2023-02-09 12:03:16,439 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => c9287bd8c1c12cde6a38f884d6d1fbbb, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675944196408.c9287bd8c1c12cde6a38f884d6d1fbbb.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp 2023-02-09 12:03:16,439 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1675944196408.e9940616385adfef1b4a360461e5f6aa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:16,439 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1675944196408.fc93a9dbe44dab8e3d7c7b74ab677eef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:16,439 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing e9940616385adfef1b4a360461e5f6aa, disabling compactions & flushes 2023-02-09 12:03:16,439 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing fc93a9dbe44dab8e3d7c7b74ab677eef, disabling compactions & flushes 2023-02-09 12:03:16,439 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1675944196408.e9940616385adfef1b4a360461e5f6aa. 2023-02-09 12:03:16,439 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1675944196408.fc93a9dbe44dab8e3d7c7b74ab677eef. 2023-02-09 12:03:16,439 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1675944196408.e9940616385adfef1b4a360461e5f6aa. 2023-02-09 12:03:16,439 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1675944196408.fc93a9dbe44dab8e3d7c7b74ab677eef. 2023-02-09 12:03:16,439 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1675944196408.e9940616385adfef1b4a360461e5f6aa. after waiting 0 ms 2023-02-09 12:03:16,439 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1675944196408.fc93a9dbe44dab8e3d7c7b74ab677eef. after waiting 0 ms 2023-02-09 12:03:16,439 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1675944196408.e9940616385adfef1b4a360461e5f6aa. 2023-02-09 12:03:16,439 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1675944196408.fc93a9dbe44dab8e3d7c7b74ab677eef. 2023-02-09 12:03:16,439 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1675944196408.e9940616385adfef1b4a360461e5f6aa. 2023-02-09 12:03:16,439 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1675944196408.fc93a9dbe44dab8e3d7c7b74ab677eef. 2023-02-09 12:03:16,439 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for e9940616385adfef1b4a360461e5f6aa: Waiting for close lock at 1675944196439Disabling compacts and flushes for region at 1675944196439Disabling writes for close at 1675944196439Writing region close event to WAL at 1675944196439Closed at 1675944196439 2023-02-09 12:03:16,439 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for fc93a9dbe44dab8e3d7c7b74ab677eef: Waiting for close lock at 1675944196439Disabling compacts and flushes for region at 1675944196439Disabling writes for close at 1675944196439Writing region close event to WAL at 1675944196439Closed at 1675944196439 2023-02-09 12:03:16,440 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => afaa39f80fc4e48681467bdcafa36d2f, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675944196408.afaa39f80fc4e48681467bdcafa36d2f.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp 2023-02-09 12:03:16,440 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => fa5605bcfd9107cd3d59527f4cebc62e, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1675944196408.fa5605bcfd9107cd3d59527f4cebc62e.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp 2023-02-09 12:03:16,452 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675944196408.c9287bd8c1c12cde6a38f884d6d1fbbb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:16,452 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing c9287bd8c1c12cde6a38f884d6d1fbbb, disabling compactions & flushes 2023-02-09 12:03:16,452 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675944196408.c9287bd8c1c12cde6a38f884d6d1fbbb. 2023-02-09 12:03:16,452 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675944196408.c9287bd8c1c12cde6a38f884d6d1fbbb. 2023-02-09 12:03:16,452 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675944196408.c9287bd8c1c12cde6a38f884d6d1fbbb. after waiting 0 ms 2023-02-09 12:03:16,452 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675944196408.c9287bd8c1c12cde6a38f884d6d1fbbb. 2023-02-09 12:03:16,452 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675944196408.c9287bd8c1c12cde6a38f884d6d1fbbb. 2023-02-09 12:03:16,452 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for c9287bd8c1c12cde6a38f884d6d1fbbb: Waiting for close lock at 1675944196452Disabling compacts and flushes for region at 1675944196452Disabling writes for close at 1675944196452Writing region close event to WAL at 1675944196452Closed at 1675944196452 2023-02-09 12:03:16,453 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 47f38db786eccf0b6b5d6e2a84049446, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1675944196408.47f38db786eccf0b6b5d6e2a84049446.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp 2023-02-09 12:03:16,456 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675944196408.afaa39f80fc4e48681467bdcafa36d2f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:16,456 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing afaa39f80fc4e48681467bdcafa36d2f, disabling compactions & flushes 2023-02-09 12:03:16,456 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675944196408.afaa39f80fc4e48681467bdcafa36d2f. 2023-02-09 12:03:16,456 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675944196408.afaa39f80fc4e48681467bdcafa36d2f. 2023-02-09 12:03:16,456 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675944196408.afaa39f80fc4e48681467bdcafa36d2f. after waiting 0 ms 2023-02-09 12:03:16,456 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675944196408.afaa39f80fc4e48681467bdcafa36d2f. 2023-02-09 12:03:16,456 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675944196408.afaa39f80fc4e48681467bdcafa36d2f. 2023-02-09 12:03:16,457 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for afaa39f80fc4e48681467bdcafa36d2f: Waiting for close lock at 1675944196456Disabling compacts and flushes for region at 1675944196456Disabling writes for close at 1675944196456Writing region close event to WAL at 1675944196456Closed at 1675944196456 2023-02-09 12:03:16,457 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 0f9ec56206c8a4a22ea16c5e609aa91e, NAME => 'testWithMockedMapReduceMultiRegion,t43,1675944196408.0f9ec56206c8a4a22ea16c5e609aa91e.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp 2023-02-09 12:03:16,458 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1675944196408.fa5605bcfd9107cd3d59527f4cebc62e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:16,458 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing fa5605bcfd9107cd3d59527f4cebc62e, disabling compactions & flushes 2023-02-09 12:03:16,458 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1675944196408.fa5605bcfd9107cd3d59527f4cebc62e. 2023-02-09 12:03:16,458 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1675944196408.fa5605bcfd9107cd3d59527f4cebc62e. 2023-02-09 12:03:16,458 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1675944196408.fa5605bcfd9107cd3d59527f4cebc62e. after waiting 0 ms 2023-02-09 12:03:16,458 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1675944196408.fa5605bcfd9107cd3d59527f4cebc62e. 2023-02-09 12:03:16,458 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1675944196408.fa5605bcfd9107cd3d59527f4cebc62e. 2023-02-09 12:03:16,458 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for fa5605bcfd9107cd3d59527f4cebc62e: Waiting for close lock at 1675944196458Disabling compacts and flushes for region at 1675944196458Disabling writes for close at 1675944196458Writing region close event to WAL at 1675944196458Closed at 1675944196458 2023-02-09 12:03:16,459 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => b99c55f7f2e0c44b0df4935d019d297c, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1675944196408.b99c55f7f2e0c44b0df4935d019d297c.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp 2023-02-09 12:03:16,465 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1675944196408.47f38db786eccf0b6b5d6e2a84049446.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:16,465 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 47f38db786eccf0b6b5d6e2a84049446, disabling compactions & flushes 2023-02-09 12:03:16,465 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1675944196408.47f38db786eccf0b6b5d6e2a84049446. 2023-02-09 12:03:16,465 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1675944196408.47f38db786eccf0b6b5d6e2a84049446. 2023-02-09 12:03:16,465 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1675944196408.47f38db786eccf0b6b5d6e2a84049446. after waiting 0 ms 2023-02-09 12:03:16,465 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1675944196408.47f38db786eccf0b6b5d6e2a84049446. 2023-02-09 12:03:16,465 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1675944196408.47f38db786eccf0b6b5d6e2a84049446. 2023-02-09 12:03:16,465 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 47f38db786eccf0b6b5d6e2a84049446: Waiting for close lock at 1675944196465Disabling compacts and flushes for region at 1675944196465Disabling writes for close at 1675944196465Writing region close event to WAL at 1675944196465Closed at 1675944196465 2023-02-09 12:03:16,465 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => f16214bbc54fdfa480400f03bb3486f8, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1675944196408.f16214bbc54fdfa480400f03bb3486f8.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp 2023-02-09 12:03:16,470 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1675944196408.0f9ec56206c8a4a22ea16c5e609aa91e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:16,470 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 0f9ec56206c8a4a22ea16c5e609aa91e, disabling compactions & flushes 2023-02-09 12:03:16,470 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1675944196408.0f9ec56206c8a4a22ea16c5e609aa91e. 2023-02-09 12:03:16,470 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1675944196408.0f9ec56206c8a4a22ea16c5e609aa91e. 2023-02-09 12:03:16,470 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1675944196408.0f9ec56206c8a4a22ea16c5e609aa91e. after waiting 0 ms 2023-02-09 12:03:16,470 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1675944196408.0f9ec56206c8a4a22ea16c5e609aa91e. 2023-02-09 12:03:16,470 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1675944196408.0f9ec56206c8a4a22ea16c5e609aa91e. 2023-02-09 12:03:16,470 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 0f9ec56206c8a4a22ea16c5e609aa91e: Waiting for close lock at 1675944196470Disabling compacts and flushes for region at 1675944196470Disabling writes for close at 1675944196470Writing region close event to WAL at 1675944196470Closed at 1675944196470 2023-02-09 12:03:16,472 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1675944196408.b99c55f7f2e0c44b0df4935d019d297c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:16,472 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing b99c55f7f2e0c44b0df4935d019d297c, disabling compactions & flushes 2023-02-09 12:03:16,472 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1675944196408.b99c55f7f2e0c44b0df4935d019d297c. 2023-02-09 12:03:16,472 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1675944196408.b99c55f7f2e0c44b0df4935d019d297c. 2023-02-09 12:03:16,472 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1675944196408.b99c55f7f2e0c44b0df4935d019d297c. after waiting 0 ms 2023-02-09 12:03:16,472 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1675944196408.b99c55f7f2e0c44b0df4935d019d297c. 2023-02-09 12:03:16,472 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1675944196408.b99c55f7f2e0c44b0df4935d019d297c. 2023-02-09 12:03:16,472 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for b99c55f7f2e0c44b0df4935d019d297c: Waiting for close lock at 1675944196472Disabling compacts and flushes for region at 1675944196472Disabling writes for close at 1675944196472Writing region close event to WAL at 1675944196472Closed at 1675944196472 2023-02-09 12:03:16,473 INFO [RS:1;jenkins-hbase4:36313] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36313%2C1675944195173, suffix=, logDir=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/WALs/jenkins-hbase4.apache.org,36313,1675944195173, archiveDir=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/oldWALs, maxLogs=32 2023-02-09 12:03:16,485 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1675944196408.f16214bbc54fdfa480400f03bb3486f8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:16,485 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing f16214bbc54fdfa480400f03bb3486f8, disabling compactions & flushes 2023-02-09 12:03:16,485 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1675944196408.f16214bbc54fdfa480400f03bb3486f8. 2023-02-09 12:03:16,485 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1675944196408.f16214bbc54fdfa480400f03bb3486f8. 2023-02-09 12:03:16,485 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1675944196408.f16214bbc54fdfa480400f03bb3486f8. after waiting 0 ms 2023-02-09 12:03:16,485 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1675944196408.f16214bbc54fdfa480400f03bb3486f8. 2023-02-09 12:03:16,485 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1675944196408.f16214bbc54fdfa480400f03bb3486f8. 2023-02-09 12:03:16,485 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for f16214bbc54fdfa480400f03bb3486f8: Waiting for close lock at 1675944196485Disabling compacts and flushes for region at 1675944196485Disabling writes for close at 1675944196485Writing region close event to WAL at 1675944196485Closed at 1675944196485 2023-02-09 12:03:16,487 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33109,DS-02e5afc0-53bc-483d-97c2-eb8d24f6549f,DISK] 2023-02-09 12:03:16,487 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44921,DS-1afc4939-ac87-4206-91c8-54ad7838ee96,DISK] 2023-02-09 12:03:16,488 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 12:03:16,489 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1675944196408.63c860f86a4badc3807b95d70675d9f2.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675944196489"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675944196489"}]},"ts":"1675944196489"} 2023-02-09 12:03:16,489 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1675944196408.e9940616385adfef1b4a360461e5f6aa.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675944196489"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675944196489"}]},"ts":"1675944196489"} 2023-02-09 12:03:16,489 INFO [RS:1;jenkins-hbase4:36313] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/WALs/jenkins-hbase4.apache.org,36313,1675944195173/jenkins-hbase4.apache.org%2C36313%2C1675944195173.1675944196474 2023-02-09 12:03:16,489 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1675944196408.fc93a9dbe44dab8e3d7c7b74ab677eef.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675944196489"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675944196489"}]},"ts":"1675944196489"} 2023-02-09 12:03:16,489 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1675944196408.c9287bd8c1c12cde6a38f884d6d1fbbb.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675944196489"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675944196489"}]},"ts":"1675944196489"} 2023-02-09 12:03:16,489 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1675944196408.afaa39f80fc4e48681467bdcafa36d2f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675944196489"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675944196489"}]},"ts":"1675944196489"} 2023-02-09 12:03:16,490 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1675944196408.fa5605bcfd9107cd3d59527f4cebc62e.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675944196489"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675944196489"}]},"ts":"1675944196489"} 2023-02-09 12:03:16,490 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1675944196408.47f38db786eccf0b6b5d6e2a84049446.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675944196489"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675944196489"}]},"ts":"1675944196489"} 2023-02-09 12:03:16,490 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1675944196408.0f9ec56206c8a4a22ea16c5e609aa91e.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675944196489"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675944196489"}]},"ts":"1675944196489"} 2023-02-09 12:03:16,490 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1675944196408.b99c55f7f2e0c44b0df4935d019d297c.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675944196489"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675944196489"}]},"ts":"1675944196489"} 2023-02-09 12:03:16,490 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1675944196408.f16214bbc54fdfa480400f03bb3486f8.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675944196489"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675944196489"}]},"ts":"1675944196489"} 2023-02-09 12:03:16,490 DEBUG [RS:1;jenkins-hbase4:36313] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33109,DS-02e5afc0-53bc-483d-97c2-eb8d24f6549f,DISK], DatanodeInfoWithStorage[127.0.0.1:44921,DS-1afc4939-ac87-4206-91c8-54ad7838ee96,DISK]] 2023-02-09 12:03:16,494 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-09 12:03:16,494 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 12:03:16,494 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675944196494"}]},"ts":"1675944196494"} 2023-02-09 12:03:16,496 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLING in hbase:meta 2023-02-09 12:03:16,503 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 12:03:16,509 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 12:03:16,509 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 12:03:16,509 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 12:03:16,509 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=fc93a9dbe44dab8e3d7c7b74ab677eef, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e9940616385adfef1b4a360461e5f6aa, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=63c860f86a4badc3807b95d70675d9f2, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c9287bd8c1c12cde6a38f884d6d1fbbb, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=afaa39f80fc4e48681467bdcafa36d2f, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=fa5605bcfd9107cd3d59527f4cebc62e, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=47f38db786eccf0b6b5d6e2a84049446, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=0f9ec56206c8a4a22ea16c5e609aa91e, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b99c55f7f2e0c44b0df4935d019d297c, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f16214bbc54fdfa480400f03bb3486f8, ASSIGN}] 2023-02-09 12:03:16,512 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e9940616385adfef1b4a360461e5f6aa, ASSIGN 2023-02-09 12:03:16,512 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=fc93a9dbe44dab8e3d7c7b74ab677eef, ASSIGN 2023-02-09 12:03:16,512 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=63c860f86a4badc3807b95d70675d9f2, ASSIGN 2023-02-09 12:03:16,512 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c9287bd8c1c12cde6a38f884d6d1fbbb, ASSIGN 2023-02-09 12:03:16,512 INFO [Listener at localhost/45917] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:16,512 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=63c860f86a4badc3807b95d70675d9f2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36427,1675944195143; forceNewPlan=false, retain=false 2023-02-09 12:03:16,512 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=fc93a9dbe44dab8e3d7c7b74ab677eef, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36427,1675944195143; forceNewPlan=false, retain=false 2023-02-09 12:03:16,512 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e9940616385adfef1b4a360461e5f6aa, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36313,1675944195173; forceNewPlan=false, retain=false 2023-02-09 12:03:16,513 INFO [Listener at localhost/45917] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:16,513 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c9287bd8c1c12cde6a38f884d6d1fbbb, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36313,1675944195173; forceNewPlan=false, retain=false 2023-02-09 12:03:16,513 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f16214bbc54fdfa480400f03bb3486f8, ASSIGN 2023-02-09 12:03:16,514 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b99c55f7f2e0c44b0df4935d019d297c, ASSIGN 2023-02-09 12:03:16,514 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=0f9ec56206c8a4a22ea16c5e609aa91e, ASSIGN 2023-02-09 12:03:16,514 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=47f38db786eccf0b6b5d6e2a84049446, ASSIGN 2023-02-09 12:03:16,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36247] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 12:03:16,514 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=fa5605bcfd9107cd3d59527f4cebc62e, ASSIGN 2023-02-09 12:03:16,514 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f16214bbc54fdfa480400f03bb3486f8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36313,1675944195173; forceNewPlan=false, retain=false 2023-02-09 12:03:16,514 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b99c55f7f2e0c44b0df4935d019d297c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36427,1675944195143; forceNewPlan=false, retain=false 2023-02-09 12:03:16,515 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=0f9ec56206c8a4a22ea16c5e609aa91e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36313,1675944195173; forceNewPlan=false, retain=false 2023-02-09 12:03:16,515 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=47f38db786eccf0b6b5d6e2a84049446, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36427,1675944195143; forceNewPlan=false, retain=false 2023-02-09 12:03:16,515 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=fa5605bcfd9107cd3d59527f4cebc62e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36313,1675944195173; forceNewPlan=false, retain=false 2023-02-09 12:03:16,515 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=afaa39f80fc4e48681467bdcafa36d2f, ASSIGN 2023-02-09 12:03:16,516 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=afaa39f80fc4e48681467bdcafa36d2f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36427,1675944195143; forceNewPlan=false, retain=false 2023-02-09 12:03:16,663 INFO [jenkins-hbase4:36247] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-09 12:03:16,669 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=63c860f86a4badc3807b95d70675d9f2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36427,1675944195143 2023-02-09 12:03:16,669 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=fc93a9dbe44dab8e3d7c7b74ab677eef, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36427,1675944195143 2023-02-09 12:03:16,669 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=b99c55f7f2e0c44b0df4935d019d297c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36427,1675944195143 2023-02-09 12:03:16,669 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=47f38db786eccf0b6b5d6e2a84049446, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36427,1675944195143 2023-02-09 12:03:16,669 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=afaa39f80fc4e48681467bdcafa36d2f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36427,1675944195143 2023-02-09 12:03:16,669 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1675944196408.47f38db786eccf0b6b5d6e2a84049446.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675944196669"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675944196669"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675944196669"}]},"ts":"1675944196669"} 2023-02-09 12:03:16,670 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1675944196408.afaa39f80fc4e48681467bdcafa36d2f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675944196669"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675944196669"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675944196669"}]},"ts":"1675944196669"} 2023-02-09 12:03:16,669 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1675944196408.b99c55f7f2e0c44b0df4935d019d297c.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675944196669"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675944196669"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675944196669"}]},"ts":"1675944196669"} 2023-02-09 12:03:16,669 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1675944196408.fc93a9dbe44dab8e3d7c7b74ab677eef.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675944196669"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675944196669"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675944196669"}]},"ts":"1675944196669"} 2023-02-09 12:03:16,669 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1675944196408.63c860f86a4badc3807b95d70675d9f2.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675944196669"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675944196669"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675944196669"}]},"ts":"1675944196669"} 2023-02-09 12:03:16,671 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=17, state=RUNNABLE; OpenRegionProcedure 47f38db786eccf0b6b5d6e2a84049446, server=jenkins-hbase4.apache.org,36427,1675944195143}] 2023-02-09 12:03:16,672 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=15, state=RUNNABLE; OpenRegionProcedure afaa39f80fc4e48681467bdcafa36d2f, server=jenkins-hbase4.apache.org,36427,1675944195143}] 2023-02-09 12:03:16,673 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=19, state=RUNNABLE; OpenRegionProcedure b99c55f7f2e0c44b0df4935d019d297c, server=jenkins-hbase4.apache.org,36427,1675944195143}] 2023-02-09 12:03:16,674 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=11, state=RUNNABLE; OpenRegionProcedure fc93a9dbe44dab8e3d7c7b74ab677eef, server=jenkins-hbase4.apache.org,36427,1675944195143}] 2023-02-09 12:03:16,674 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=13, state=RUNNABLE; OpenRegionProcedure 63c860f86a4badc3807b95d70675d9f2, server=jenkins-hbase4.apache.org,36427,1675944195143}] 2023-02-09 12:03:16,674 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=f16214bbc54fdfa480400f03bb3486f8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36313,1675944195173 2023-02-09 12:03:16,674 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1675944196408.f16214bbc54fdfa480400f03bb3486f8.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675944196674"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675944196674"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675944196674"}]},"ts":"1675944196674"} 2023-02-09 12:03:16,675 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=0f9ec56206c8a4a22ea16c5e609aa91e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36313,1675944195173 2023-02-09 12:03:16,675 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1675944196408.0f9ec56206c8a4a22ea16c5e609aa91e.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675944196675"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675944196675"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675944196675"}]},"ts":"1675944196675"} 2023-02-09 12:03:16,676 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=fa5605bcfd9107cd3d59527f4cebc62e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36313,1675944195173 2023-02-09 12:03:16,676 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1675944196408.fa5605bcfd9107cd3d59527f4cebc62e.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675944196676"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675944196676"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675944196676"}]},"ts":"1675944196676"} 2023-02-09 12:03:16,676 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=20, state=RUNNABLE; OpenRegionProcedure f16214bbc54fdfa480400f03bb3486f8, server=jenkins-hbase4.apache.org,36313,1675944195173}] 2023-02-09 12:03:16,677 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=e9940616385adfef1b4a360461e5f6aa, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36313,1675944195173 2023-02-09 12:03:16,677 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1675944196408.e9940616385adfef1b4a360461e5f6aa.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675944196677"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675944196677"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675944196677"}]},"ts":"1675944196677"} 2023-02-09 12:03:16,677 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=18, state=RUNNABLE; OpenRegionProcedure 0f9ec56206c8a4a22ea16c5e609aa91e, server=jenkins-hbase4.apache.org,36313,1675944195173}] 2023-02-09 12:03:16,677 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=c9287bd8c1c12cde6a38f884d6d1fbbb, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36313,1675944195173 2023-02-09 12:03:16,677 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1675944196408.c9287bd8c1c12cde6a38f884d6d1fbbb.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675944196677"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675944196677"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675944196677"}]},"ts":"1675944196677"} 2023-02-09 12:03:16,678 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=16, state=RUNNABLE; OpenRegionProcedure fa5605bcfd9107cd3d59527f4cebc62e, server=jenkins-hbase4.apache.org,36313,1675944195173}] 2023-02-09 12:03:16,680 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=12, state=RUNNABLE; OpenRegionProcedure e9940616385adfef1b4a360461e5f6aa, server=jenkins-hbase4.apache.org,36313,1675944195173}] 2023-02-09 12:03:16,681 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=14, state=RUNNABLE; OpenRegionProcedure c9287bd8c1c12cde6a38f884d6d1fbbb, server=jenkins-hbase4.apache.org,36313,1675944195173}] 2023-02-09 12:03:16,714 INFO [Listener at localhost/45917] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:16,715 INFO [Listener at localhost/45917] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:16,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36247] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 12:03:16,827 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,d\x84\x84,1675944196408.63c860f86a4badc3807b95d70675d9f2. 2023-02-09 12:03:16,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 63c860f86a4badc3807b95d70675d9f2, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1675944196408.63c860f86a4badc3807b95d70675d9f2.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-09 12:03:16,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 63c860f86a4badc3807b95d70675d9f2 2023-02-09 12:03:16,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1675944196408.63c860f86a4badc3807b95d70675d9f2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:16,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 63c860f86a4badc3807b95d70675d9f2 2023-02-09 12:03:16,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 63c860f86a4badc3807b95d70675d9f2 2023-02-09 12:03:16,828 INFO [StoreOpener-63c860f86a4badc3807b95d70675d9f2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 63c860f86a4badc3807b95d70675d9f2 2023-02-09 12:03:16,830 DEBUG [StoreOpener-63c860f86a4badc3807b95d70675d9f2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/63c860f86a4badc3807b95d70675d9f2/f1 2023-02-09 12:03:16,830 DEBUG [StoreOpener-63c860f86a4badc3807b95d70675d9f2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/63c860f86a4badc3807b95d70675d9f2/f1 2023-02-09 12:03:16,830 INFO [StoreOpener-63c860f86a4badc3807b95d70675d9f2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 63c860f86a4badc3807b95d70675d9f2 columnFamilyName f1 2023-02-09 12:03:16,830 INFO [StoreOpener-63c860f86a4badc3807b95d70675d9f2-1] regionserver.HStore(310): Store=63c860f86a4badc3807b95d70675d9f2/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:16,831 INFO [StoreOpener-63c860f86a4badc3807b95d70675d9f2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 63c860f86a4badc3807b95d70675d9f2 2023-02-09 12:03:16,831 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,t43,1675944196408.0f9ec56206c8a4a22ea16c5e609aa91e. 2023-02-09 12:03:16,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 0f9ec56206c8a4a22ea16c5e609aa91e, NAME => 'testWithMockedMapReduceMultiRegion,t43,1675944196408.0f9ec56206c8a4a22ea16c5e609aa91e.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-09 12:03:16,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 0f9ec56206c8a4a22ea16c5e609aa91e 2023-02-09 12:03:16,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1675944196408.0f9ec56206c8a4a22ea16c5e609aa91e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:16,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 0f9ec56206c8a4a22ea16c5e609aa91e 2023-02-09 12:03:16,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 0f9ec56206c8a4a22ea16c5e609aa91e 2023-02-09 12:03:16,832 DEBUG [StoreOpener-63c860f86a4badc3807b95d70675d9f2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/63c860f86a4badc3807b95d70675d9f2/f2 2023-02-09 12:03:16,832 DEBUG [StoreOpener-63c860f86a4badc3807b95d70675d9f2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/63c860f86a4badc3807b95d70675d9f2/f2 2023-02-09 12:03:16,832 INFO [StoreOpener-63c860f86a4badc3807b95d70675d9f2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 63c860f86a4badc3807b95d70675d9f2 columnFamilyName f2 2023-02-09 12:03:16,833 INFO [StoreOpener-63c860f86a4badc3807b95d70675d9f2-1] regionserver.HStore(310): Store=63c860f86a4badc3807b95d70675d9f2/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:16,833 INFO [StoreOpener-0f9ec56206c8a4a22ea16c5e609aa91e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0f9ec56206c8a4a22ea16c5e609aa91e 2023-02-09 12:03:16,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/63c860f86a4badc3807b95d70675d9f2 2023-02-09 12:03:16,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/63c860f86a4badc3807b95d70675d9f2 2023-02-09 12:03:16,834 DEBUG [StoreOpener-0f9ec56206c8a4a22ea16c5e609aa91e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/0f9ec56206c8a4a22ea16c5e609aa91e/f1 2023-02-09 12:03:16,834 DEBUG [StoreOpener-0f9ec56206c8a4a22ea16c5e609aa91e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/0f9ec56206c8a4a22ea16c5e609aa91e/f1 2023-02-09 12:03:16,834 INFO [StoreOpener-0f9ec56206c8a4a22ea16c5e609aa91e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0f9ec56206c8a4a22ea16c5e609aa91e columnFamilyName f1 2023-02-09 12:03:16,834 INFO [StoreOpener-0f9ec56206c8a4a22ea16c5e609aa91e-1] regionserver.HStore(310): Store=0f9ec56206c8a4a22ea16c5e609aa91e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:16,834 INFO [StoreOpener-0f9ec56206c8a4a22ea16c5e609aa91e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0f9ec56206c8a4a22ea16c5e609aa91e 2023-02-09 12:03:16,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 12:03:16,835 DEBUG [StoreOpener-0f9ec56206c8a4a22ea16c5e609aa91e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/0f9ec56206c8a4a22ea16c5e609aa91e/f2 2023-02-09 12:03:16,835 DEBUG [StoreOpener-0f9ec56206c8a4a22ea16c5e609aa91e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/0f9ec56206c8a4a22ea16c5e609aa91e/f2 2023-02-09 12:03:16,836 INFO [StoreOpener-0f9ec56206c8a4a22ea16c5e609aa91e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0f9ec56206c8a4a22ea16c5e609aa91e columnFamilyName f2 2023-02-09 12:03:16,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 63c860f86a4badc3807b95d70675d9f2 2023-02-09 12:03:16,836 INFO [StoreOpener-0f9ec56206c8a4a22ea16c5e609aa91e-1] regionserver.HStore(310): Store=0f9ec56206c8a4a22ea16c5e609aa91e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:16,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/0f9ec56206c8a4a22ea16c5e609aa91e 2023-02-09 12:03:16,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/0f9ec56206c8a4a22ea16c5e609aa91e 2023-02-09 12:03:16,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/63c860f86a4badc3807b95d70675d9f2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 12:03:16,838 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 63c860f86a4badc3807b95d70675d9f2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71752068, jitterRate=0.06918913125991821}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 12:03:16,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 63c860f86a4badc3807b95d70675d9f2: Running coprocessor pre-open hook at 1675944196827Writing region info on filesystem at 1675944196827Initializing all the Stores at 1675944196828 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944196828Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944196828Cleaning up temporary data from old regions at 1675944196834 (+6 ms)Cleaning up detritus from prior splits at 1675944196834Running coprocessor post-open hooks at 1675944196838 (+4 ms)Region opened successfully at 1675944196838 2023-02-09 12:03:16,839 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 12:03:16,839 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,d\x84\x84,1675944196408.63c860f86a4badc3807b95d70675d9f2., pid=25, masterSystemTime=1675944196823 2023-02-09 12:03:16,840 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 0f9ec56206c8a4a22ea16c5e609aa91e 2023-02-09 12:03:16,840 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,d\x84\x84,1675944196408.63c860f86a4badc3807b95d70675d9f2. 2023-02-09 12:03:16,841 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,d\x84\x84,1675944196408.63c860f86a4badc3807b95d70675d9f2. 2023-02-09 12:03:16,841 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,,1675944196408.fc93a9dbe44dab8e3d7c7b74ab677eef. 2023-02-09 12:03:16,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => fc93a9dbe44dab8e3d7c7b74ab677eef, NAME => 'testWithMockedMapReduceMultiRegion,,1675944196408.fc93a9dbe44dab8e3d7c7b74ab677eef.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-09 12:03:16,841 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=63c860f86a4badc3807b95d70675d9f2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36427,1675944195143 2023-02-09 12:03:16,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion fc93a9dbe44dab8e3d7c7b74ab677eef 2023-02-09 12:03:16,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1675944196408.fc93a9dbe44dab8e3d7c7b74ab677eef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:16,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for fc93a9dbe44dab8e3d7c7b74ab677eef 2023-02-09 12:03:16,841 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1675944196408.63c860f86a4badc3807b95d70675d9f2.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675944196841"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675944196841"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675944196841"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675944196841"}]},"ts":"1675944196841"} 2023-02-09 12:03:16,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for fc93a9dbe44dab8e3d7c7b74ab677eef 2023-02-09 12:03:16,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/0f9ec56206c8a4a22ea16c5e609aa91e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 12:03:16,842 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 0f9ec56206c8a4a22ea16c5e609aa91e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70200074, jitterRate=0.046062618494033813}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 12:03:16,842 INFO [StoreOpener-fc93a9dbe44dab8e3d7c7b74ab677eef-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region fc93a9dbe44dab8e3d7c7b74ab677eef 2023-02-09 12:03:16,842 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 0f9ec56206c8a4a22ea16c5e609aa91e: Running coprocessor pre-open hook at 1675944196832Writing region info on filesystem at 1675944196832Initializing all the Stores at 1675944196832Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944196832Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944196832Cleaning up temporary data from old regions at 1675944196838 (+6 ms)Cleaning up detritus from prior splits at 1675944196838Running coprocessor post-open hooks at 1675944196842 (+4 ms)Region opened successfully at 1675944196842 2023-02-09 12:03:16,843 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,t43,1675944196408.0f9ec56206c8a4a22ea16c5e609aa91e., pid=27, masterSystemTime=1675944196828 2023-02-09 12:03:16,844 DEBUG [StoreOpener-fc93a9dbe44dab8e3d7c7b74ab677eef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/fc93a9dbe44dab8e3d7c7b74ab677eef/f1 2023-02-09 12:03:16,844 DEBUG [StoreOpener-fc93a9dbe44dab8e3d7c7b74ab677eef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/fc93a9dbe44dab8e3d7c7b74ab677eef/f1 2023-02-09 12:03:16,844 INFO [StoreOpener-fc93a9dbe44dab8e3d7c7b74ab677eef-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fc93a9dbe44dab8e3d7c7b74ab677eef columnFamilyName f1 2023-02-09 12:03:16,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,t43,1675944196408.0f9ec56206c8a4a22ea16c5e609aa91e. 2023-02-09 12:03:16,845 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,t43,1675944196408.0f9ec56206c8a4a22ea16c5e609aa91e. 2023-02-09 12:03:16,845 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675944196408.c9287bd8c1c12cde6a38f884d6d1fbbb. 2023-02-09 12:03:16,845 INFO [StoreOpener-fc93a9dbe44dab8e3d7c7b74ab677eef-1] regionserver.HStore(310): Store=fc93a9dbe44dab8e3d7c7b74ab677eef/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:16,845 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=13 2023-02-09 12:03:16,845 INFO [StoreOpener-fc93a9dbe44dab8e3d7c7b74ab677eef-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region fc93a9dbe44dab8e3d7c7b74ab677eef 2023-02-09 12:03:16,845 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=0f9ec56206c8a4a22ea16c5e609aa91e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36313,1675944195173 2023-02-09 12:03:16,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c9287bd8c1c12cde6a38f884d6d1fbbb, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675944196408.c9287bd8c1c12cde6a38f884d6d1fbbb.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-09 12:03:16,845 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=13, state=SUCCESS; OpenRegionProcedure 63c860f86a4badc3807b95d70675d9f2, server=jenkins-hbase4.apache.org,36427,1675944195143 in 169 msec 2023-02-09 12:03:16,845 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,t43,1675944196408.0f9ec56206c8a4a22ea16c5e609aa91e.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675944196845"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675944196845"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675944196845"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675944196845"}]},"ts":"1675944196845"} 2023-02-09 12:03:16,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion c9287bd8c1c12cde6a38f884d6d1fbbb 2023-02-09 12:03:16,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675944196408.c9287bd8c1c12cde6a38f884d6d1fbbb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:16,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for c9287bd8c1c12cde6a38f884d6d1fbbb 2023-02-09 12:03:16,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for c9287bd8c1c12cde6a38f884d6d1fbbb 2023-02-09 12:03:16,846 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=63c860f86a4badc3807b95d70675d9f2, ASSIGN in 336 msec 2023-02-09 12:03:16,846 DEBUG [StoreOpener-fc93a9dbe44dab8e3d7c7b74ab677eef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/fc93a9dbe44dab8e3d7c7b74ab677eef/f2 2023-02-09 12:03:16,846 DEBUG [StoreOpener-fc93a9dbe44dab8e3d7c7b74ab677eef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/fc93a9dbe44dab8e3d7c7b74ab677eef/f2 2023-02-09 12:03:16,846 INFO [StoreOpener-c9287bd8c1c12cde6a38f884d6d1fbbb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c9287bd8c1c12cde6a38f884d6d1fbbb 2023-02-09 12:03:16,846 INFO [StoreOpener-fc93a9dbe44dab8e3d7c7b74ab677eef-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fc93a9dbe44dab8e3d7c7b74ab677eef columnFamilyName f2 2023-02-09 12:03:16,847 INFO [StoreOpener-fc93a9dbe44dab8e3d7c7b74ab677eef-1] regionserver.HStore(310): Store=fc93a9dbe44dab8e3d7c7b74ab677eef/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:16,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/fc93a9dbe44dab8e3d7c7b74ab677eef 2023-02-09 12:03:16,848 DEBUG [StoreOpener-c9287bd8c1c12cde6a38f884d6d1fbbb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/c9287bd8c1c12cde6a38f884d6d1fbbb/f1 2023-02-09 12:03:16,848 DEBUG [StoreOpener-c9287bd8c1c12cde6a38f884d6d1fbbb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/c9287bd8c1c12cde6a38f884d6d1fbbb/f1 2023-02-09 12:03:16,848 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=18 2023-02-09 12:03:16,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/fc93a9dbe44dab8e3d7c7b74ab677eef 2023-02-09 12:03:16,848 INFO [StoreOpener-c9287bd8c1c12cde6a38f884d6d1fbbb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c9287bd8c1c12cde6a38f884d6d1fbbb columnFamilyName f1 2023-02-09 12:03:16,848 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=18, state=SUCCESS; OpenRegionProcedure 0f9ec56206c8a4a22ea16c5e609aa91e, server=jenkins-hbase4.apache.org,36313,1675944195173 in 170 msec 2023-02-09 12:03:16,849 INFO [StoreOpener-c9287bd8c1c12cde6a38f884d6d1fbbb-1] regionserver.HStore(310): Store=c9287bd8c1c12cde6a38f884d6d1fbbb/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:16,849 INFO [StoreOpener-c9287bd8c1c12cde6a38f884d6d1fbbb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c9287bd8c1c12cde6a38f884d6d1fbbb 2023-02-09 12:03:16,849 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=0f9ec56206c8a4a22ea16c5e609aa91e, ASSIGN in 339 msec 2023-02-09 12:03:16,850 DEBUG [StoreOpener-c9287bd8c1c12cde6a38f884d6d1fbbb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/c9287bd8c1c12cde6a38f884d6d1fbbb/f2 2023-02-09 12:03:16,850 DEBUG [StoreOpener-c9287bd8c1c12cde6a38f884d6d1fbbb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/c9287bd8c1c12cde6a38f884d6d1fbbb/f2 2023-02-09 12:03:16,850 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 12:03:16,850 INFO [StoreOpener-c9287bd8c1c12cde6a38f884d6d1fbbb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c9287bd8c1c12cde6a38f884d6d1fbbb columnFamilyName f2 2023-02-09 12:03:16,850 INFO [StoreOpener-c9287bd8c1c12cde6a38f884d6d1fbbb-1] regionserver.HStore(310): Store=c9287bd8c1c12cde6a38f884d6d1fbbb/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:16,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for fc93a9dbe44dab8e3d7c7b74ab677eef 2023-02-09 12:03:16,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/c9287bd8c1c12cde6a38f884d6d1fbbb 2023-02-09 12:03:16,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/c9287bd8c1c12cde6a38f884d6d1fbbb 2023-02-09 12:03:16,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/fc93a9dbe44dab8e3d7c7b74ab677eef/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 12:03:16,853 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened fc93a9dbe44dab8e3d7c7b74ab677eef; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70952368, jitterRate=0.05727267265319824}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 12:03:16,853 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 12:03:16,853 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for fc93a9dbe44dab8e3d7c7b74ab677eef: Running coprocessor pre-open hook at 1675944196841Writing region info on filesystem at 1675944196841Initializing all the Stores at 1675944196842 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944196842Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944196842Cleaning up temporary data from old regions at 1675944196849 (+7 ms)Cleaning up detritus from prior splits at 1675944196849Running coprocessor post-open hooks at 1675944196853 (+4 ms)Region opened successfully at 1675944196853 2023-02-09 12:03:16,853 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,,1675944196408.fc93a9dbe44dab8e3d7c7b74ab677eef., pid=24, masterSystemTime=1675944196823 2023-02-09 12:03:16,854 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for c9287bd8c1c12cde6a38f884d6d1fbbb 2023-02-09 12:03:16,855 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=fc93a9dbe44dab8e3d7c7b74ab677eef, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36427,1675944195143 2023-02-09 12:03:16,855 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,,1675944196408.fc93a9dbe44dab8e3d7c7b74ab677eef.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675944196855"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675944196855"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675944196855"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675944196855"}]},"ts":"1675944196855"} 2023-02-09 12:03:16,856 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/c9287bd8c1c12cde6a38f884d6d1fbbb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 12:03:16,856 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,,1675944196408.fc93a9dbe44dab8e3d7c7b74ab677eef. 2023-02-09 12:03:16,856 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,,1675944196408.fc93a9dbe44dab8e3d7c7b74ab677eef. 2023-02-09 12:03:16,856 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675944196408.afaa39f80fc4e48681467bdcafa36d2f. 2023-02-09 12:03:16,856 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => afaa39f80fc4e48681467bdcafa36d2f, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675944196408.afaa39f80fc4e48681467bdcafa36d2f.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-09 12:03:16,856 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened c9287bd8c1c12cde6a38f884d6d1fbbb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68484321, jitterRate=0.020495906472206116}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 12:03:16,856 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion afaa39f80fc4e48681467bdcafa36d2f 2023-02-09 12:03:16,856 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for c9287bd8c1c12cde6a38f884d6d1fbbb: Running coprocessor pre-open hook at 1675944196845Writing region info on filesystem at 1675944196845Initializing all the Stores at 1675944196846 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944196846Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944196846Cleaning up temporary data from old regions at 1675944196852 (+6 ms)Cleaning up detritus from prior splits at 1675944196852Running coprocessor post-open hooks at 1675944196856 (+4 ms)Region opened successfully at 1675944196856 2023-02-09 12:03:16,856 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675944196408.afaa39f80fc4e48681467bdcafa36d2f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:16,856 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for afaa39f80fc4e48681467bdcafa36d2f 2023-02-09 12:03:16,856 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for afaa39f80fc4e48681467bdcafa36d2f 2023-02-09 12:03:16,857 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675944196408.c9287bd8c1c12cde6a38f884d6d1fbbb., pid=30, masterSystemTime=1675944196828 2023-02-09 12:03:16,858 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=11 2023-02-09 12:03:16,858 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=11, state=SUCCESS; OpenRegionProcedure fc93a9dbe44dab8e3d7c7b74ab677eef, server=jenkins-hbase4.apache.org,36427,1675944195143 in 182 msec 2023-02-09 12:03:16,858 INFO [StoreOpener-afaa39f80fc4e48681467bdcafa36d2f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region afaa39f80fc4e48681467bdcafa36d2f 2023-02-09 12:03:16,858 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675944196408.c9287bd8c1c12cde6a38f884d6d1fbbb. 2023-02-09 12:03:16,858 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675944196408.c9287bd8c1c12cde6a38f884d6d1fbbb. 2023-02-09 12:03:16,858 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,m\xED\xED,1675944196408.fa5605bcfd9107cd3d59527f4cebc62e. 2023-02-09 12:03:16,858 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => fa5605bcfd9107cd3d59527f4cebc62e, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1675944196408.fa5605bcfd9107cd3d59527f4cebc62e.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-09 12:03:16,859 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=c9287bd8c1c12cde6a38f884d6d1fbbb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36313,1675944195173 2023-02-09 12:03:16,859 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1675944196408.c9287bd8c1c12cde6a38f884d6d1fbbb.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675944196858"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675944196858"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675944196858"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675944196858"}]},"ts":"1675944196858"} 2023-02-09 12:03:16,859 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion fa5605bcfd9107cd3d59527f4cebc62e 2023-02-09 12:03:16,859 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1675944196408.fa5605bcfd9107cd3d59527f4cebc62e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:16,859 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=fc93a9dbe44dab8e3d7c7b74ab677eef, ASSIGN in 349 msec 2023-02-09 12:03:16,859 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for fa5605bcfd9107cd3d59527f4cebc62e 2023-02-09 12:03:16,859 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for fa5605bcfd9107cd3d59527f4cebc62e 2023-02-09 12:03:16,859 DEBUG [StoreOpener-afaa39f80fc4e48681467bdcafa36d2f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/afaa39f80fc4e48681467bdcafa36d2f/f1 2023-02-09 12:03:16,859 DEBUG [StoreOpener-afaa39f80fc4e48681467bdcafa36d2f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/afaa39f80fc4e48681467bdcafa36d2f/f1 2023-02-09 12:03:16,860 INFO [StoreOpener-afaa39f80fc4e48681467bdcafa36d2f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region afaa39f80fc4e48681467bdcafa36d2f columnFamilyName f1 2023-02-09 12:03:16,860 INFO [StoreOpener-afaa39f80fc4e48681467bdcafa36d2f-1] regionserver.HStore(310): Store=afaa39f80fc4e48681467bdcafa36d2f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:16,860 INFO [StoreOpener-fa5605bcfd9107cd3d59527f4cebc62e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region fa5605bcfd9107cd3d59527f4cebc62e 2023-02-09 12:03:16,860 INFO [StoreOpener-afaa39f80fc4e48681467bdcafa36d2f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region afaa39f80fc4e48681467bdcafa36d2f 2023-02-09 12:03:16,861 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=14 2023-02-09 12:03:16,861 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=14, state=SUCCESS; OpenRegionProcedure c9287bd8c1c12cde6a38f884d6d1fbbb, server=jenkins-hbase4.apache.org,36313,1675944195173 in 179 msec 2023-02-09 12:03:16,862 DEBUG [StoreOpener-fa5605bcfd9107cd3d59527f4cebc62e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/fa5605bcfd9107cd3d59527f4cebc62e/f1 2023-02-09 12:03:16,862 DEBUG [StoreOpener-afaa39f80fc4e48681467bdcafa36d2f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/afaa39f80fc4e48681467bdcafa36d2f/f2 2023-02-09 12:03:16,862 DEBUG [StoreOpener-afaa39f80fc4e48681467bdcafa36d2f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/afaa39f80fc4e48681467bdcafa36d2f/f2 2023-02-09 12:03:16,862 DEBUG [StoreOpener-fa5605bcfd9107cd3d59527f4cebc62e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/fa5605bcfd9107cd3d59527f4cebc62e/f1 2023-02-09 12:03:16,862 INFO [StoreOpener-fa5605bcfd9107cd3d59527f4cebc62e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fa5605bcfd9107cd3d59527f4cebc62e columnFamilyName f1 2023-02-09 12:03:16,862 INFO [StoreOpener-afaa39f80fc4e48681467bdcafa36d2f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region afaa39f80fc4e48681467bdcafa36d2f columnFamilyName f2 2023-02-09 12:03:16,862 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c9287bd8c1c12cde6a38f884d6d1fbbb, ASSIGN in 352 msec 2023-02-09 12:03:16,862 INFO [StoreOpener-fa5605bcfd9107cd3d59527f4cebc62e-1] regionserver.HStore(310): Store=fa5605bcfd9107cd3d59527f4cebc62e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:16,862 INFO [StoreOpener-afaa39f80fc4e48681467bdcafa36d2f-1] regionserver.HStore(310): Store=afaa39f80fc4e48681467bdcafa36d2f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:16,862 INFO [StoreOpener-fa5605bcfd9107cd3d59527f4cebc62e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region fa5605bcfd9107cd3d59527f4cebc62e 2023-02-09 12:03:16,863 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/afaa39f80fc4e48681467bdcafa36d2f 2023-02-09 12:03:16,863 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/afaa39f80fc4e48681467bdcafa36d2f 2023-02-09 12:03:16,864 DEBUG [StoreOpener-fa5605bcfd9107cd3d59527f4cebc62e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/fa5605bcfd9107cd3d59527f4cebc62e/f2 2023-02-09 12:03:16,864 DEBUG [StoreOpener-fa5605bcfd9107cd3d59527f4cebc62e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/fa5605bcfd9107cd3d59527f4cebc62e/f2 2023-02-09 12:03:16,864 INFO [StoreOpener-fa5605bcfd9107cd3d59527f4cebc62e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fa5605bcfd9107cd3d59527f4cebc62e columnFamilyName f2 2023-02-09 12:03:16,864 INFO [StoreOpener-fa5605bcfd9107cd3d59527f4cebc62e-1] regionserver.HStore(310): Store=fa5605bcfd9107cd3d59527f4cebc62e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:16,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/fa5605bcfd9107cd3d59527f4cebc62e 2023-02-09 12:03:16,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 12:03:16,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/fa5605bcfd9107cd3d59527f4cebc62e 2023-02-09 12:03:16,866 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for afaa39f80fc4e48681467bdcafa36d2f 2023-02-09 12:03:16,866 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 12:03:16,867 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/afaa39f80fc4e48681467bdcafa36d2f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 12:03:16,867 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for fa5605bcfd9107cd3d59527f4cebc62e 2023-02-09 12:03:16,868 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened afaa39f80fc4e48681467bdcafa36d2f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58838441, jitterRate=-0.12323890626430511}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 12:03:16,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for afaa39f80fc4e48681467bdcafa36d2f: Running coprocessor pre-open hook at 1675944196856Writing region info on filesystem at 1675944196856Initializing all the Stores at 1675944196858 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944196858Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944196858Cleaning up temporary data from old regions at 1675944196864 (+6 ms)Cleaning up detritus from prior splits at 1675944196864Running coprocessor post-open hooks at 1675944196868 (+4 ms)Region opened successfully at 1675944196868 2023-02-09 12:03:16,868 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675944196408.afaa39f80fc4e48681467bdcafa36d2f., pid=22, masterSystemTime=1675944196823 2023-02-09 12:03:16,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/fa5605bcfd9107cd3d59527f4cebc62e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 12:03:16,870 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened fa5605bcfd9107cd3d59527f4cebc62e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65838268, jitterRate=-0.018933355808258057}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 12:03:16,870 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for fa5605bcfd9107cd3d59527f4cebc62e: Running coprocessor pre-open hook at 1675944196859Writing region info on filesystem at 1675944196859Initializing all the Stores at 1675944196860 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944196860Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944196860Cleaning up temporary data from old regions at 1675944196866 (+6 ms)Cleaning up detritus from prior splits at 1675944196866Running coprocessor post-open hooks at 1675944196870 (+4 ms)Region opened successfully at 1675944196870 2023-02-09 12:03:16,870 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675944196408.afaa39f80fc4e48681467bdcafa36d2f. 2023-02-09 12:03:16,870 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675944196408.afaa39f80fc4e48681467bdcafa36d2f. 2023-02-09 12:03:16,870 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,wWV,1675944196408.b99c55f7f2e0c44b0df4935d019d297c. 2023-02-09 12:03:16,870 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=afaa39f80fc4e48681467bdcafa36d2f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36427,1675944195143 2023-02-09 12:03:16,870 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => b99c55f7f2e0c44b0df4935d019d297c, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1675944196408.b99c55f7f2e0c44b0df4935d019d297c.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-09 12:03:16,870 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1675944196408.afaa39f80fc4e48681467bdcafa36d2f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675944196870"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675944196870"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675944196870"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675944196870"}]},"ts":"1675944196870"} 2023-02-09 12:03:16,870 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion b99c55f7f2e0c44b0df4935d019d297c 2023-02-09 12:03:16,870 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1675944196408.b99c55f7f2e0c44b0df4935d019d297c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:16,870 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for b99c55f7f2e0c44b0df4935d019d297c 2023-02-09 12:03:16,870 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for b99c55f7f2e0c44b0df4935d019d297c 2023-02-09 12:03:16,871 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,m\xED\xED,1675944196408.fa5605bcfd9107cd3d59527f4cebc62e., pid=28, masterSystemTime=1675944196828 2023-02-09 12:03:16,872 INFO [StoreOpener-b99c55f7f2e0c44b0df4935d019d297c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b99c55f7f2e0c44b0df4935d019d297c 2023-02-09 12:03:16,872 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,m\xED\xED,1675944196408.fa5605bcfd9107cd3d59527f4cebc62e. 2023-02-09 12:03:16,872 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,m\xED\xED,1675944196408.fa5605bcfd9107cd3d59527f4cebc62e. 2023-02-09 12:03:16,872 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,zz{,1675944196408.f16214bbc54fdfa480400f03bb3486f8. 2023-02-09 12:03:16,872 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => f16214bbc54fdfa480400f03bb3486f8, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1675944196408.f16214bbc54fdfa480400f03bb3486f8.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-09 12:03:16,872 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion f16214bbc54fdfa480400f03bb3486f8 2023-02-09 12:03:16,872 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1675944196408.f16214bbc54fdfa480400f03bb3486f8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:16,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for f16214bbc54fdfa480400f03bb3486f8 2023-02-09 12:03:16,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for f16214bbc54fdfa480400f03bb3486f8 2023-02-09 12:03:16,875 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=fa5605bcfd9107cd3d59527f4cebc62e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36313,1675944195173 2023-02-09 12:03:16,875 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1675944196408.fa5605bcfd9107cd3d59527f4cebc62e.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675944196875"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675944196875"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675944196875"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675944196875"}]},"ts":"1675944196875"} 2023-02-09 12:03:16,875 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=15 2023-02-09 12:03:16,875 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=15, state=SUCCESS; OpenRegionProcedure afaa39f80fc4e48681467bdcafa36d2f, server=jenkins-hbase4.apache.org,36427,1675944195143 in 199 msec 2023-02-09 12:03:16,877 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=afaa39f80fc4e48681467bdcafa36d2f, ASSIGN in 366 msec 2023-02-09 12:03:16,878 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=16 2023-02-09 12:03:16,878 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=16, state=SUCCESS; OpenRegionProcedure fa5605bcfd9107cd3d59527f4cebc62e, server=jenkins-hbase4.apache.org,36313,1675944195173 in 198 msec 2023-02-09 12:03:16,879 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=fa5605bcfd9107cd3d59527f4cebc62e, ASSIGN in 369 msec 2023-02-09 12:03:16,881 DEBUG [StoreOpener-b99c55f7f2e0c44b0df4935d019d297c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/b99c55f7f2e0c44b0df4935d019d297c/f1 2023-02-09 12:03:16,881 DEBUG [StoreOpener-b99c55f7f2e0c44b0df4935d019d297c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/b99c55f7f2e0c44b0df4935d019d297c/f1 2023-02-09 12:03:16,881 INFO [StoreOpener-b99c55f7f2e0c44b0df4935d019d297c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b99c55f7f2e0c44b0df4935d019d297c columnFamilyName f1 2023-02-09 12:03:16,882 INFO [StoreOpener-b99c55f7f2e0c44b0df4935d019d297c-1] regionserver.HStore(310): Store=b99c55f7f2e0c44b0df4935d019d297c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:16,882 INFO [StoreOpener-b99c55f7f2e0c44b0df4935d019d297c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b99c55f7f2e0c44b0df4935d019d297c 2023-02-09 12:03:16,884 DEBUG [StoreOpener-b99c55f7f2e0c44b0df4935d019d297c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/b99c55f7f2e0c44b0df4935d019d297c/f2 2023-02-09 12:03:16,884 DEBUG [StoreOpener-b99c55f7f2e0c44b0df4935d019d297c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/b99c55f7f2e0c44b0df4935d019d297c/f2 2023-02-09 12:03:16,884 INFO [StoreOpener-f16214bbc54fdfa480400f03bb3486f8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f16214bbc54fdfa480400f03bb3486f8 2023-02-09 12:03:16,884 INFO [StoreOpener-b99c55f7f2e0c44b0df4935d019d297c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b99c55f7f2e0c44b0df4935d019d297c columnFamilyName f2 2023-02-09 12:03:16,884 INFO [StoreOpener-b99c55f7f2e0c44b0df4935d019d297c-1] regionserver.HStore(310): Store=b99c55f7f2e0c44b0df4935d019d297c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:16,885 DEBUG [StoreOpener-f16214bbc54fdfa480400f03bb3486f8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/f16214bbc54fdfa480400f03bb3486f8/f1 2023-02-09 12:03:16,885 DEBUG [StoreOpener-f16214bbc54fdfa480400f03bb3486f8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/f16214bbc54fdfa480400f03bb3486f8/f1 2023-02-09 12:03:16,885 INFO [StoreOpener-f16214bbc54fdfa480400f03bb3486f8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f16214bbc54fdfa480400f03bb3486f8 columnFamilyName f1 2023-02-09 12:03:16,885 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/b99c55f7f2e0c44b0df4935d019d297c 2023-02-09 12:03:16,886 INFO [StoreOpener-f16214bbc54fdfa480400f03bb3486f8-1] regionserver.HStore(310): Store=f16214bbc54fdfa480400f03bb3486f8/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:16,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/b99c55f7f2e0c44b0df4935d019d297c 2023-02-09 12:03:16,886 INFO [StoreOpener-f16214bbc54fdfa480400f03bb3486f8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f16214bbc54fdfa480400f03bb3486f8 2023-02-09 12:03:16,887 DEBUG [StoreOpener-f16214bbc54fdfa480400f03bb3486f8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/f16214bbc54fdfa480400f03bb3486f8/f2 2023-02-09 12:03:16,887 DEBUG [StoreOpener-f16214bbc54fdfa480400f03bb3486f8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/f16214bbc54fdfa480400f03bb3486f8/f2 2023-02-09 12:03:16,887 INFO [StoreOpener-f16214bbc54fdfa480400f03bb3486f8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f16214bbc54fdfa480400f03bb3486f8 columnFamilyName f2 2023-02-09 12:03:16,887 INFO [StoreOpener-f16214bbc54fdfa480400f03bb3486f8-1] regionserver.HStore(310): Store=f16214bbc54fdfa480400f03bb3486f8/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:16,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 12:03:16,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/f16214bbc54fdfa480400f03bb3486f8 2023-02-09 12:03:16,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/f16214bbc54fdfa480400f03bb3486f8 2023-02-09 12:03:16,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for b99c55f7f2e0c44b0df4935d019d297c 2023-02-09 12:03:16,891 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 12:03:16,891 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for f16214bbc54fdfa480400f03bb3486f8 2023-02-09 12:03:16,892 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/b99c55f7f2e0c44b0df4935d019d297c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 12:03:16,893 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened b99c55f7f2e0c44b0df4935d019d297c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70549173, jitterRate=0.051264598965644836}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 12:03:16,893 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for b99c55f7f2e0c44b0df4935d019d297c: Running coprocessor pre-open hook at 1675944196871Writing region info on filesystem at 1675944196871Initializing all the Stores at 1675944196871Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944196871Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944196871Cleaning up temporary data from old regions at 1675944196886 (+15 ms)Cleaning up detritus from prior splits at 1675944196887 (+1 ms)Running coprocessor post-open hooks at 1675944196893 (+6 ms)Region opened successfully at 1675944196893 2023-02-09 12:03:16,893 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,wWV,1675944196408.b99c55f7f2e0c44b0df4935d019d297c., pid=23, masterSystemTime=1675944196823 2023-02-09 12:03:16,895 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,wWV,1675944196408.b99c55f7f2e0c44b0df4935d019d297c. 2023-02-09 12:03:16,895 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,wWV,1675944196408.b99c55f7f2e0c44b0df4935d019d297c. 2023-02-09 12:03:16,895 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,q\x11\x10,1675944196408.47f38db786eccf0b6b5d6e2a84049446. 2023-02-09 12:03:16,895 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 47f38db786eccf0b6b5d6e2a84049446, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1675944196408.47f38db786eccf0b6b5d6e2a84049446.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-09 12:03:16,895 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=b99c55f7f2e0c44b0df4935d019d297c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36427,1675944195143 2023-02-09 12:03:16,896 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 47f38db786eccf0b6b5d6e2a84049446 2023-02-09 12:03:16,896 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1675944196408.47f38db786eccf0b6b5d6e2a84049446.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:16,896 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 47f38db786eccf0b6b5d6e2a84049446 2023-02-09 12:03:16,896 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 47f38db786eccf0b6b5d6e2a84049446 2023-02-09 12:03:16,896 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,wWV,1675944196408.b99c55f7f2e0c44b0df4935d019d297c.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675944196895"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675944196895"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675944196895"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675944196895"}]},"ts":"1675944196895"} 2023-02-09 12:03:16,897 INFO [StoreOpener-47f38db786eccf0b6b5d6e2a84049446-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 47f38db786eccf0b6b5d6e2a84049446 2023-02-09 12:03:16,897 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/f16214bbc54fdfa480400f03bb3486f8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 12:03:16,898 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened f16214bbc54fdfa480400f03bb3486f8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58869765, jitterRate=-0.12277214229106903}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 12:03:16,898 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for f16214bbc54fdfa480400f03bb3486f8: Running coprocessor pre-open hook at 1675944196873Writing region info on filesystem at 1675944196873Initializing all the Stores at 1675944196881 (+8 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944196881Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944196884 (+3 ms)Cleaning up temporary data from old regions at 1675944196890 (+6 ms)Cleaning up detritus from prior splits at 1675944196890Running coprocessor post-open hooks at 1675944196898 (+8 ms)Region opened successfully at 1675944196898 2023-02-09 12:03:16,899 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,zz{,1675944196408.f16214bbc54fdfa480400f03bb3486f8., pid=26, masterSystemTime=1675944196828 2023-02-09 12:03:16,899 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=19 2023-02-09 12:03:16,899 DEBUG [StoreOpener-47f38db786eccf0b6b5d6e2a84049446-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/47f38db786eccf0b6b5d6e2a84049446/f1 2023-02-09 12:03:16,900 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=19, state=SUCCESS; OpenRegionProcedure b99c55f7f2e0c44b0df4935d019d297c, server=jenkins-hbase4.apache.org,36427,1675944195143 in 224 msec 2023-02-09 12:03:16,900 DEBUG [StoreOpener-47f38db786eccf0b6b5d6e2a84049446-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/47f38db786eccf0b6b5d6e2a84049446/f1 2023-02-09 12:03:16,900 INFO [StoreOpener-47f38db786eccf0b6b5d6e2a84049446-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 47f38db786eccf0b6b5d6e2a84049446 columnFamilyName f1 2023-02-09 12:03:16,901 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b99c55f7f2e0c44b0df4935d019d297c, ASSIGN in 390 msec 2023-02-09 12:03:16,901 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,zz{,1675944196408.f16214bbc54fdfa480400f03bb3486f8. 2023-02-09 12:03:16,901 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,zz{,1675944196408.f16214bbc54fdfa480400f03bb3486f8. 2023-02-09 12:03:16,901 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,aaa,1675944196408.e9940616385adfef1b4a360461e5f6aa. 2023-02-09 12:03:16,901 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e9940616385adfef1b4a360461e5f6aa, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1675944196408.e9940616385adfef1b4a360461e5f6aa.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-09 12:03:16,901 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=f16214bbc54fdfa480400f03bb3486f8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36313,1675944195173 2023-02-09 12:03:16,901 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,zz{,1675944196408.f16214bbc54fdfa480400f03bb3486f8.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675944196901"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675944196901"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675944196901"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675944196901"}]},"ts":"1675944196901"} 2023-02-09 12:03:16,902 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion e9940616385adfef1b4a360461e5f6aa 2023-02-09 12:03:16,902 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1675944196408.e9940616385adfef1b4a360461e5f6aa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:16,902 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for e9940616385adfef1b4a360461e5f6aa 2023-02-09 12:03:16,902 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for e9940616385adfef1b4a360461e5f6aa 2023-02-09 12:03:16,903 INFO [StoreOpener-e9940616385adfef1b4a360461e5f6aa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e9940616385adfef1b4a360461e5f6aa 2023-02-09 12:03:16,904 INFO [StoreOpener-47f38db786eccf0b6b5d6e2a84049446-1] regionserver.HStore(310): Store=47f38db786eccf0b6b5d6e2a84049446/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:16,904 INFO [StoreOpener-47f38db786eccf0b6b5d6e2a84049446-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 47f38db786eccf0b6b5d6e2a84049446 2023-02-09 12:03:16,904 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=20 2023-02-09 12:03:16,904 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=20, state=SUCCESS; OpenRegionProcedure f16214bbc54fdfa480400f03bb3486f8, server=jenkins-hbase4.apache.org,36313,1675944195173 in 227 msec 2023-02-09 12:03:16,904 DEBUG [StoreOpener-e9940616385adfef1b4a360461e5f6aa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/e9940616385adfef1b4a360461e5f6aa/f1 2023-02-09 12:03:16,905 DEBUG [StoreOpener-e9940616385adfef1b4a360461e5f6aa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/e9940616385adfef1b4a360461e5f6aa/f1 2023-02-09 12:03:16,905 INFO [StoreOpener-e9940616385adfef1b4a360461e5f6aa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e9940616385adfef1b4a360461e5f6aa columnFamilyName f1 2023-02-09 12:03:16,905 INFO [StoreOpener-e9940616385adfef1b4a360461e5f6aa-1] regionserver.HStore(310): Store=e9940616385adfef1b4a360461e5f6aa/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:16,905 INFO [StoreOpener-e9940616385adfef1b4a360461e5f6aa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e9940616385adfef1b4a360461e5f6aa 2023-02-09 12:03:16,906 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f16214bbc54fdfa480400f03bb3486f8, ASSIGN in 395 msec 2023-02-09 12:03:16,906 DEBUG [StoreOpener-47f38db786eccf0b6b5d6e2a84049446-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/47f38db786eccf0b6b5d6e2a84049446/f2 2023-02-09 12:03:16,906 DEBUG [StoreOpener-47f38db786eccf0b6b5d6e2a84049446-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/47f38db786eccf0b6b5d6e2a84049446/f2 2023-02-09 12:03:16,906 INFO [StoreOpener-47f38db786eccf0b6b5d6e2a84049446-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 47f38db786eccf0b6b5d6e2a84049446 columnFamilyName f2 2023-02-09 12:03:16,906 INFO [StoreOpener-47f38db786eccf0b6b5d6e2a84049446-1] regionserver.HStore(310): Store=47f38db786eccf0b6b5d6e2a84049446/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:16,907 DEBUG [StoreOpener-e9940616385adfef1b4a360461e5f6aa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/e9940616385adfef1b4a360461e5f6aa/f2 2023-02-09 12:03:16,907 DEBUG [StoreOpener-e9940616385adfef1b4a360461e5f6aa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/e9940616385adfef1b4a360461e5f6aa/f2 2023-02-09 12:03:16,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/47f38db786eccf0b6b5d6e2a84049446 2023-02-09 12:03:16,907 INFO [StoreOpener-e9940616385adfef1b4a360461e5f6aa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e9940616385adfef1b4a360461e5f6aa columnFamilyName f2 2023-02-09 12:03:16,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/47f38db786eccf0b6b5d6e2a84049446 2023-02-09 12:03:16,908 INFO [StoreOpener-e9940616385adfef1b4a360461e5f6aa-1] regionserver.HStore(310): Store=e9940616385adfef1b4a360461e5f6aa/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:16,909 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/e9940616385adfef1b4a360461e5f6aa 2023-02-09 12:03:16,909 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/e9940616385adfef1b4a360461e5f6aa 2023-02-09 12:03:16,910 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 12:03:16,911 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 12:03:16,911 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 47f38db786eccf0b6b5d6e2a84049446 2023-02-09 12:03:16,912 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for e9940616385adfef1b4a360461e5f6aa 2023-02-09 12:03:16,914 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/47f38db786eccf0b6b5d6e2a84049446/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 12:03:16,914 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/e9940616385adfef1b4a360461e5f6aa/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 12:03:16,914 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 47f38db786eccf0b6b5d6e2a84049446; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65173182, jitterRate=-0.02884390950202942}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 12:03:16,914 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 47f38db786eccf0b6b5d6e2a84049446: Running coprocessor pre-open hook at 1675944196896Writing region info on filesystem at 1675944196896Initializing all the Stores at 1675944196897 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944196897Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944196897Cleaning up temporary data from old regions at 1675944196909 (+12 ms)Cleaning up detritus from prior splits at 1675944196910 (+1 ms)Running coprocessor post-open hooks at 1675944196914 (+4 ms)Region opened successfully at 1675944196914 2023-02-09 12:03:16,914 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened e9940616385adfef1b4a360461e5f6aa; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66587511, jitterRate=-0.007768765091896057}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 12:03:16,914 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for e9940616385adfef1b4a360461e5f6aa: Running coprocessor pre-open hook at 1675944196902Writing region info on filesystem at 1675944196902Initializing all the Stores at 1675944196902Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944196902Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944196903 (+1 ms)Cleaning up temporary data from old regions at 1675944196910 (+7 ms)Cleaning up detritus from prior splits at 1675944196910Running coprocessor post-open hooks at 1675944196914 (+4 ms)Region opened successfully at 1675944196914 2023-02-09 12:03:16,915 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,q\x11\x10,1675944196408.47f38db786eccf0b6b5d6e2a84049446., pid=21, masterSystemTime=1675944196823 2023-02-09 12:03:16,915 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,aaa,1675944196408.e9940616385adfef1b4a360461e5f6aa., pid=29, masterSystemTime=1675944196828 2023-02-09 12:03:16,916 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,aaa,1675944196408.e9940616385adfef1b4a360461e5f6aa. 2023-02-09 12:03:16,916 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,aaa,1675944196408.e9940616385adfef1b4a360461e5f6aa. 2023-02-09 12:03:16,917 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=e9940616385adfef1b4a360461e5f6aa, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36313,1675944195173 2023-02-09 12:03:16,917 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,aaa,1675944196408.e9940616385adfef1b4a360461e5f6aa.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675944196917"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675944196917"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675944196917"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675944196917"}]},"ts":"1675944196917"} 2023-02-09 12:03:16,917 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,q\x11\x10,1675944196408.47f38db786eccf0b6b5d6e2a84049446. 2023-02-09 12:03:16,917 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,q\x11\x10,1675944196408.47f38db786eccf0b6b5d6e2a84049446. 2023-02-09 12:03:16,917 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=47f38db786eccf0b6b5d6e2a84049446, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36427,1675944195143 2023-02-09 12:03:16,918 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1675944196408.47f38db786eccf0b6b5d6e2a84049446.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675944196917"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675944196917"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675944196917"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675944196917"}]},"ts":"1675944196917"} 2023-02-09 12:03:16,920 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=12 2023-02-09 12:03:16,920 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=12, state=SUCCESS; OpenRegionProcedure e9940616385adfef1b4a360461e5f6aa, server=jenkins-hbase4.apache.org,36313,1675944195173 in 239 msec 2023-02-09 12:03:16,922 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=17 2023-02-09 12:03:16,922 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=17, state=SUCCESS; OpenRegionProcedure 47f38db786eccf0b6b5d6e2a84049446, server=jenkins-hbase4.apache.org,36427,1675944195143 in 248 msec 2023-02-09 12:03:16,922 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e9940616385adfef1b4a360461e5f6aa, ASSIGN in 412 msec 2023-02-09 12:03:16,924 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=10 2023-02-09 12:03:16,924 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=47f38db786eccf0b6b5d6e2a84049446, ASSIGN in 413 msec 2023-02-09 12:03:16,924 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 12:03:16,925 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675944196924"}]},"ts":"1675944196924"} 2023-02-09 12:03:16,926 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLED in hbase:meta 2023-02-09 12:03:16,928 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 12:03:16,930 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceMultiRegion in 520 msec 2023-02-09 12:03:17,016 INFO [Listener at localhost/45917] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:17,016 INFO [Listener at localhost/45917] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:17,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36247] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 12:03:17,018 INFO [Listener at localhost/45917] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 10 completed 2023-02-09 12:03:17,018 DEBUG [Listener at localhost/45917] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceMultiRegion get assigned. Timeout = 60000ms 2023-02-09 12:03:17,018 INFO [Listener at localhost/45917] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-09 12:03:17,020 INFO [Listener at localhost/45917] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceMultiRegion assigned to meta. Checking AM states. 2023-02-09 12:03:17,021 INFO [Listener at localhost/45917] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-09 12:03:17,021 INFO [Listener at localhost/45917] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceMultiRegion assigned. 2023-02-09 12:03:17,021 INFO [Listener at localhost/45917] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-09 12:03:17,057 DEBUG [hconnection-0x34bbc11e-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 12:03:17,068 INFO [RS-EventLoopGroup-13-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36942, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 12:03:17,073 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36313] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1675944196408.e9940616385adfef1b4a360461e5f6aa. 2023-02-09 12:03:17,075 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36427] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,d\x84\x84,1675944196408.63c860f86a4badc3807b95d70675d9f2. 2023-02-09 12:03:17,132 INFO [Listener at localhost/45917] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-09 12:03:17,132 INFO [Listener at localhost/45917] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-09 12:03:17,132 INFO [Listener at localhost/45917] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:17,132 INFO [Listener at localhost/45917] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:17,133 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36247] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-09 12:03:17,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36247] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1675944197133 (current time:1675944197133). 2023-02-09 12:03:17,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36247] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-09 12:03:17,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36247] zookeeper.ReadOnlyZKClient(139): Connect 0x610b5ba7 to 127.0.0.1:62567 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 12:03:17,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36247] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6b9a8d51, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 12:03:17,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36247] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 12:03:17,142 INFO [RS-EventLoopGroup-14-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33660, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 12:03:17,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36247] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x610b5ba7 to 127.0.0.1:62567 2023-02-09 12:03:17,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36247] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 12:03:17,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36247] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-09 12:03:17,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36247] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-09 12:03:17,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36247] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-09 12:03:17,147 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-09 12:03:17,148 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE; timeout=600000, timestamp=1675944797148 2023-02-09 12:03:17,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36247] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-09 12:03:17,148 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion 2023-02-09 12:03:17,150 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-09 12:03:17,150 DEBUG [Listener at localhost/45917] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-09 12:03:17,150 DEBUG [Listener at localhost/45917] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-09 12:03:17,150 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-09 12:03:17,151 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE in 5 msec 2023-02-09 12:03:17,151 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-09 12:03:17,152 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED; timeout=600000, timestamp=1675944797152 2023-02-09 12:03:17,171 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-09 12:03:17,171 INFO [(jenkins-hbase4.apache.org,36247,1675944195090)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-09 12:03:17,171 DEBUG [(jenkins-hbase4.apache.org,36247,1675944195090)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 12:03:17,172 DEBUG [(jenkins-hbase4.apache.org,36247,1675944195090)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-09 12:03:17,172 DEBUG [(jenkins-hbase4.apache.org,36247,1675944195090)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-09 12:03:17,173 DEBUG [(jenkins-hbase4.apache.org,36247,1675944195090)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-09 12:03:17,173 DEBUG [(jenkins-hbase4.apache.org,36247,1675944195090)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-09 12:03:17,174 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): regionserver:36313-0x10038f6ddbf0002, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 12:03:17,174 DEBUG [(jenkins-hbase4.apache.org,36247,1675944195090)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36427,1675944195143 2023-02-09 12:03:17,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 12:03:17,174 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): regionserver:36427-0x10038f6ddbf0001, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 12:03:17,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 12:03:17,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 12:03:17,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 12:03:17,174 DEBUG [(jenkins-hbase4.apache.org,36247,1675944195090)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36427,1675944195143 2023-02-09 12:03:17,174 DEBUG [(jenkins-hbase4.apache.org,36247,1675944195090)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36313,1675944195173 2023-02-09 12:03:17,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-09 12:03:17,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-09 12:03:17,174 DEBUG [(jenkins-hbase4.apache.org,36247,1675944195090)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36313,1675944195173 2023-02-09 12:03:17,175 DEBUG [(jenkins-hbase4.apache.org,36247,1675944195090)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 12:03:17,175 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36313-0x10038f6ddbf0002, quorum=127.0.0.1:62567, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-09 12:03:17,175 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36427-0x10038f6ddbf0001, quorum=127.0.0.1:62567, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-09 12:03:17,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-09 12:03:17,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-09 12:03:17,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-09 12:03:17,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-09 12:03:17,175 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-09 12:03:17,175 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-09 12:03:17,175 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-09 12:03:17,175 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-09 12:03:17,175 DEBUG [member: 'jenkins-hbase4.apache.org,36313,1675944195173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-09 12:03:17,176 DEBUG [member: 'jenkins-hbase4.apache.org,36313,1675944195173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 12:03:17,176 DEBUG [member: 'jenkins-hbase4.apache.org,36427,1675944195143' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-09 12:03:17,178 DEBUG [member: 'jenkins-hbase4.apache.org,36427,1675944195143' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 12:03:17,178 DEBUG [member: 'jenkins-hbase4.apache.org,36313,1675944195173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-09 12:03:17,178 DEBUG [member: 'jenkins-hbase4.apache.org,36313,1675944195173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-09 12:03:17,178 DEBUG [member: 'jenkins-hbase4.apache.org,36427,1675944195143' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-09 12:03:17,178 DEBUG [member: 'jenkins-hbase4.apache.org,36427,1675944195143' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-09 12:03:17,178 DEBUG [member: 'jenkins-hbase4.apache.org,36313,1675944195173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36313,1675944195173' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-09 12:03:17,178 DEBUG [member: 'jenkins-hbase4.apache.org,36427,1675944195143' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36427,1675944195143' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-09 12:03:17,179 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36427,1675944195143 2023-02-09 12:03:17,180 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36313,1675944195173 2023-02-09 12:03:17,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36427,1675944195143 2023-02-09 12:03:17,180 DEBUG [member: 'jenkins-hbase4.apache.org,36313,1675944195173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-09 12:03:17,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 12:03:17,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 12:03:17,180 DEBUG [member: 'jenkins-hbase4.apache.org,36427,1675944195143' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-09 12:03:17,180 DEBUG [member: 'jenkins-hbase4.apache.org,36313,1675944195173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36313-0x10038f6ddbf0002, quorum=127.0.0.1:62567, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-09 12:03:17,180 DEBUG [member: 'jenkins-hbase4.apache.org,36313,1675944195173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 12:03:17,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 12:03:17,180 DEBUG [member: 'jenkins-hbase4.apache.org,36427,1675944195143' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36427-0x10038f6ddbf0001, quorum=127.0.0.1:62567, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-09 12:03:17,180 DEBUG [member: 'jenkins-hbase4.apache.org,36427,1675944195143' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 12:03:17,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 12:03:17,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-09 12:03:17,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36427,1675944195143 2023-02-09 12:03:17,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36313,1675944195173 2023-02-09 12:03:17,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 12:03:17,181 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36427,1675944195143' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-09 12:03:17,182 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1bc946d8[Count = 1] remaining members to acquire global barrier 2023-02-09 12:03:17,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36313,1675944195173 2023-02-09 12:03:17,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 12:03:17,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 12:03:17,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 12:03:17,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 12:03:17,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-09 12:03:17,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36427,1675944195143 2023-02-09 12:03:17,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36313,1675944195173 2023-02-09 12:03:17,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 12:03:17,183 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36313,1675944195173' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-09 12:03:17,183 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1bc946d8[Count = 0] remaining members to acquire global barrier 2023-02-09 12:03:17,183 DEBUG [(jenkins-hbase4.apache.org,36247,1675944195090)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-09 12:03:17,183 DEBUG [(jenkins-hbase4.apache.org,36247,1675944195090)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-09 12:03:17,185 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): regionserver:36313-0x10038f6ddbf0002, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-09 12:03:17,185 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): regionserver:36427-0x10038f6ddbf0001, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-09 12:03:17,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-09 12:03:17,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-09 12:03:17,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-09 12:03:17,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-09 12:03:17,185 DEBUG [member: 'jenkins-hbase4.apache.org,36313,1675944195173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-09 12:03:17,185 DEBUG [member: 'jenkins-hbase4.apache.org,36427,1675944195143' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-09 12:03:17,185 DEBUG [(jenkins-hbase4.apache.org,36247,1675944195090)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36427,1675944195143 2023-02-09 12:03:17,185 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1675944196408.47f38db786eccf0b6b5d6e2a84049446. 2023-02-09 12:03:17,185 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675944196408.c9287bd8c1c12cde6a38f884d6d1fbbb. 2023-02-09 12:03:17,185 DEBUG [(jenkins-hbase4.apache.org,36247,1675944195090)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36313,1675944195173 2023-02-09 12:03:17,185 DEBUG [(jenkins-hbase4.apache.org,36247,1675944195090)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 12:03:17,185 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675944196408.c9287bd8c1c12cde6a38f884d6d1fbbb. started... 2023-02-09 12:03:17,185 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1675944196408.47f38db786eccf0b6b5d6e2a84049446. started... 2023-02-09 12:03:17,187 INFO [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 47f38db786eccf0b6b5d6e2a84049446 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-09 12:03:17,187 INFO [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-0] regionserver.HRegion(2744): Flushing c9287bd8c1c12cde6a38f884d6d1fbbb 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-09 12:03:17,188 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1675944196408.b99c55f7f2e0c44b0df4935d019d297c. 2023-02-09 12:03:17,188 DEBUG [member: 'jenkins-hbase4.apache.org,36427,1675944195143' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-09 12:03:17,188 DEBUG [member: 'jenkins-hbase4.apache.org,36427,1675944195143' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-09 12:03:17,188 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1675944196408.fa5605bcfd9107cd3d59527f4cebc62e. 2023-02-09 12:03:17,188 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1675944196408.b99c55f7f2e0c44b0df4935d019d297c. started... 2023-02-09 12:03:17,188 DEBUG [member: 'jenkins-hbase4.apache.org,36313,1675944195173' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-09 12:03:17,188 DEBUG [member: 'jenkins-hbase4.apache.org,36313,1675944195173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-09 12:03:17,189 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1675944196408.f16214bbc54fdfa480400f03bb3486f8. 2023-02-09 12:03:17,188 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1675944196408.fa5605bcfd9107cd3d59527f4cebc62e. started... 2023-02-09 12:03:17,188 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,,1675944196408.fc93a9dbe44dab8e3d7c7b74ab677eef. 2023-02-09 12:03:17,189 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1675944196408.fc93a9dbe44dab8e3d7c7b74ab677eef. started... 2023-02-09 12:03:17,189 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1675944196408.f16214bbc54fdfa480400f03bb3486f8. started... 2023-02-09 12:03:17,190 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for fc93a9dbe44dab8e3d7c7b74ab677eef: 2023-02-09 12:03:17,189 INFO [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-1] regionserver.HRegion(2744): Flushing b99c55f7f2e0c44b0df4935d019d297c 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-09 12:03:17,191 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for f16214bbc54fdfa480400f03bb3486f8: 2023-02-09 12:03:17,190 INFO [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-1] regionserver.HRegion(2744): Flushing fa5605bcfd9107cd3d59527f4cebc62e 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-09 12:03:17,191 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,,1675944196408.fc93a9dbe44dab8e3d7c7b74ab677eef.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 12:03:17,191 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,zz{,1675944196408.f16214bbc54fdfa480400f03bb3486f8.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 12:03:17,192 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 12:03:17,192 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-09 12:03:17,192 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-09 12:03:17,192 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 12:03:17,193 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-09 12:03:17,193 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-09 12:03:17,225 INFO [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/c9287bd8c1c12cde6a38f884d6d1fbbb/.tmp/f1/f882f9e0a80042a2adb0884d6f9b155b 2023-02-09 12:03:17,232 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1675944196408.f16214bbc54fdfa480400f03bb3486f8. completed. 2023-02-09 12:03:17,232 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1675944196408.f16214bbc54fdfa480400f03bb3486f8. 2023-02-09 12:03:17,232 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,t43,1675944196408.0f9ec56206c8a4a22ea16c5e609aa91e. 2023-02-09 12:03:17,232 DEBUG [member: 'jenkins-hbase4.apache.org,36313,1675944195173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-09 12:03:17,232 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1675944196408.0f9ec56206c8a4a22ea16c5e609aa91e. started... 2023-02-09 12:03:17,233 INFO [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 0f9ec56206c8a4a22ea16c5e609aa91e 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-09 12:03:17,239 INFO [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/fa5605bcfd9107cd3d59527f4cebc62e/.tmp/f1/7e583d31e28e4a1e917a7e4d60c2c99a 2023-02-09 12:03:17,244 INFO [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/47f38db786eccf0b6b5d6e2a84049446/.tmp/f1/9a868e1c73ca48b1b00b08c882a075e5 2023-02-09 12:03:17,248 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1675944196408.fc93a9dbe44dab8e3d7c7b74ab677eef. completed. 2023-02-09 12:03:17,248 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,,1675944196408.fc93a9dbe44dab8e3d7c7b74ab677eef. 2023-02-09 12:03:17,248 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1675944196408.63c860f86a4badc3807b95d70675d9f2. 2023-02-09 12:03:17,248 DEBUG [member: 'jenkins-hbase4.apache.org,36427,1675944195143' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-09 12:03:17,248 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1675944196408.63c860f86a4badc3807b95d70675d9f2. started... 2023-02-09 12:03:17,250 INFO [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 63c860f86a4badc3807b95d70675d9f2 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-09 12:03:17,250 INFO [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/b99c55f7f2e0c44b0df4935d019d297c/.tmp/f1/94cd398824534c0cbe7c23903f2c0000 2023-02-09 12:03:17,250 DEBUG [Listener at localhost/45917] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 12:03:17,250 INFO [Listener at localhost/45917] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:17,250 INFO [Listener at localhost/45917] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:17,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36247] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-09 12:03:17,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36247] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-09 12:03:17,252 DEBUG [Listener at localhost/45917] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-09 12:03:17,273 INFO [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/0f9ec56206c8a4a22ea16c5e609aa91e/.tmp/f1/7745e4e0d53045c8bf7543e500d089ce 2023-02-09 12:03:17,274 INFO [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/c9287bd8c1c12cde6a38f884d6d1fbbb/.tmp/f2/26d95beeb35a4408bb773da53399c110 2023-02-09 12:03:17,304 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/c9287bd8c1c12cde6a38f884d6d1fbbb/.tmp/f1/f882f9e0a80042a2adb0884d6f9b155b as hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/c9287bd8c1c12cde6a38f884d6d1fbbb/f1/f882f9e0a80042a2adb0884d6f9b155b 2023-02-09 12:03:17,309 INFO [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/c9287bd8c1c12cde6a38f884d6d1fbbb/f1/f882f9e0a80042a2adb0884d6f9b155b, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 12:03:17,310 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/c9287bd8c1c12cde6a38f884d6d1fbbb/.tmp/f2/26d95beeb35a4408bb773da53399c110 as hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/c9287bd8c1c12cde6a38f884d6d1fbbb/f2/26d95beeb35a4408bb773da53399c110 2023-02-09 12:03:17,312 INFO [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/fa5605bcfd9107cd3d59527f4cebc62e/.tmp/f2/52439242bcef409e9eba30d4bb0b203f 2023-02-09 12:03:17,313 INFO [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/47f38db786eccf0b6b5d6e2a84049446/.tmp/f2/083e48d50b6b45ecad79c9eea6bb0380 2023-02-09 12:03:17,317 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/fa5605bcfd9107cd3d59527f4cebc62e/.tmp/f1/7e583d31e28e4a1e917a7e4d60c2c99a as hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/fa5605bcfd9107cd3d59527f4cebc62e/f1/7e583d31e28e4a1e917a7e4d60c2c99a 2023-02-09 12:03:17,318 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/47f38db786eccf0b6b5d6e2a84049446/.tmp/f1/9a868e1c73ca48b1b00b08c882a075e5 as hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/47f38db786eccf0b6b5d6e2a84049446/f1/9a868e1c73ca48b1b00b08c882a075e5 2023-02-09 12:03:17,322 INFO [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/47f38db786eccf0b6b5d6e2a84049446/f1/9a868e1c73ca48b1b00b08c882a075e5, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 12:03:17,322 INFO [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/fa5605bcfd9107cd3d59527f4cebc62e/f1/7e583d31e28e4a1e917a7e4d60c2c99a, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 12:03:17,323 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/47f38db786eccf0b6b5d6e2a84049446/.tmp/f2/083e48d50b6b45ecad79c9eea6bb0380 as hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/47f38db786eccf0b6b5d6e2a84049446/f2/083e48d50b6b45ecad79c9eea6bb0380 2023-02-09 12:03:17,323 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/fa5605bcfd9107cd3d59527f4cebc62e/.tmp/f2/52439242bcef409e9eba30d4bb0b203f as hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/fa5605bcfd9107cd3d59527f4cebc62e/f2/52439242bcef409e9eba30d4bb0b203f 2023-02-09 12:03:17,333 INFO [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/c9287bd8c1c12cde6a38f884d6d1fbbb/f2/26d95beeb35a4408bb773da53399c110, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 12:03:17,334 INFO [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for c9287bd8c1c12cde6a38f884d6d1fbbb in 147ms, sequenceid=5, compaction requested=false 2023-02-09 12:03:17,334 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceMultiRegion' 2023-02-09 12:03:17,335 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for c9287bd8c1c12cde6a38f884d6d1fbbb: 2023-02-09 12:03:17,335 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675944196408.c9287bd8c1c12cde6a38f884d6d1fbbb.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 12:03:17,335 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 12:03:17,335 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/c9287bd8c1c12cde6a38f884d6d1fbbb/f1/f882f9e0a80042a2adb0884d6f9b155b] hfiles 2023-02-09 12:03:17,335 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/c9287bd8c1c12cde6a38f884d6d1fbbb/f1/f882f9e0a80042a2adb0884d6f9b155b for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 12:03:17,335 INFO [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/b99c55f7f2e0c44b0df4935d019d297c/.tmp/f2/63f4561ad5ed4c74a59322bdaef7255d 2023-02-09 12:03:17,335 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/c9287bd8c1c12cde6a38f884d6d1fbbb/f2/26d95beeb35a4408bb773da53399c110] hfiles 2023-02-09 12:03:17,336 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/c9287bd8c1c12cde6a38f884d6d1fbbb/f2/26d95beeb35a4408bb773da53399c110 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 12:03:17,336 INFO [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/47f38db786eccf0b6b5d6e2a84049446/f2/083e48d50b6b45ecad79c9eea6bb0380, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 12:03:17,336 INFO [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/0f9ec56206c8a4a22ea16c5e609aa91e/.tmp/f2/fa427154844642f3968726ae9a652297 2023-02-09 12:03:17,337 INFO [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 47f38db786eccf0b6b5d6e2a84049446 in 150ms, sequenceid=5, compaction requested=false 2023-02-09 12:03:17,338 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 47f38db786eccf0b6b5d6e2a84049446: 2023-02-09 12:03:17,339 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,q\x11\x10,1675944196408.47f38db786eccf0b6b5d6e2a84049446.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 12:03:17,339 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 12:03:17,339 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/47f38db786eccf0b6b5d6e2a84049446/f1/9a868e1c73ca48b1b00b08c882a075e5] hfiles 2023-02-09 12:03:17,339 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/47f38db786eccf0b6b5d6e2a84049446/f1/9a868e1c73ca48b1b00b08c882a075e5 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 12:03:17,339 INFO [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/fa5605bcfd9107cd3d59527f4cebc62e/f2/52439242bcef409e9eba30d4bb0b203f, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 12:03:17,339 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/47f38db786eccf0b6b5d6e2a84049446/f2/083e48d50b6b45ecad79c9eea6bb0380] hfiles 2023-02-09 12:03:17,339 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/47f38db786eccf0b6b5d6e2a84049446/f2/083e48d50b6b45ecad79c9eea6bb0380 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 12:03:17,340 INFO [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for fa5605bcfd9107cd3d59527f4cebc62e in 150ms, sequenceid=5, compaction requested=false 2023-02-09 12:03:17,340 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for fa5605bcfd9107cd3d59527f4cebc62e: 2023-02-09 12:03:17,340 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,m\xED\xED,1675944196408.fa5605bcfd9107cd3d59527f4cebc62e.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 12:03:17,340 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 12:03:17,340 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/fa5605bcfd9107cd3d59527f4cebc62e/f1/7e583d31e28e4a1e917a7e4d60c2c99a] hfiles 2023-02-09 12:03:17,340 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/fa5605bcfd9107cd3d59527f4cebc62e/f1/7e583d31e28e4a1e917a7e4d60c2c99a for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 12:03:17,341 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/fa5605bcfd9107cd3d59527f4cebc62e/f2/52439242bcef409e9eba30d4bb0b203f] hfiles 2023-02-09 12:03:17,341 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/fa5605bcfd9107cd3d59527f4cebc62e/f2/52439242bcef409e9eba30d4bb0b203f for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 12:03:17,343 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/b99c55f7f2e0c44b0df4935d019d297c/.tmp/f1/94cd398824534c0cbe7c23903f2c0000 as hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/b99c55f7f2e0c44b0df4935d019d297c/f1/94cd398824534c0cbe7c23903f2c0000 2023-02-09 12:03:17,345 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/0f9ec56206c8a4a22ea16c5e609aa91e/.tmp/f1/7745e4e0d53045c8bf7543e500d089ce as hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/0f9ec56206c8a4a22ea16c5e609aa91e/f1/7745e4e0d53045c8bf7543e500d089ce 2023-02-09 12:03:17,347 INFO [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/b99c55f7f2e0c44b0df4935d019d297c/f1/94cd398824534c0cbe7c23903f2c0000, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-09 12:03:17,348 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/b99c55f7f2e0c44b0df4935d019d297c/.tmp/f2/63f4561ad5ed4c74a59322bdaef7255d as hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/b99c55f7f2e0c44b0df4935d019d297c/f2/63f4561ad5ed4c74a59322bdaef7255d 2023-02-09 12:03:17,351 INFO [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/0f9ec56206c8a4a22ea16c5e609aa91e/f1/7745e4e0d53045c8bf7543e500d089ce, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 12:03:17,352 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/0f9ec56206c8a4a22ea16c5e609aa91e/.tmp/f2/fa427154844642f3968726ae9a652297 as hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/0f9ec56206c8a4a22ea16c5e609aa91e/f2/fa427154844642f3968726ae9a652297 2023-02-09 12:03:17,361 INFO [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/b99c55f7f2e0c44b0df4935d019d297c/f2/63f4561ad5ed4c74a59322bdaef7255d, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-09 12:03:17,362 INFO [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for b99c55f7f2e0c44b0df4935d019d297c in 173ms, sequenceid=5, compaction requested=false 2023-02-09 12:03:17,362 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for b99c55f7f2e0c44b0df4935d019d297c: 2023-02-09 12:03:17,363 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,wWV,1675944196408.b99c55f7f2e0c44b0df4935d019d297c.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 12:03:17,363 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 12:03:17,363 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/b99c55f7f2e0c44b0df4935d019d297c/f1/94cd398824534c0cbe7c23903f2c0000] hfiles 2023-02-09 12:03:17,363 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/b99c55f7f2e0c44b0df4935d019d297c/f1/94cd398824534c0cbe7c23903f2c0000 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 12:03:17,363 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/b99c55f7f2e0c44b0df4935d019d297c/f2/63f4561ad5ed4c74a59322bdaef7255d] hfiles 2023-02-09 12:03:17,363 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/b99c55f7f2e0c44b0df4935d019d297c/f2/63f4561ad5ed4c74a59322bdaef7255d for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 12:03:17,364 INFO [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/0f9ec56206c8a4a22ea16c5e609aa91e/f2/fa427154844642f3968726ae9a652297, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 12:03:17,365 INFO [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 0f9ec56206c8a4a22ea16c5e609aa91e in 132ms, sequenceid=5, compaction requested=false 2023-02-09 12:03:17,365 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 0f9ec56206c8a4a22ea16c5e609aa91e: 2023-02-09 12:03:17,365 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,t43,1675944196408.0f9ec56206c8a4a22ea16c5e609aa91e.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 12:03:17,365 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 12:03:17,365 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/0f9ec56206c8a4a22ea16c5e609aa91e/f1/7745e4e0d53045c8bf7543e500d089ce] hfiles 2023-02-09 12:03:17,365 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/0f9ec56206c8a4a22ea16c5e609aa91e/f1/7745e4e0d53045c8bf7543e500d089ce for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 12:03:17,366 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/0f9ec56206c8a4a22ea16c5e609aa91e/f2/fa427154844642f3968726ae9a652297] hfiles 2023-02-09 12:03:17,366 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/0f9ec56206c8a4a22ea16c5e609aa91e/f2/fa427154844642f3968726ae9a652297 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 12:03:17,372 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675944196408.c9287bd8c1c12cde6a38f884d6d1fbbb. completed. 2023-02-09 12:03:17,372 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675944196408.c9287bd8c1c12cde6a38f884d6d1fbbb. 2023-02-09 12:03:17,372 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1675944196408.e9940616385adfef1b4a360461e5f6aa. 2023-02-09 12:03:17,372 DEBUG [member: 'jenkins-hbase4.apache.org,36313,1675944195173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-09 12:03:17,372 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1675944196408.e9940616385adfef1b4a360461e5f6aa. started... 2023-02-09 12:03:17,378 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1675944196408.fa5605bcfd9107cd3d59527f4cebc62e. completed. 2023-02-09 12:03:17,379 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1675944196408.fa5605bcfd9107cd3d59527f4cebc62e. 2023-02-09 12:03:17,379 DEBUG [member: 'jenkins-hbase4.apache.org,36313,1675944195173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-09 12:03:17,380 INFO [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-0] regionserver.HRegion(2744): Flushing e9940616385adfef1b4a360461e5f6aa 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-09 12:03:17,401 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1675944196408.47f38db786eccf0b6b5d6e2a84049446. completed. 2023-02-09 12:03:17,401 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1675944196408.47f38db786eccf0b6b5d6e2a84049446. 2023-02-09 12:03:17,401 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675944196408.afaa39f80fc4e48681467bdcafa36d2f. 2023-02-09 12:03:17,401 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675944196408.afaa39f80fc4e48681467bdcafa36d2f. started... 2023-02-09 12:03:17,401 DEBUG [member: 'jenkins-hbase4.apache.org,36427,1675944195143' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-09 12:03:17,403 INFO [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-0] regionserver.HRegion(2744): Flushing afaa39f80fc4e48681467bdcafa36d2f 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-09 12:03:17,410 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1675944196408.b99c55f7f2e0c44b0df4935d019d297c. completed. 2023-02-09 12:03:17,410 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1675944196408.b99c55f7f2e0c44b0df4935d019d297c. 2023-02-09 12:03:17,411 DEBUG [member: 'jenkins-hbase4.apache.org,36427,1675944195143' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-09 12:03:17,411 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1675944196408.0f9ec56206c8a4a22ea16c5e609aa91e. completed. 2023-02-09 12:03:17,411 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,t43,1675944196408.0f9ec56206c8a4a22ea16c5e609aa91e. 2023-02-09 12:03:17,411 DEBUG [member: 'jenkins-hbase4.apache.org,36313,1675944195173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-09 12:03:17,414 INFO [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/e9940616385adfef1b4a360461e5f6aa/.tmp/f1/bcdb11218c9f46cf8c299011dd9e4b42 2023-02-09 12:03:17,430 INFO [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/e9940616385adfef1b4a360461e5f6aa/.tmp/f2/0ab74d50238540b885d761b90bf75a42 2023-02-09 12:03:17,435 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/e9940616385adfef1b4a360461e5f6aa/.tmp/f1/bcdb11218c9f46cf8c299011dd9e4b42 as hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/e9940616385adfef1b4a360461e5f6aa/f1/bcdb11218c9f46cf8c299011dd9e4b42 2023-02-09 12:03:17,439 INFO [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/e9940616385adfef1b4a360461e5f6aa/f1/bcdb11218c9f46cf8c299011dd9e4b42, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-09 12:03:17,440 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/e9940616385adfef1b4a360461e5f6aa/.tmp/f2/0ab74d50238540b885d761b90bf75a42 as hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/e9940616385adfef1b4a360461e5f6aa/f2/0ab74d50238540b885d761b90bf75a42 2023-02-09 12:03:17,444 INFO [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/e9940616385adfef1b4a360461e5f6aa/f2/0ab74d50238540b885d761b90bf75a42, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-09 12:03:17,445 INFO [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for e9940616385adfef1b4a360461e5f6aa in 65ms, sequenceid=5, compaction requested=false 2023-02-09 12:03:17,445 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for e9940616385adfef1b4a360461e5f6aa: 2023-02-09 12:03:17,445 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,aaa,1675944196408.e9940616385adfef1b4a360461e5f6aa.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 12:03:17,446 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 12:03:17,446 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/e9940616385adfef1b4a360461e5f6aa/f1/bcdb11218c9f46cf8c299011dd9e4b42] hfiles 2023-02-09 12:03:17,446 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/e9940616385adfef1b4a360461e5f6aa/f1/bcdb11218c9f46cf8c299011dd9e4b42 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 12:03:17,446 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/e9940616385adfef1b4a360461e5f6aa/f2/0ab74d50238540b885d761b90bf75a42] hfiles 2023-02-09 12:03:17,446 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/e9940616385adfef1b4a360461e5f6aa/f2/0ab74d50238540b885d761b90bf75a42 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 12:03:17,452 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1675944196408.e9940616385adfef1b4a360461e5f6aa. completed. 2023-02-09 12:03:17,452 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1675944196408.e9940616385adfef1b4a360461e5f6aa. 2023-02-09 12:03:17,452 DEBUG [member: 'jenkins-hbase4.apache.org,36313,1675944195173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-09 12:03:17,452 DEBUG [member: 'jenkins-hbase4.apache.org,36313,1675944195173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-09 12:03:17,452 DEBUG [member: 'jenkins-hbase4.apache.org,36313,1675944195173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36313,1675944195173 2023-02-09 12:03:17,452 DEBUG [member: 'jenkins-hbase4.apache.org,36313,1675944195173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-09 12:03:17,452 DEBUG [member: 'jenkins-hbase4.apache.org,36313,1675944195173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,36313,1675944195173' in zk 2023-02-09 12:03:17,452 DEBUG [Listener at localhost/45917] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 12:03:17,452 INFO [Listener at localhost/45917] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:17,453 INFO [Listener at localhost/45917] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:17,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36247] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-09 12:03:17,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36247] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-09 12:03:17,454 DEBUG [Listener at localhost/45917] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-09 12:03:17,455 DEBUG [member: 'jenkins-hbase4.apache.org,36313,1675944195173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-09 12:03:17,455 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36313,1675944195173 2023-02-09 12:03:17,455 DEBUG [member: 'jenkins-hbase4.apache.org,36313,1675944195173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 12:03:17,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36313,1675944195173 2023-02-09 12:03:17,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 12:03:17,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 12:03:17,455 DEBUG [member: 'jenkins-hbase4.apache.org,36313,1675944195173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-09 12:03:17,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 12:03:17,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 12:03:17,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-09 12:03:17,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36427,1675944195143 2023-02-09 12:03:17,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36313,1675944195173 2023-02-09 12:03:17,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 12:03:17,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-09 12:03:17,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36313,1675944195173 2023-02-09 12:03:17,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,36313,1675944195173': 2023-02-09 12:03:17,458 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36313,1675944195173' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-09 12:03:17,693 INFO [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/63c860f86a4badc3807b95d70675d9f2/.tmp/f1/49bcf0e4eb2f4cedaf1a96860f156b39 2023-02-09 12:03:17,707 INFO [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/63c860f86a4badc3807b95d70675d9f2/.tmp/f2/bb51a85678c242a391d763a9944f1f4f 2023-02-09 12:03:17,712 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/63c860f86a4badc3807b95d70675d9f2/.tmp/f1/49bcf0e4eb2f4cedaf1a96860f156b39 as hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/63c860f86a4badc3807b95d70675d9f2/f1/49bcf0e4eb2f4cedaf1a96860f156b39 2023-02-09 12:03:17,716 INFO [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/63c860f86a4badc3807b95d70675d9f2/f1/49bcf0e4eb2f4cedaf1a96860f156b39, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 12:03:17,717 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/63c860f86a4badc3807b95d70675d9f2/.tmp/f2/bb51a85678c242a391d763a9944f1f4f as hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/63c860f86a4badc3807b95d70675d9f2/f2/bb51a85678c242a391d763a9944f1f4f 2023-02-09 12:03:17,721 INFO [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/63c860f86a4badc3807b95d70675d9f2/f2/bb51a85678c242a391d763a9944f1f4f, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 12:03:17,722 INFO [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 63c860f86a4badc3807b95d70675d9f2 in 472ms, sequenceid=5, compaction requested=false 2023-02-09 12:03:17,722 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 63c860f86a4badc3807b95d70675d9f2: 2023-02-09 12:03:17,722 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,d\x84\x84,1675944196408.63c860f86a4badc3807b95d70675d9f2.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 12:03:17,722 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 12:03:17,722 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/63c860f86a4badc3807b95d70675d9f2/f1/49bcf0e4eb2f4cedaf1a96860f156b39] hfiles 2023-02-09 12:03:17,722 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/63c860f86a4badc3807b95d70675d9f2/f1/49bcf0e4eb2f4cedaf1a96860f156b39 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 12:03:17,722 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/63c860f86a4badc3807b95d70675d9f2/f2/bb51a85678c242a391d763a9944f1f4f] hfiles 2023-02-09 12:03:17,722 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/63c860f86a4badc3807b95d70675d9f2/f2/bb51a85678c242a391d763a9944f1f4f for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 12:03:17,728 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1675944196408.63c860f86a4badc3807b95d70675d9f2. completed. 2023-02-09 12:03:17,728 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1675944196408.63c860f86a4badc3807b95d70675d9f2. 2023-02-09 12:03:17,728 DEBUG [member: 'jenkins-hbase4.apache.org,36427,1675944195143' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-09 12:03:17,754 DEBUG [Listener at localhost/45917] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 12:03:17,754 INFO [Listener at localhost/45917] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:17,755 INFO [Listener at localhost/45917] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:17,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36247] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-09 12:03:17,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36247] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-09 12:03:17,756 DEBUG [Listener at localhost/45917] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-09 12:03:17,824 INFO [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/afaa39f80fc4e48681467bdcafa36d2f/.tmp/f1/45667bdb0bae410fb9518dfbea89c676 2023-02-09 12:03:17,837 INFO [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/afaa39f80fc4e48681467bdcafa36d2f/.tmp/f2/40dfc38126d2460f857d68fc85e45ce2 2023-02-09 12:03:17,841 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/afaa39f80fc4e48681467bdcafa36d2f/.tmp/f1/45667bdb0bae410fb9518dfbea89c676 as hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/afaa39f80fc4e48681467bdcafa36d2f/f1/45667bdb0bae410fb9518dfbea89c676 2023-02-09 12:03:17,845 INFO [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/afaa39f80fc4e48681467bdcafa36d2f/f1/45667bdb0bae410fb9518dfbea89c676, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 12:03:17,846 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/afaa39f80fc4e48681467bdcafa36d2f/.tmp/f2/40dfc38126d2460f857d68fc85e45ce2 as hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/afaa39f80fc4e48681467bdcafa36d2f/f2/40dfc38126d2460f857d68fc85e45ce2 2023-02-09 12:03:17,850 INFO [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/afaa39f80fc4e48681467bdcafa36d2f/f2/40dfc38126d2460f857d68fc85e45ce2, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 12:03:17,850 INFO [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for afaa39f80fc4e48681467bdcafa36d2f in 448ms, sequenceid=5, compaction requested=false 2023-02-09 12:03:17,851 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for afaa39f80fc4e48681467bdcafa36d2f: 2023-02-09 12:03:17,851 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675944196408.afaa39f80fc4e48681467bdcafa36d2f.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 12:03:17,851 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 12:03:17,851 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/afaa39f80fc4e48681467bdcafa36d2f/f1/45667bdb0bae410fb9518dfbea89c676] hfiles 2023-02-09 12:03:17,851 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/afaa39f80fc4e48681467bdcafa36d2f/f1/45667bdb0bae410fb9518dfbea89c676 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 12:03:17,851 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/afaa39f80fc4e48681467bdcafa36d2f/f2/40dfc38126d2460f857d68fc85e45ce2] hfiles 2023-02-09 12:03:17,851 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/afaa39f80fc4e48681467bdcafa36d2f/f2/40dfc38126d2460f857d68fc85e45ce2 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 12:03:17,856 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675944196408.afaa39f80fc4e48681467bdcafa36d2f. completed. 2023-02-09 12:03:17,857 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675944196408.afaa39f80fc4e48681467bdcafa36d2f. 2023-02-09 12:03:17,857 DEBUG [member: 'jenkins-hbase4.apache.org,36427,1675944195143' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-09 12:03:17,857 DEBUG [member: 'jenkins-hbase4.apache.org,36427,1675944195143' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-09 12:03:17,857 DEBUG [member: 'jenkins-hbase4.apache.org,36427,1675944195143' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36427,1675944195143 2023-02-09 12:03:17,857 DEBUG [member: 'jenkins-hbase4.apache.org,36427,1675944195143' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-09 12:03:17,857 DEBUG [member: 'jenkins-hbase4.apache.org,36427,1675944195143' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,36427,1675944195143' in zk 2023-02-09 12:03:17,858 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36427,1675944195143 2023-02-09 12:03:17,858 DEBUG [member: 'jenkins-hbase4.apache.org,36427,1675944195143' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-09 12:03:17,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36427,1675944195143 2023-02-09 12:03:17,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 12:03:17,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 12:03:17,859 DEBUG [member: 'jenkins-hbase4.apache.org,36427,1675944195143' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 12:03:17,859 DEBUG [member: 'jenkins-hbase4.apache.org,36427,1675944195143' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-09 12:03:17,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 12:03:17,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 12:03:17,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-09 12:03:17,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36427,1675944195143 2023-02-09 12:03:17,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36313,1675944195173 2023-02-09 12:03:17,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 12:03:17,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-09 12:03:17,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36427,1675944195143 2023-02-09 12:03:17,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36313,1675944195173 2023-02-09 12:03:17,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,36427,1675944195143': 2023-02-09 12:03:17,862 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36427,1675944195143' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-09 12:03:17,862 INFO [(jenkins-hbase4.apache.org,36247,1675944195090)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-09 12:03:17,862 DEBUG [(jenkins-hbase4.apache.org,36247,1675944195090)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 12:03:17,862 DEBUG [(jenkins-hbase4.apache.org,36247,1675944195090)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 12:03:17,862 DEBUG [(jenkins-hbase4.apache.org,36247,1675944195090)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-09 12:03:17,862 INFO [(jenkins-hbase4.apache.org,36247,1675944195090)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-09 12:03:17,863 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): regionserver:36427-0x10038f6ddbf0001, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-09 12:03:17,863 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): regionserver:36313-0x10038f6ddbf0002, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-09 12:03:17,863 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-09 12:03:17,863 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): regionserver:36313-0x10038f6ddbf0002, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 12:03:17,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-09 12:03:17,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 12:03:17,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 12:03:17,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-09 12:03:17,863 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): regionserver:36427-0x10038f6ddbf0001, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 12:03:17,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-09 12:03:17,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-09 12:03:17,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-09 12:03:17,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 12:03:17,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 12:03:17,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 12:03:17,864 DEBUG [(jenkins-hbase4.apache.org,36247,1675944195090)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36427,1675944195143 2023-02-09 12:03:17,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 12:03:17,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-09 12:03:17,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 12:03:17,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-09 12:03:17,864 DEBUG [(jenkins-hbase4.apache.org,36247,1675944195090)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36313,1675944195173 2023-02-09 12:03:17,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-09 12:03:17,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 12:03:17,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-09 12:03:17,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36427,1675944195143 2023-02-09 12:03:17,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36313,1675944195173 2023-02-09 12:03:17,866 DEBUG [(jenkins-hbase4.apache.org,36247,1675944195090)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36427,1675944195143 2023-02-09 12:03:17,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 12:03:17,866 DEBUG [(jenkins-hbase4.apache.org,36247,1675944195090)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36313,1675944195173 2023-02-09 12:03:17,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-09 12:03:17,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36427,1675944195143 2023-02-09 12:03:17,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36313,1675944195173 2023-02-09 12:03:17,875 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): regionserver:36427-0x10038f6ddbf0001, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 12:03:17,875 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): regionserver:36313-0x10038f6ddbf0002, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 12:03:17,875 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36313,1675944195173 2023-02-09 12:03:17,875 DEBUG [(jenkins-hbase4.apache.org,36247,1675944195090)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 12:03:17,875 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceMultiRegion 2023-02-09 12:03:17,875 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): regionserver:36427-0x10038f6ddbf0001, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 12:03:17,875 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-09 12:03:17,875 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 12:03:17,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 12:03:17,875 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): regionserver:36313-0x10038f6ddbf0002, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 12:03:17,875 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 12:03:17,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 12:03:17,875 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36427,1675944195143 2023-02-09 12:03:17,875 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceMultiRegion 2023-02-09 12:03:17,876 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-09 12:03:17,876 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36313,1675944195173 2023-02-09 12:03:17,876 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 12:03:17,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 12:03:17,876 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 12:03:17,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 12:03:17,876 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-09 12:03:17,876 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36427,1675944195143 2023-02-09 12:03:17,876 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-09 12:03:17,876 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-09 12:03:17,876 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-09 12:03:17,908 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion to hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.hbase-snapshot/testWithMockedMapReduceMultiRegion 2023-02-09 12:03:17,938 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed 2023-02-09 12:03:17,938 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-09 12:03:17,939 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-09 12:03:17,939 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion at 1675944197148Consolidate snapshot: testWithMockedMapReduceMultiRegion at 1675944197875 (+727 ms)Loading Region manifests for testWithMockedMapReduceMultiRegion at 1675944197876 (+1 ms)Writing data manifest for testWithMockedMapReduceMultiRegion at 1675944197886 (+10 ms)Verifying snapshot: testWithMockedMapReduceMultiRegion at 1675944197895 (+9 ms)Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed at 1675944197938 (+43 ms) 2023-02-09 12:03:17,941 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-09 12:03:17,942 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED in 792 msec 2023-02-09 12:03:18,256 DEBUG [Listener at localhost/45917] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 12:03:18,256 INFO [Listener at localhost/45917] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:18,256 INFO [Listener at localhost/45917] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:18,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36247] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-09 12:03:18,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36247] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-09 12:03:18,258 INFO [Listener at localhost/45917] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-09 12:03:18,258 INFO [Listener at localhost/45917] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:18,258 INFO [Listener at localhost/45917] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:18,262 INFO [Listener at localhost/45917] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-09 12:03:18,268 INFO [Listener at localhost/45917] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-09 12:03:18,297 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36313] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1675944196408.e9940616385adfef1b4a360461e5f6aa. 2023-02-09 12:03:18,297 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36427] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,d\x84\x84,1675944196408.63c860f86a4badc3807b95d70675d9f2. 2023-02-09 12:03:18,356 INFO [Listener at localhost/45917] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-09 12:03:18,359 INFO [Listener at localhost/45917] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:18,359 INFO [Listener at localhost/45917] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:18,361 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36247] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 12:03:18,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36247] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-09 12:03:18,364 INFO [(jenkins-hbase4.apache.org,36247,1675944195090)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-09 12:03:18,364 DEBUG [(jenkins-hbase4.apache.org,36247,1675944195090)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 12:03:18,365 DEBUG [(jenkins-hbase4.apache.org,36247,1675944195090)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-09 12:03:18,365 DEBUG [(jenkins-hbase4.apache.org,36247,1675944195090)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-09 12:03:18,365 DEBUG [(jenkins-hbase4.apache.org,36247,1675944195090)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-09 12:03:18,365 DEBUG [(jenkins-hbase4.apache.org,36247,1675944195090)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-09 12:03:18,366 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): regionserver:36427-0x10038f6ddbf0001, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 12:03:18,366 DEBUG [(jenkins-hbase4.apache.org,36247,1675944195090)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36427,1675944195143 2023-02-09 12:03:18,367 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 12:03:18,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 12:03:18,367 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): regionserver:36313-0x10038f6ddbf0002, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 12:03:18,367 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 12:03:18,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 12:03:18,367 DEBUG [(jenkins-hbase4.apache.org,36247,1675944195090)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36427,1675944195143 2023-02-09 12:03:18,367 DEBUG [(jenkins-hbase4.apache.org,36247,1675944195090)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36313,1675944195173 2023-02-09 12:03:18,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-09 12:03:18,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-09 12:03:18,367 DEBUG [(jenkins-hbase4.apache.org,36247,1675944195090)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36313,1675944195173 2023-02-09 12:03:18,367 DEBUG [(jenkins-hbase4.apache.org,36247,1675944195090)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 12:03:18,367 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36427-0x10038f6ddbf0001, quorum=127.0.0.1:62567, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-09 12:03:18,367 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36313-0x10038f6ddbf0002, quorum=127.0.0.1:62567, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-09 12:03:18,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 12:03:18,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-09 12:03:18,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 12:03:18,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-09 12:03:18,368 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-09 12:03:18,368 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-09 12:03:18,368 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-09 12:03:18,368 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-09 12:03:18,368 DEBUG [member: 'jenkins-hbase4.apache.org,36427,1675944195143' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-09 12:03:18,368 DEBUG [member: 'jenkins-hbase4.apache.org,36427,1675944195143' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 12:03:18,368 DEBUG [member: 'jenkins-hbase4.apache.org,36313,1675944195173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-09 12:03:18,369 DEBUG [member: 'jenkins-hbase4.apache.org,36427,1675944195143' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-09 12:03:18,369 DEBUG [member: 'jenkins-hbase4.apache.org,36313,1675944195173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 12:03:18,370 DEBUG [member: 'jenkins-hbase4.apache.org,36313,1675944195173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-09 12:03:18,370 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1675944196408.47f38db786eccf0b6b5d6e2a84049446. 2023-02-09 12:03:18,370 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,q\x11\x10,1675944196408.47f38db786eccf0b6b5d6e2a84049446. started... 2023-02-09 12:03:18,370 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,wWV,1675944196408.b99c55f7f2e0c44b0df4935d019d297c. 2023-02-09 12:03:18,370 INFO [rs(jenkins-hbase4.apache.org,36427,1675944195143)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 47f38db786eccf0b6b5d6e2a84049446 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-09 12:03:18,370 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,wWV,1675944196408.b99c55f7f2e0c44b0df4935d019d297c. started... 2023-02-09 12:03:18,370 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675944196408.c9287bd8c1c12cde6a38f884d6d1fbbb. 2023-02-09 12:03:18,370 DEBUG [member: 'jenkins-hbase4.apache.org,36427,1675944195143' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-09 12:03:18,370 INFO [rs(jenkins-hbase4.apache.org,36427,1675944195143)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing b99c55f7f2e0c44b0df4935d019d297c 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-09 12:03:18,370 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,,1675944196408.fc93a9dbe44dab8e3d7c7b74ab677eef. 2023-02-09 12:03:18,371 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,,1675944196408.fc93a9dbe44dab8e3d7c7b74ab677eef. started... 2023-02-09 12:03:18,370 DEBUG [member: 'jenkins-hbase4.apache.org,36427,1675944195143' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 12:03:18,370 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675944196408.c9287bd8c1c12cde6a38f884d6d1fbbb. started... 2023-02-09 12:03:18,371 INFO [rs(jenkins-hbase4.apache.org,36313,1675944195173)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing c9287bd8c1c12cde6a38f884d6d1fbbb 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-09 12:03:18,371 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1675944196408.fa5605bcfd9107cd3d59527f4cebc62e. 2023-02-09 12:03:18,372 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,m\xED\xED,1675944196408.fa5605bcfd9107cd3d59527f4cebc62e. started... 2023-02-09 12:03:18,371 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for fc93a9dbe44dab8e3d7c7b74ab677eef: 2023-02-09 12:03:18,371 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,zz{,1675944196408.f16214bbc54fdfa480400f03bb3486f8. 2023-02-09 12:03:18,371 DEBUG [member: 'jenkins-hbase4.apache.org,36313,1675944195173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-09 12:03:18,373 DEBUG [member: 'jenkins-hbase4.apache.org,36313,1675944195173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 12:03:18,373 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,zz{,1675944196408.f16214bbc54fdfa480400f03bb3486f8. started... 2023-02-09 12:03:18,373 INFO [rs(jenkins-hbase4.apache.org,36313,1675944195173)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing fa5605bcfd9107cd3d59527f4cebc62e 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-09 12:03:18,373 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for f16214bbc54fdfa480400f03bb3486f8: 2023-02-09 12:03:18,373 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,zz{,1675944196408.f16214bbc54fdfa480400f03bb3486f8. 2023-02-09 12:03:18,372 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,,1675944196408.fc93a9dbe44dab8e3d7c7b74ab677eef. 2023-02-09 12:03:18,373 DEBUG [member: 'jenkins-hbase4.apache.org,36313,1675944195173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-09 12:03:18,373 DEBUG [member: 'jenkins-hbase4.apache.org,36427,1675944195143' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-09 12:03:18,373 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,t43,1675944196408.0f9ec56206c8a4a22ea16c5e609aa91e. 2023-02-09 12:03:18,373 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,t43,1675944196408.0f9ec56206c8a4a22ea16c5e609aa91e. started... 2023-02-09 12:03:18,373 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1675944196408.63c860f86a4badc3807b95d70675d9f2. 2023-02-09 12:03:18,373 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,d\x84\x84,1675944196408.63c860f86a4badc3807b95d70675d9f2. started... 2023-02-09 12:03:18,373 INFO [rs(jenkins-hbase4.apache.org,36427,1675944195143)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 63c860f86a4badc3807b95d70675d9f2 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-09 12:03:18,373 INFO [rs(jenkins-hbase4.apache.org,36313,1675944195173)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 0f9ec56206c8a4a22ea16c5e609aa91e 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-09 12:03:18,404 INFO [rs(jenkins-hbase4.apache.org,36427,1675944195143)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/b99c55f7f2e0c44b0df4935d019d297c/.tmp/f1/ce72ff2589934ac38e7b916f22a95c85 2023-02-09 12:03:18,409 INFO [rs(jenkins-hbase4.apache.org,36313,1675944195173)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/c9287bd8c1c12cde6a38f884d6d1fbbb/.tmp/f1/2b66780410cf44c2915d3878c4508012 2023-02-09 12:03:18,412 INFO [rs(jenkins-hbase4.apache.org,36313,1675944195173)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/fa5605bcfd9107cd3d59527f4cebc62e/.tmp/f1/987c61d18e724e1db2a84a9e6a904801 2023-02-09 12:03:18,412 INFO [rs(jenkins-hbase4.apache.org,36427,1675944195143)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/47f38db786eccf0b6b5d6e2a84049446/.tmp/f1/e250ef82050641a290816ee9cb8c12ee 2023-02-09 12:03:18,418 INFO [rs(jenkins-hbase4.apache.org,36313,1675944195173)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/0f9ec56206c8a4a22ea16c5e609aa91e/.tmp/f1/c6b7bfc862ed4bbca181f39553232046 2023-02-09 12:03:18,449 INFO [rs(jenkins-hbase4.apache.org,36427,1675944195143)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/b99c55f7f2e0c44b0df4935d019d297c/.tmp/f2/060cf4f6ef4c41ceaf4a88c27e5315f9 2023-02-09 12:03:18,454 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/b99c55f7f2e0c44b0df4935d019d297c/.tmp/f1/ce72ff2589934ac38e7b916f22a95c85 as hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/b99c55f7f2e0c44b0df4935d019d297c/f1/ce72ff2589934ac38e7b916f22a95c85 2023-02-09 12:03:18,459 INFO [rs(jenkins-hbase4.apache.org,36427,1675944195143)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/b99c55f7f2e0c44b0df4935d019d297c/f1/ce72ff2589934ac38e7b916f22a95c85, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-09 12:03:18,460 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/b99c55f7f2e0c44b0df4935d019d297c/.tmp/f2/060cf4f6ef4c41ceaf4a88c27e5315f9 as hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/b99c55f7f2e0c44b0df4935d019d297c/f2/060cf4f6ef4c41ceaf4a88c27e5315f9 2023-02-09 12:03:18,464 INFO [rs(jenkins-hbase4.apache.org,36427,1675944195143)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/b99c55f7f2e0c44b0df4935d019d297c/f2/060cf4f6ef4c41ceaf4a88c27e5315f9, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-09 12:03:18,465 INFO [rs(jenkins-hbase4.apache.org,36427,1675944195143)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for b99c55f7f2e0c44b0df4935d019d297c in 95ms, sequenceid=9, compaction requested=false 2023-02-09 12:03:18,466 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for b99c55f7f2e0c44b0df4935d019d297c: 2023-02-09 12:03:18,466 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,wWV,1675944196408.b99c55f7f2e0c44b0df4935d019d297c. 2023-02-09 12:03:18,466 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675944196408.afaa39f80fc4e48681467bdcafa36d2f. 2023-02-09 12:03:18,466 DEBUG [member: 'jenkins-hbase4.apache.org,36427,1675944195143' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-09 12:03:18,466 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675944196408.afaa39f80fc4e48681467bdcafa36d2f. started... 2023-02-09 12:03:18,466 INFO [rs(jenkins-hbase4.apache.org,36427,1675944195143)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing afaa39f80fc4e48681467bdcafa36d2f 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-09 12:03:18,469 INFO [rs(jenkins-hbase4.apache.org,36427,1675944195143)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/47f38db786eccf0b6b5d6e2a84049446/.tmp/f2/572c04a36d754e8f915f0b3a3764b53f 2023-02-09 12:03:18,469 INFO [rs(jenkins-hbase4.apache.org,36313,1675944195173)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/0f9ec56206c8a4a22ea16c5e609aa91e/.tmp/f2/f9c4ac2febfc4e5b9a43d7db215d27a6 2023-02-09 12:03:18,480 INFO [rs(jenkins-hbase4.apache.org,36313,1675944195173)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/c9287bd8c1c12cde6a38f884d6d1fbbb/.tmp/f2/3beb1a5dc3d248af8e5e46f033f10e80 2023-02-09 12:03:18,481 INFO [rs(jenkins-hbase4.apache.org,36313,1675944195173)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/fa5605bcfd9107cd3d59527f4cebc62e/.tmp/f2/71bc7297758042f89cfaf51eafa90f6c 2023-02-09 12:03:18,483 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/47f38db786eccf0b6b5d6e2a84049446/.tmp/f1/e250ef82050641a290816ee9cb8c12ee as hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/47f38db786eccf0b6b5d6e2a84049446/f1/e250ef82050641a290816ee9cb8c12ee 2023-02-09 12:03:18,485 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/0f9ec56206c8a4a22ea16c5e609aa91e/.tmp/f1/c6b7bfc862ed4bbca181f39553232046 as hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/0f9ec56206c8a4a22ea16c5e609aa91e/f1/c6b7bfc862ed4bbca181f39553232046 2023-02-09 12:03:18,489 INFO [rs(jenkins-hbase4.apache.org,36427,1675944195143)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/afaa39f80fc4e48681467bdcafa36d2f/.tmp/f1/ae246e93eb144c0796619499bb32b656 2023-02-09 12:03:18,490 INFO [rs(jenkins-hbase4.apache.org,36427,1675944195143)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/47f38db786eccf0b6b5d6e2a84049446/f1/e250ef82050641a290816ee9cb8c12ee, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 12:03:18,491 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/47f38db786eccf0b6b5d6e2a84049446/.tmp/f2/572c04a36d754e8f915f0b3a3764b53f as hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/47f38db786eccf0b6b5d6e2a84049446/f2/572c04a36d754e8f915f0b3a3764b53f 2023-02-09 12:03:18,492 INFO [rs(jenkins-hbase4.apache.org,36313,1675944195173)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/0f9ec56206c8a4a22ea16c5e609aa91e/f1/c6b7bfc862ed4bbca181f39553232046, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 12:03:18,494 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/0f9ec56206c8a4a22ea16c5e609aa91e/.tmp/f2/f9c4ac2febfc4e5b9a43d7db215d27a6 as hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/0f9ec56206c8a4a22ea16c5e609aa91e/f2/f9c4ac2febfc4e5b9a43d7db215d27a6 2023-02-09 12:03:18,496 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/fa5605bcfd9107cd3d59527f4cebc62e/.tmp/f1/987c61d18e724e1db2a84a9e6a904801 as hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/fa5605bcfd9107cd3d59527f4cebc62e/f1/987c61d18e724e1db2a84a9e6a904801 2023-02-09 12:03:18,497 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/c9287bd8c1c12cde6a38f884d6d1fbbb/.tmp/f1/2b66780410cf44c2915d3878c4508012 as hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/c9287bd8c1c12cde6a38f884d6d1fbbb/f1/2b66780410cf44c2915d3878c4508012 2023-02-09 12:03:18,498 INFO [rs(jenkins-hbase4.apache.org,36427,1675944195143)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/47f38db786eccf0b6b5d6e2a84049446/f2/572c04a36d754e8f915f0b3a3764b53f, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 12:03:18,500 INFO [rs(jenkins-hbase4.apache.org,36427,1675944195143)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 47f38db786eccf0b6b5d6e2a84049446 in 130ms, sequenceid=9, compaction requested=false 2023-02-09 12:03:18,500 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 47f38db786eccf0b6b5d6e2a84049446: 2023-02-09 12:03:18,500 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1675944196408.47f38db786eccf0b6b5d6e2a84049446. 2023-02-09 12:03:18,501 DEBUG [member: 'jenkins-hbase4.apache.org,36427,1675944195143' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-09 12:03:18,501 INFO [rs(jenkins-hbase4.apache.org,36313,1675944195173)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/0f9ec56206c8a4a22ea16c5e609aa91e/f2/f9c4ac2febfc4e5b9a43d7db215d27a6, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 12:03:18,501 INFO [rs(jenkins-hbase4.apache.org,36313,1675944195173)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/fa5605bcfd9107cd3d59527f4cebc62e/f1/987c61d18e724e1db2a84a9e6a904801, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 12:03:18,501 INFO [rs(jenkins-hbase4.apache.org,36313,1675944195173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/c9287bd8c1c12cde6a38f884d6d1fbbb/f1/2b66780410cf44c2915d3878c4508012, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 12:03:18,501 INFO [rs(jenkins-hbase4.apache.org,36313,1675944195173)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 0f9ec56206c8a4a22ea16c5e609aa91e in 128ms, sequenceid=9, compaction requested=false 2023-02-09 12:03:18,502 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 0f9ec56206c8a4a22ea16c5e609aa91e: 2023-02-09 12:03:18,502 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,t43,1675944196408.0f9ec56206c8a4a22ea16c5e609aa91e. 2023-02-09 12:03:18,502 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/fa5605bcfd9107cd3d59527f4cebc62e/.tmp/f2/71bc7297758042f89cfaf51eafa90f6c as hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/fa5605bcfd9107cd3d59527f4cebc62e/f2/71bc7297758042f89cfaf51eafa90f6c 2023-02-09 12:03:18,502 DEBUG [member: 'jenkins-hbase4.apache.org,36313,1675944195173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-09 12:03:18,502 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,aaa,1675944196408.e9940616385adfef1b4a360461e5f6aa. 2023-02-09 12:03:18,502 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,aaa,1675944196408.e9940616385adfef1b4a360461e5f6aa. started... 2023-02-09 12:03:18,502 INFO [rs(jenkins-hbase4.apache.org,36313,1675944195173)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing e9940616385adfef1b4a360461e5f6aa 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-09 12:03:18,502 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/c9287bd8c1c12cde6a38f884d6d1fbbb/.tmp/f2/3beb1a5dc3d248af8e5e46f033f10e80 as hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/c9287bd8c1c12cde6a38f884d6d1fbbb/f2/3beb1a5dc3d248af8e5e46f033f10e80 2023-02-09 12:03:18,508 INFO [rs(jenkins-hbase4.apache.org,36313,1675944195173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/c9287bd8c1c12cde6a38f884d6d1fbbb/f2/3beb1a5dc3d248af8e5e46f033f10e80, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 12:03:18,508 INFO [rs(jenkins-hbase4.apache.org,36313,1675944195173)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/fa5605bcfd9107cd3d59527f4cebc62e/f2/71bc7297758042f89cfaf51eafa90f6c, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 12:03:18,509 INFO [rs(jenkins-hbase4.apache.org,36313,1675944195173)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for c9287bd8c1c12cde6a38f884d6d1fbbb in 138ms, sequenceid=9, compaction requested=false 2023-02-09 12:03:18,509 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for c9287bd8c1c12cde6a38f884d6d1fbbb: 2023-02-09 12:03:18,509 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675944196408.c9287bd8c1c12cde6a38f884d6d1fbbb. 2023-02-09 12:03:18,509 DEBUG [member: 'jenkins-hbase4.apache.org,36313,1675944195173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-09 12:03:18,509 INFO [rs(jenkins-hbase4.apache.org,36313,1675944195173)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for fa5605bcfd9107cd3d59527f4cebc62e in 137ms, sequenceid=9, compaction requested=false 2023-02-09 12:03:18,509 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for fa5605bcfd9107cd3d59527f4cebc62e: 2023-02-09 12:03:18,509 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1675944196408.fa5605bcfd9107cd3d59527f4cebc62e. 2023-02-09 12:03:18,509 DEBUG [member: 'jenkins-hbase4.apache.org,36313,1675944195173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-09 12:03:18,512 INFO [rs(jenkins-hbase4.apache.org,36427,1675944195143)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/afaa39f80fc4e48681467bdcafa36d2f/.tmp/f2/6e02aeced4fc4f839841173f00e80dd6 2023-02-09 12:03:18,516 INFO [rs(jenkins-hbase4.apache.org,36313,1675944195173)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/e9940616385adfef1b4a360461e5f6aa/.tmp/f1/f140e052de8c49e7b37c74f2a79ceaf0 2023-02-09 12:03:18,517 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/afaa39f80fc4e48681467bdcafa36d2f/.tmp/f1/ae246e93eb144c0796619499bb32b656 as hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/afaa39f80fc4e48681467bdcafa36d2f/f1/ae246e93eb144c0796619499bb32b656 2023-02-09 12:03:18,521 INFO [rs(jenkins-hbase4.apache.org,36427,1675944195143)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/afaa39f80fc4e48681467bdcafa36d2f/f1/ae246e93eb144c0796619499bb32b656, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 12:03:18,522 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/afaa39f80fc4e48681467bdcafa36d2f/.tmp/f2/6e02aeced4fc4f839841173f00e80dd6 as hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/afaa39f80fc4e48681467bdcafa36d2f/f2/6e02aeced4fc4f839841173f00e80dd6 2023-02-09 12:03:18,526 INFO [rs(jenkins-hbase4.apache.org,36427,1675944195143)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/afaa39f80fc4e48681467bdcafa36d2f/f2/6e02aeced4fc4f839841173f00e80dd6, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 12:03:18,526 INFO [rs(jenkins-hbase4.apache.org,36427,1675944195143)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for afaa39f80fc4e48681467bdcafa36d2f in 60ms, sequenceid=9, compaction requested=false 2023-02-09 12:03:18,527 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for afaa39f80fc4e48681467bdcafa36d2f: 2023-02-09 12:03:18,527 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675944196408.afaa39f80fc4e48681467bdcafa36d2f. 2023-02-09 12:03:18,527 DEBUG [member: 'jenkins-hbase4.apache.org,36427,1675944195143' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-09 12:03:18,530 INFO [rs(jenkins-hbase4.apache.org,36313,1675944195173)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/e9940616385adfef1b4a360461e5f6aa/.tmp/f2/d507caa9ec4d419880719935795c2df7 2023-02-09 12:03:18,534 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/e9940616385adfef1b4a360461e5f6aa/.tmp/f1/f140e052de8c49e7b37c74f2a79ceaf0 as hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/e9940616385adfef1b4a360461e5f6aa/f1/f140e052de8c49e7b37c74f2a79ceaf0 2023-02-09 12:03:18,538 INFO [rs(jenkins-hbase4.apache.org,36313,1675944195173)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/e9940616385adfef1b4a360461e5f6aa/f1/f140e052de8c49e7b37c74f2a79ceaf0, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-09 12:03:18,539 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/e9940616385adfef1b4a360461e5f6aa/.tmp/f2/d507caa9ec4d419880719935795c2df7 as hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/e9940616385adfef1b4a360461e5f6aa/f2/d507caa9ec4d419880719935795c2df7 2023-02-09 12:03:18,544 INFO [rs(jenkins-hbase4.apache.org,36313,1675944195173)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/e9940616385adfef1b4a360461e5f6aa/f2/d507caa9ec4d419880719935795c2df7, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-09 12:03:18,544 INFO [rs(jenkins-hbase4.apache.org,36313,1675944195173)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for e9940616385adfef1b4a360461e5f6aa in 42ms, sequenceid=9, compaction requested=false 2023-02-09 12:03:18,544 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for e9940616385adfef1b4a360461e5f6aa: 2023-02-09 12:03:18,544 DEBUG [rs(jenkins-hbase4.apache.org,36313,1675944195173)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,aaa,1675944196408.e9940616385adfef1b4a360461e5f6aa. 2023-02-09 12:03:18,544 DEBUG [member: 'jenkins-hbase4.apache.org,36313,1675944195173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-09 12:03:18,544 DEBUG [member: 'jenkins-hbase4.apache.org,36313,1675944195173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-09 12:03:18,544 DEBUG [member: 'jenkins-hbase4.apache.org,36313,1675944195173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36313,1675944195173 2023-02-09 12:03:18,545 DEBUG [member: 'jenkins-hbase4.apache.org,36313,1675944195173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-09 12:03:18,545 DEBUG [member: 'jenkins-hbase4.apache.org,36313,1675944195173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36313,1675944195173' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-09 12:03:18,546 DEBUG [member: 'jenkins-hbase4.apache.org,36313,1675944195173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-09 12:03:18,546 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36313,1675944195173 2023-02-09 12:03:18,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36313,1675944195173 2023-02-09 12:03:18,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 12:03:18,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 12:03:18,546 DEBUG [member: 'jenkins-hbase4.apache.org,36313,1675944195173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36313-0x10038f6ddbf0002, quorum=127.0.0.1:62567, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-09 12:03:18,546 DEBUG [member: 'jenkins-hbase4.apache.org,36313,1675944195173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 12:03:18,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 12:03:18,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 12:03:18,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-09 12:03:18,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36313,1675944195173 2023-02-09 12:03:18,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 12:03:18,548 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36313,1675944195173' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-09 12:03:18,548 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1ff6d179[Count = 1] remaining members to acquire global barrier 2023-02-09 12:03:18,611 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-09 12:03:18,820 INFO [rs(jenkins-hbase4.apache.org,36427,1675944195143)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/63c860f86a4badc3807b95d70675d9f2/.tmp/f1/bcb108f353b74ee88d5f54a27b08c4ea 2023-02-09 12:03:18,834 INFO [rs(jenkins-hbase4.apache.org,36427,1675944195143)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/63c860f86a4badc3807b95d70675d9f2/.tmp/f2/3a89b2a2855445ea92262d7d26e17039 2023-02-09 12:03:18,839 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/63c860f86a4badc3807b95d70675d9f2/.tmp/f1/bcb108f353b74ee88d5f54a27b08c4ea as hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/63c860f86a4badc3807b95d70675d9f2/f1/bcb108f353b74ee88d5f54a27b08c4ea 2023-02-09 12:03:18,843 INFO [rs(jenkins-hbase4.apache.org,36427,1675944195143)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/63c860f86a4badc3807b95d70675d9f2/f1/bcb108f353b74ee88d5f54a27b08c4ea, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 12:03:18,843 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/63c860f86a4badc3807b95d70675d9f2/.tmp/f2/3a89b2a2855445ea92262d7d26e17039 as hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/63c860f86a4badc3807b95d70675d9f2/f2/3a89b2a2855445ea92262d7d26e17039 2023-02-09 12:03:18,848 INFO [rs(jenkins-hbase4.apache.org,36427,1675944195143)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/63c860f86a4badc3807b95d70675d9f2/f2/3a89b2a2855445ea92262d7d26e17039, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 12:03:18,848 INFO [rs(jenkins-hbase4.apache.org,36427,1675944195143)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 63c860f86a4badc3807b95d70675d9f2 in 475ms, sequenceid=9, compaction requested=false 2023-02-09 12:03:18,849 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 63c860f86a4badc3807b95d70675d9f2: 2023-02-09 12:03:18,849 DEBUG [rs(jenkins-hbase4.apache.org,36427,1675944195143)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1675944196408.63c860f86a4badc3807b95d70675d9f2. 2023-02-09 12:03:18,849 DEBUG [member: 'jenkins-hbase4.apache.org,36427,1675944195143' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-09 12:03:18,849 DEBUG [member: 'jenkins-hbase4.apache.org,36427,1675944195143' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-09 12:03:18,849 DEBUG [member: 'jenkins-hbase4.apache.org,36427,1675944195143' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36427,1675944195143 2023-02-09 12:03:18,849 DEBUG [member: 'jenkins-hbase4.apache.org,36427,1675944195143' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-09 12:03:18,849 DEBUG [member: 'jenkins-hbase4.apache.org,36427,1675944195143' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36427,1675944195143' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-09 12:03:18,850 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36427,1675944195143 2023-02-09 12:03:18,850 DEBUG [member: 'jenkins-hbase4.apache.org,36427,1675944195143' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-09 12:03:18,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36427,1675944195143 2023-02-09 12:03:18,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 12:03:18,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 12:03:18,851 DEBUG [member: 'jenkins-hbase4.apache.org,36427,1675944195143' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36427-0x10038f6ddbf0001, quorum=127.0.0.1:62567, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-09 12:03:18,851 DEBUG [member: 'jenkins-hbase4.apache.org,36427,1675944195143' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 12:03:18,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 12:03:18,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 12:03:18,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-09 12:03:18,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36427,1675944195143 2023-02-09 12:03:18,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36313,1675944195173 2023-02-09 12:03:18,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 12:03:18,852 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36427,1675944195143' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-09 12:03:18,852 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1ff6d179[Count = 0] remaining members to acquire global barrier 2023-02-09 12:03:18,852 DEBUG [(jenkins-hbase4.apache.org,36247,1675944195090)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-09 12:03:18,852 DEBUG [(jenkins-hbase4.apache.org,36247,1675944195090)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-09 12:03:18,854 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): regionserver:36427-0x10038f6ddbf0001, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-09 12:03:18,854 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): regionserver:36313-0x10038f6ddbf0002, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-09 12:03:18,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-09 12:03:18,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-09 12:03:18,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-09 12:03:18,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-09 12:03:18,855 DEBUG [member: 'jenkins-hbase4.apache.org,36427,1675944195143' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-09 12:03:18,855 DEBUG [member: 'jenkins-hbase4.apache.org,36313,1675944195173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-09 12:03:18,855 DEBUG [member: 'jenkins-hbase4.apache.org,36313,1675944195173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-09 12:03:18,855 DEBUG [member: 'jenkins-hbase4.apache.org,36427,1675944195143' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-09 12:03:18,855 DEBUG [member: 'jenkins-hbase4.apache.org,36313,1675944195173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,36313,1675944195173' in zk 2023-02-09 12:03:18,855 DEBUG [member: 'jenkins-hbase4.apache.org,36427,1675944195143' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,36427,1675944195143' in zk 2023-02-09 12:03:18,855 DEBUG [(jenkins-hbase4.apache.org,36247,1675944195090)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36313,1675944195173 2023-02-09 12:03:18,855 DEBUG [(jenkins-hbase4.apache.org,36247,1675944195090)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36427,1675944195143 2023-02-09 12:03:18,855 DEBUG [(jenkins-hbase4.apache.org,36247,1675944195090)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 12:03:18,856 DEBUG [member: 'jenkins-hbase4.apache.org,36427,1675944195143' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-09 12:03:18,856 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36427,1675944195143 2023-02-09 12:03:18,856 DEBUG [member: 'jenkins-hbase4.apache.org,36427,1675944195143' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 12:03:18,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36427,1675944195143 2023-02-09 12:03:18,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 12:03:18,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 12:03:18,856 DEBUG [member: 'jenkins-hbase4.apache.org,36427,1675944195143' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-09 12:03:18,857 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36313,1675944195173 2023-02-09 12:03:18,857 DEBUG [member: 'jenkins-hbase4.apache.org,36313,1675944195173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-09 12:03:18,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 12:03:18,857 DEBUG [member: 'jenkins-hbase4.apache.org,36313,1675944195173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 12:03:18,857 DEBUG [member: 'jenkins-hbase4.apache.org,36313,1675944195173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-09 12:03:18,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 12:03:18,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-09 12:03:18,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36427,1675944195143 2023-02-09 12:03:18,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36313,1675944195173 2023-02-09 12:03:18,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 12:03:18,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-09 12:03:18,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36427,1675944195143 2023-02-09 12:03:18,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36313,1675944195173 2023-02-09 12:03:18,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,36427,1675944195143': 2023-02-09 12:03:18,859 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36427,1675944195143' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-09 12:03:18,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36313,1675944195173 2023-02-09 12:03:18,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 12:03:18,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 12:03:18,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 12:03:18,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 12:03:18,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-09 12:03:18,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36427,1675944195143 2023-02-09 12:03:18,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36313,1675944195173 2023-02-09 12:03:18,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 12:03:18,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-09 12:03:18,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36427,1675944195143 2023-02-09 12:03:18,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36313,1675944195173 2023-02-09 12:03:18,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,36313,1675944195173': 2023-02-09 12:03:18,862 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36313,1675944195173' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-09 12:03:18,862 INFO [(jenkins-hbase4.apache.org,36247,1675944195090)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-09 12:03:18,862 DEBUG [(jenkins-hbase4.apache.org,36247,1675944195090)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 12:03:18,862 DEBUG [(jenkins-hbase4.apache.org,36247,1675944195090)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 12:03:18,862 DEBUG [(jenkins-hbase4.apache.org,36247,1675944195090)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-09 12:03:18,862 INFO [(jenkins-hbase4.apache.org,36247,1675944195090)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 12:03:18,863 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-09 12:03:18,863 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): regionserver:36313-0x10038f6ddbf0002, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-09 12:03:18,863 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): regionserver:36427-0x10038f6ddbf0001, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-09 12:03:18,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-09 12:03:18,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-09 12:03:18,863 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): regionserver:36313-0x10038f6ddbf0002, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 12:03:18,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-09 12:03:18,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-09 12:03:18,863 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): regionserver:36427-0x10038f6ddbf0001, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 12:03:18,864 DEBUG [(jenkins-hbase4.apache.org,36247,1675944195090)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36427,1675944195143 2023-02-09 12:03:18,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 12:03:18,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 12:03:18,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 12:03:18,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 12:03:18,864 DEBUG [(jenkins-hbase4.apache.org,36247,1675944195090)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36313,1675944195173 2023-02-09 12:03:18,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-09 12:03:18,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-09 12:03:18,865 DEBUG [(jenkins-hbase4.apache.org,36247,1675944195090)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36427,1675944195143 2023-02-09 12:03:18,866 DEBUG [(jenkins-hbase4.apache.org,36247,1675944195090)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36313,1675944195173 2023-02-09 12:03:18,869 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): regionserver:36313-0x10038f6ddbf0002, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 12:03:18,869 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): regionserver:36427-0x10038f6ddbf0001, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 12:03:18,869 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36313,1675944195173 2023-02-09 12:03:18,869 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 12:03:18,869 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-09 12:03:18,869 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): regionserver:36427-0x10038f6ddbf0001, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 12:03:18,869 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): regionserver:36313-0x10038f6ddbf0002, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 12:03:18,869 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 12:03:18,869 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36247] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceMultiRegion' 2023-02-09 12:03:18,869 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36247] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 12:03:18,869 DEBUG [(jenkins-hbase4.apache.org,36247,1675944195090)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 12:03:18,869 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36427,1675944195143 2023-02-09 12:03:18,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 12:03:18,869 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-09 12:03:18,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 12:03:18,869 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36313,1675944195173 2023-02-09 12:03:18,870 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-09 12:03:18,870 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36427,1675944195143 2023-02-09 12:03:18,870 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-09 12:03:18,870 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-09 12:03:18,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 12:03:18,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 12:03:18,870 DEBUG [Listener at localhost/45917] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceMultiRegion'' to complete. (max 20000 ms per retry) 2023-02-09 12:03:18,870 DEBUG [Listener at localhost/45917] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 12:03:18,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 12:03:18,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 12:03:18,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-09 12:03:18,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 12:03:18,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 12:03:18,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 12:03:18,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 12:03:18,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 12:03:18,877 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion because node does not exist (not an error) 2023-02-09 12:03:18,970 DEBUG [Listener at localhost/45917] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 12:03:18,970 INFO [Listener at localhost/45917] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:18,970 INFO [Listener at localhost/45917] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:18,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36247] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 12:03:18,976 INFO [Listener at localhost/45917] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1675944197133 type: FLUSH version: 2 ttl: 0 2023-02-09 12:03:18,976 DEBUG [Listener at localhost/45917] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:37789/user/jenkins/test-data/12ba8186-be0f-7e8f-11c9-39faac04ac44/testWithMockedMapReduceMultiRegion/f4926c28-1e41-4d0c-8178-9c3baa5c6e58/data/default/testWithMockedMapReduceMultiRegion 2023-02-09 12:03:18,977 INFO [Listener at localhost/45917] snapshot.RestoreSnapshotHelper(239): region to add: c9287bd8c1c12cde6a38f884d6d1fbbb 2023-02-09 12:03:18,977 INFO [Listener at localhost/45917] snapshot.RestoreSnapshotHelper(239): region to add: fa5605bcfd9107cd3d59527f4cebc62e 2023-02-09 12:03:18,977 INFO [Listener at localhost/45917] snapshot.RestoreSnapshotHelper(239): region to add: 47f38db786eccf0b6b5d6e2a84049446 2023-02-09 12:03:18,977 INFO [Listener at localhost/45917] snapshot.RestoreSnapshotHelper(239): region to add: b99c55f7f2e0c44b0df4935d019d297c 2023-02-09 12:03:18,977 INFO [Listener at localhost/45917] snapshot.RestoreSnapshotHelper(239): region to add: f16214bbc54fdfa480400f03bb3486f8 2023-02-09 12:03:18,977 INFO [Listener at localhost/45917] snapshot.RestoreSnapshotHelper(239): region to add: 0f9ec56206c8a4a22ea16c5e609aa91e 2023-02-09 12:03:18,977 INFO [Listener at localhost/45917] snapshot.RestoreSnapshotHelper(239): region to add: fc93a9dbe44dab8e3d7c7b74ab677eef 2023-02-09 12:03:18,977 INFO [Listener at localhost/45917] snapshot.RestoreSnapshotHelper(239): region to add: 63c860f86a4badc3807b95d70675d9f2 2023-02-09 12:03:18,977 INFO [Listener at localhost/45917] snapshot.RestoreSnapshotHelper(239): region to add: afaa39f80fc4e48681467bdcafa36d2f 2023-02-09 12:03:18,977 INFO [Listener at localhost/45917] snapshot.RestoreSnapshotHelper(239): region to add: e9940616385adfef1b4a360461e5f6aa 2023-02-09 12:03:18,977 INFO [Listener at localhost/45917] snapshot.RestoreSnapshotHelper(585): clone region=c9287bd8c1c12cde6a38f884d6d1fbbb as c9287bd8c1c12cde6a38f884d6d1fbbb in snapshot testWithMockedMapReduceMultiRegion 2023-02-09 12:03:18,977 INFO [Listener at localhost/45917] snapshot.RestoreSnapshotHelper(585): clone region=fa5605bcfd9107cd3d59527f4cebc62e as fa5605bcfd9107cd3d59527f4cebc62e in snapshot testWithMockedMapReduceMultiRegion 2023-02-09 12:03:18,977 INFO [Listener at localhost/45917] snapshot.RestoreSnapshotHelper(585): clone region=47f38db786eccf0b6b5d6e2a84049446 as 47f38db786eccf0b6b5d6e2a84049446 in snapshot testWithMockedMapReduceMultiRegion 2023-02-09 12:03:18,977 INFO [Listener at localhost/45917] snapshot.RestoreSnapshotHelper(585): clone region=b99c55f7f2e0c44b0df4935d019d297c as b99c55f7f2e0c44b0df4935d019d297c in snapshot testWithMockedMapReduceMultiRegion 2023-02-09 12:03:18,977 INFO [Listener at localhost/45917] snapshot.RestoreSnapshotHelper(585): clone region=f16214bbc54fdfa480400f03bb3486f8 as f16214bbc54fdfa480400f03bb3486f8 in snapshot testWithMockedMapReduceMultiRegion 2023-02-09 12:03:18,977 INFO [Listener at localhost/45917] snapshot.RestoreSnapshotHelper(585): clone region=0f9ec56206c8a4a22ea16c5e609aa91e as 0f9ec56206c8a4a22ea16c5e609aa91e in snapshot testWithMockedMapReduceMultiRegion 2023-02-09 12:03:18,977 INFO [Listener at localhost/45917] snapshot.RestoreSnapshotHelper(585): clone region=fc93a9dbe44dab8e3d7c7b74ab677eef as fc93a9dbe44dab8e3d7c7b74ab677eef in snapshot testWithMockedMapReduceMultiRegion 2023-02-09 12:03:18,978 INFO [Listener at localhost/45917] snapshot.RestoreSnapshotHelper(585): clone region=63c860f86a4badc3807b95d70675d9f2 as 63c860f86a4badc3807b95d70675d9f2 in snapshot testWithMockedMapReduceMultiRegion 2023-02-09 12:03:18,978 INFO [Listener at localhost/45917] snapshot.RestoreSnapshotHelper(585): clone region=afaa39f80fc4e48681467bdcafa36d2f as afaa39f80fc4e48681467bdcafa36d2f in snapshot testWithMockedMapReduceMultiRegion 2023-02-09 12:03:18,978 INFO [Listener at localhost/45917] snapshot.RestoreSnapshotHelper(585): clone region=e9940616385adfef1b4a360461e5f6aa as e9940616385adfef1b4a360461e5f6aa in snapshot testWithMockedMapReduceMultiRegion 2023-02-09 12:03:18,979 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => b99c55f7f2e0c44b0df4935d019d297c, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1675944196408.b99c55f7f2e0c44b0df4935d019d297c.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37789/user/jenkins/test-data/12ba8186-be0f-7e8f-11c9-39faac04ac44/testWithMockedMapReduceMultiRegion/f4926c28-1e41-4d0c-8178-9c3baa5c6e58 2023-02-09 12:03:18,979 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => fa5605bcfd9107cd3d59527f4cebc62e, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1675944196408.fa5605bcfd9107cd3d59527f4cebc62e.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37789/user/jenkins/test-data/12ba8186-be0f-7e8f-11c9-39faac04ac44/testWithMockedMapReduceMultiRegion/f4926c28-1e41-4d0c-8178-9c3baa5c6e58 2023-02-09 12:03:18,979 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 47f38db786eccf0b6b5d6e2a84049446, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1675944196408.47f38db786eccf0b6b5d6e2a84049446.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37789/user/jenkins/test-data/12ba8186-be0f-7e8f-11c9-39faac04ac44/testWithMockedMapReduceMultiRegion/f4926c28-1e41-4d0c-8178-9c3baa5c6e58 2023-02-09 12:03:18,980 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 63c860f86a4badc3807b95d70675d9f2, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1675944196408.63c860f86a4badc3807b95d70675d9f2.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37789/user/jenkins/test-data/12ba8186-be0f-7e8f-11c9-39faac04ac44/testWithMockedMapReduceMultiRegion/f4926c28-1e41-4d0c-8178-9c3baa5c6e58 2023-02-09 12:03:18,980 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => fc93a9dbe44dab8e3d7c7b74ab677eef, NAME => 'testWithMockedMapReduceMultiRegion,,1675944196408.fc93a9dbe44dab8e3d7c7b74ab677eef.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37789/user/jenkins/test-data/12ba8186-be0f-7e8f-11c9-39faac04ac44/testWithMockedMapReduceMultiRegion/f4926c28-1e41-4d0c-8178-9c3baa5c6e58 2023-02-09 12:03:18,980 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => f16214bbc54fdfa480400f03bb3486f8, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1675944196408.f16214bbc54fdfa480400f03bb3486f8.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37789/user/jenkins/test-data/12ba8186-be0f-7e8f-11c9-39faac04ac44/testWithMockedMapReduceMultiRegion/f4926c28-1e41-4d0c-8178-9c3baa5c6e58 2023-02-09 12:03:18,980 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => c9287bd8c1c12cde6a38f884d6d1fbbb, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675944196408.c9287bd8c1c12cde6a38f884d6d1fbbb.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37789/user/jenkins/test-data/12ba8186-be0f-7e8f-11c9-39faac04ac44/testWithMockedMapReduceMultiRegion/f4926c28-1e41-4d0c-8178-9c3baa5c6e58 2023-02-09 12:03:18,981 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 0f9ec56206c8a4a22ea16c5e609aa91e, NAME => 'testWithMockedMapReduceMultiRegion,t43,1675944196408.0f9ec56206c8a4a22ea16c5e609aa91e.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37789/user/jenkins/test-data/12ba8186-be0f-7e8f-11c9-39faac04ac44/testWithMockedMapReduceMultiRegion/f4926c28-1e41-4d0c-8178-9c3baa5c6e58 2023-02-09 12:03:19,009 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675944196408.c9287bd8c1c12cde6a38f884d6d1fbbb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:19,009 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f882f9e0a80042a2adb0884d6f9b155b from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-09 12:03:19,017 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1675944196408.47f38db786eccf0b6b5d6e2a84049446.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:19,017 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9a868e1c73ca48b1b00b08c882a075e5 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-09 12:03:19,018 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1675944196408.b99c55f7f2e0c44b0df4935d019d297c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:19,018 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 94cd398824534c0cbe7c23903f2c0000 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-09 12:03:19,018 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 26d95beeb35a4408bb773da53399c110 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-09 12:03:19,024 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 083e48d50b6b45ecad79c9eea6bb0380 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-09 12:03:19,024 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing c9287bd8c1c12cde6a38f884d6d1fbbb, disabling compactions & flushes 2023-02-09 12:03:19,024 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675944196408.c9287bd8c1c12cde6a38f884d6d1fbbb. 2023-02-09 12:03:19,024 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675944196408.c9287bd8c1c12cde6a38f884d6d1fbbb. 2023-02-09 12:03:19,025 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675944196408.c9287bd8c1c12cde6a38f884d6d1fbbb. after waiting 0 ms 2023-02-09 12:03:19,025 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675944196408.c9287bd8c1c12cde6a38f884d6d1fbbb. 2023-02-09 12:03:19,025 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675944196408.c9287bd8c1c12cde6a38f884d6d1fbbb. 2023-02-09 12:03:19,025 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for c9287bd8c1c12cde6a38f884d6d1fbbb: Waiting for close lock at 1675944199024Disabling compacts and flushes for region at 1675944199024Disabling writes for close at 1675944199025 (+1 ms)Writing region close event to WAL at 1675944199025Closed at 1675944199025 2023-02-09 12:03:19,025 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => afaa39f80fc4e48681467bdcafa36d2f, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675944196408.afaa39f80fc4e48681467bdcafa36d2f.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37789/user/jenkins/test-data/12ba8186-be0f-7e8f-11c9-39faac04ac44/testWithMockedMapReduceMultiRegion/f4926c28-1e41-4d0c-8178-9c3baa5c6e58 2023-02-09 12:03:19,036 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1675944196408.fa5605bcfd9107cd3d59527f4cebc62e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:19,037 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 7e583d31e28e4a1e917a7e4d60c2c99a from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-09 12:03:19,037 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 63f4561ad5ed4c74a59322bdaef7255d from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-09 12:03:19,038 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1675944196408.fc93a9dbe44dab8e3d7c7b74ab677eef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:19,038 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 47f38db786eccf0b6b5d6e2a84049446, disabling compactions & flushes 2023-02-09 12:03:19,038 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing fc93a9dbe44dab8e3d7c7b74ab677eef, disabling compactions & flushes 2023-02-09 12:03:19,039 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1675944196408.fc93a9dbe44dab8e3d7c7b74ab677eef. 2023-02-09 12:03:19,039 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1675944196408.fc93a9dbe44dab8e3d7c7b74ab677eef. 2023-02-09 12:03:19,039 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1675944196408.fc93a9dbe44dab8e3d7c7b74ab677eef. after waiting 0 ms 2023-02-09 12:03:19,039 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1675944196408.fc93a9dbe44dab8e3d7c7b74ab677eef. 2023-02-09 12:03:19,039 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1675944196408.fc93a9dbe44dab8e3d7c7b74ab677eef. 2023-02-09 12:03:19,039 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for fc93a9dbe44dab8e3d7c7b74ab677eef: Waiting for close lock at 1675944199038Disabling compacts and flushes for region at 1675944199038Disabling writes for close at 1675944199039 (+1 ms)Writing region close event to WAL at 1675944199039Closed at 1675944199039 2023-02-09 12:03:19,039 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1675944196408.47f38db786eccf0b6b5d6e2a84049446. 2023-02-09 12:03:19,040 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1675944196408.47f38db786eccf0b6b5d6e2a84049446. 2023-02-09 12:03:19,040 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1675944196408.47f38db786eccf0b6b5d6e2a84049446. after waiting 0 ms 2023-02-09 12:03:19,040 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => e9940616385adfef1b4a360461e5f6aa, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1675944196408.e9940616385adfef1b4a360461e5f6aa.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37789/user/jenkins/test-data/12ba8186-be0f-7e8f-11c9-39faac04ac44/testWithMockedMapReduceMultiRegion/f4926c28-1e41-4d0c-8178-9c3baa5c6e58 2023-02-09 12:03:19,040 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1675944196408.63c860f86a4badc3807b95d70675d9f2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:19,040 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1675944196408.47f38db786eccf0b6b5d6e2a84049446. 2023-02-09 12:03:19,040 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 49bcf0e4eb2f4cedaf1a96860f156b39 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-09 12:03:19,040 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1675944196408.47f38db786eccf0b6b5d6e2a84049446. 2023-02-09 12:03:19,040 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 47f38db786eccf0b6b5d6e2a84049446: Waiting for close lock at 1675944199038Disabling compacts and flushes for region at 1675944199038Disabling writes for close at 1675944199040 (+2 ms)Writing region close event to WAL at 1675944199040Closed at 1675944199040 2023-02-09 12:03:19,040 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1675944196408.0f9ec56206c8a4a22ea16c5e609aa91e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:19,040 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 7745e4e0d53045c8bf7543e500d089ce from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-09 12:03:19,041 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1675944196408.f16214bbc54fdfa480400f03bb3486f8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:19,041 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing f16214bbc54fdfa480400f03bb3486f8, disabling compactions & flushes 2023-02-09 12:03:19,041 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1675944196408.f16214bbc54fdfa480400f03bb3486f8. 2023-02-09 12:03:19,041 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1675944196408.f16214bbc54fdfa480400f03bb3486f8. 2023-02-09 12:03:19,041 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1675944196408.f16214bbc54fdfa480400f03bb3486f8. after waiting 0 ms 2023-02-09 12:03:19,041 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1675944196408.f16214bbc54fdfa480400f03bb3486f8. 2023-02-09 12:03:19,041 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1675944196408.f16214bbc54fdfa480400f03bb3486f8. 2023-02-09 12:03:19,041 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for f16214bbc54fdfa480400f03bb3486f8: Waiting for close lock at 1675944199041Disabling compacts and flushes for region at 1675944199041Disabling writes for close at 1675944199041Writing region close event to WAL at 1675944199041Closed at 1675944199041 2023-02-09 12:03:19,045 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing b99c55f7f2e0c44b0df4935d019d297c, disabling compactions & flushes 2023-02-09 12:03:19,045 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1675944196408.b99c55f7f2e0c44b0df4935d019d297c. 2023-02-09 12:03:19,045 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1675944196408.b99c55f7f2e0c44b0df4935d019d297c. 2023-02-09 12:03:19,045 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1675944196408.b99c55f7f2e0c44b0df4935d019d297c. after waiting 0 ms 2023-02-09 12:03:19,045 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 52439242bcef409e9eba30d4bb0b203f from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-09 12:03:19,045 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675944196408.afaa39f80fc4e48681467bdcafa36d2f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:19,045 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1675944196408.b99c55f7f2e0c44b0df4935d019d297c. 2023-02-09 12:03:19,045 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 45667bdb0bae410fb9518dfbea89c676 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-09 12:03:19,045 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1675944196408.b99c55f7f2e0c44b0df4935d019d297c. 2023-02-09 12:03:19,045 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for b99c55f7f2e0c44b0df4935d019d297c: Waiting for close lock at 1675944199045Disabling compacts and flushes for region at 1675944199045Disabling writes for close at 1675944199045Writing region close event to WAL at 1675944199045Closed at 1675944199045 2023-02-09 12:03:19,047 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing fa5605bcfd9107cd3d59527f4cebc62e, disabling compactions & flushes 2023-02-09 12:03:19,047 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1675944196408.fa5605bcfd9107cd3d59527f4cebc62e. 2023-02-09 12:03:19,047 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1675944196408.fa5605bcfd9107cd3d59527f4cebc62e. 2023-02-09 12:03:19,047 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1675944196408.fa5605bcfd9107cd3d59527f4cebc62e. after waiting 0 ms 2023-02-09 12:03:19,047 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1675944196408.fa5605bcfd9107cd3d59527f4cebc62e. 2023-02-09 12:03:19,047 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1675944196408.fa5605bcfd9107cd3d59527f4cebc62e. 2023-02-09 12:03:19,048 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for fa5605bcfd9107cd3d59527f4cebc62e: Waiting for close lock at 1675944199047Disabling compacts and flushes for region at 1675944199047Disabling writes for close at 1675944199047Writing region close event to WAL at 1675944199047Closed at 1675944199047 2023-02-09 12:03:19,048 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink bb51a85678c242a391d763a9944f1f4f from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-09 12:03:19,048 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink fa427154844642f3968726ae9a652297 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-09 12:03:19,048 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 40dfc38126d2460f857d68fc85e45ce2 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-09 12:03:19,052 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 0f9ec56206c8a4a22ea16c5e609aa91e, disabling compactions & flushes 2023-02-09 12:03:19,052 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1675944196408.0f9ec56206c8a4a22ea16c5e609aa91e. 2023-02-09 12:03:19,052 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1675944196408.0f9ec56206c8a4a22ea16c5e609aa91e. 2023-02-09 12:03:19,052 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1675944196408.0f9ec56206c8a4a22ea16c5e609aa91e. after waiting 0 ms 2023-02-09 12:03:19,052 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1675944196408.0f9ec56206c8a4a22ea16c5e609aa91e. 2023-02-09 12:03:19,052 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing afaa39f80fc4e48681467bdcafa36d2f, disabling compactions & flushes 2023-02-09 12:03:19,052 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 63c860f86a4badc3807b95d70675d9f2, disabling compactions & flushes 2023-02-09 12:03:19,052 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1675944196408.0f9ec56206c8a4a22ea16c5e609aa91e. 2023-02-09 12:03:19,052 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1675944196408.63c860f86a4badc3807b95d70675d9f2. 2023-02-09 12:03:19,052 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 0f9ec56206c8a4a22ea16c5e609aa91e: Waiting for close lock at 1675944199052Disabling compacts and flushes for region at 1675944199052Disabling writes for close at 1675944199052Writing region close event to WAL at 1675944199052Closed at 1675944199052 2023-02-09 12:03:19,052 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675944196408.afaa39f80fc4e48681467bdcafa36d2f. 2023-02-09 12:03:19,052 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1675944196408.63c860f86a4badc3807b95d70675d9f2. 2023-02-09 12:03:19,052 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675944196408.afaa39f80fc4e48681467bdcafa36d2f. 2023-02-09 12:03:19,052 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1675944196408.63c860f86a4badc3807b95d70675d9f2. after waiting 0 ms 2023-02-09 12:03:19,052 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1675944196408.63c860f86a4badc3807b95d70675d9f2. 2023-02-09 12:03:19,052 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675944196408.afaa39f80fc4e48681467bdcafa36d2f. after waiting 0 ms 2023-02-09 12:03:19,052 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1675944196408.63c860f86a4badc3807b95d70675d9f2. 2023-02-09 12:03:19,052 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675944196408.afaa39f80fc4e48681467bdcafa36d2f. 2023-02-09 12:03:19,052 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 63c860f86a4badc3807b95d70675d9f2: Waiting for close lock at 1675944199052Disabling compacts and flushes for region at 1675944199052Disabling writes for close at 1675944199052Writing region close event to WAL at 1675944199052Closed at 1675944199052 2023-02-09 12:03:19,052 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675944196408.afaa39f80fc4e48681467bdcafa36d2f. 2023-02-09 12:03:19,052 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for afaa39f80fc4e48681467bdcafa36d2f: Waiting for close lock at 1675944199052Disabling compacts and flushes for region at 1675944199052Disabling writes for close at 1675944199052Writing region close event to WAL at 1675944199052Closed at 1675944199052 2023-02-09 12:03:19,054 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1675944196408.e9940616385adfef1b4a360461e5f6aa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:19,054 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink bcdb11218c9f46cf8c299011dd9e4b42 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-09 12:03:19,055 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 0ab74d50238540b885d761b90bf75a42 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-09 12:03:19,057 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing e9940616385adfef1b4a360461e5f6aa, disabling compactions & flushes 2023-02-09 12:03:19,057 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1675944196408.e9940616385adfef1b4a360461e5f6aa. 2023-02-09 12:03:19,057 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1675944196408.e9940616385adfef1b4a360461e5f6aa. 2023-02-09 12:03:19,057 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1675944196408.e9940616385adfef1b4a360461e5f6aa. after waiting 0 ms 2023-02-09 12:03:19,057 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1675944196408.e9940616385adfef1b4a360461e5f6aa. 2023-02-09 12:03:19,057 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1675944196408.e9940616385adfef1b4a360461e5f6aa. 2023-02-09 12:03:19,057 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for e9940616385adfef1b4a360461e5f6aa: Waiting for close lock at 1675944199057Disabling compacts and flushes for region at 1675944199057Disabling writes for close at 1675944199057Writing region close event to WAL at 1675944199057Closed at 1675944199057 2023-02-09 12:03:19,058 INFO [Listener at localhost/45917] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1675944197133 type: FLUSH version: 2 ttl: 0 2023-02-09 12:03:19,058 DEBUG [Listener at localhost/45917] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:37789/user/jenkins/test-data/12ba8186-be0f-7e8f-11c9-39faac04ac44/testWithMockedMapReduceMultiRegion/f4926c28-1e41-4d0c-8178-9c3baa5c6e58 2023-02-09 12:03:19,058 DEBUG [Listener at localhost/45917] util.CommonFSUtils(682): File system contents for path hdfs://localhost:37789/user/jenkins/test-data/12ba8186-be0f-7e8f-11c9-39faac04ac44/testWithMockedMapReduceMultiRegion/f4926c28-1e41-4d0c-8178-9c3baa5c6e58 2023-02-09 12:03:19,058 DEBUG [Listener at localhost/45917] util.CommonFSUtils(699): |-data/ 2023-02-09 12:03:19,059 DEBUG [Listener at localhost/45917] util.CommonFSUtils(699): |----default/ 2023-02-09 12:03:19,059 DEBUG [Listener at localhost/45917] util.CommonFSUtils(699): |-------testWithMockedMapReduceMultiRegion/ 2023-02-09 12:03:19,059 DEBUG [Listener at localhost/45917] util.CommonFSUtils(699): |----------0f9ec56206c8a4a22ea16c5e609aa91e/ 2023-02-09 12:03:19,060 DEBUG [Listener at localhost/45917] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 12:03:19,060 DEBUG [Listener at localhost/45917] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 12:03:19,060 DEBUG [Listener at localhost/45917] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=0f9ec56206c8a4a22ea16c5e609aa91e-7745e4e0d53045c8bf7543e500d089ce 2023-02-09 12:03:19,060 DEBUG [Listener at localhost/45917] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 12:03:19,060 DEBUG [Listener at localhost/45917] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=0f9ec56206c8a4a22ea16c5e609aa91e-fa427154844642f3968726ae9a652297 2023-02-09 12:03:19,060 DEBUG [Listener at localhost/45917] util.CommonFSUtils(699): |----------47f38db786eccf0b6b5d6e2a84049446/ 2023-02-09 12:03:19,061 DEBUG [Listener at localhost/45917] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 12:03:19,061 DEBUG [Listener at localhost/45917] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 12:03:19,061 DEBUG [Listener at localhost/45917] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=47f38db786eccf0b6b5d6e2a84049446-9a868e1c73ca48b1b00b08c882a075e5 2023-02-09 12:03:19,061 DEBUG [Listener at localhost/45917] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 12:03:19,061 DEBUG [Listener at localhost/45917] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=47f38db786eccf0b6b5d6e2a84049446-083e48d50b6b45ecad79c9eea6bb0380 2023-02-09 12:03:19,061 DEBUG [Listener at localhost/45917] util.CommonFSUtils(699): |----------63c860f86a4badc3807b95d70675d9f2/ 2023-02-09 12:03:19,062 DEBUG [Listener at localhost/45917] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 12:03:19,062 DEBUG [Listener at localhost/45917] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 12:03:19,062 DEBUG [Listener at localhost/45917] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=63c860f86a4badc3807b95d70675d9f2-49bcf0e4eb2f4cedaf1a96860f156b39 2023-02-09 12:03:19,062 DEBUG [Listener at localhost/45917] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 12:03:19,062 DEBUG [Listener at localhost/45917] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=63c860f86a4badc3807b95d70675d9f2-bb51a85678c242a391d763a9944f1f4f 2023-02-09 12:03:19,063 DEBUG [Listener at localhost/45917] util.CommonFSUtils(699): |----------afaa39f80fc4e48681467bdcafa36d2f/ 2023-02-09 12:03:19,063 DEBUG [Listener at localhost/45917] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 12:03:19,063 DEBUG [Listener at localhost/45917] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 12:03:19,063 DEBUG [Listener at localhost/45917] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=afaa39f80fc4e48681467bdcafa36d2f-45667bdb0bae410fb9518dfbea89c676 2023-02-09 12:03:19,063 DEBUG [Listener at localhost/45917] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 12:03:19,063 DEBUG [Listener at localhost/45917] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=afaa39f80fc4e48681467bdcafa36d2f-40dfc38126d2460f857d68fc85e45ce2 2023-02-09 12:03:19,064 DEBUG [Listener at localhost/45917] util.CommonFSUtils(699): |----------b99c55f7f2e0c44b0df4935d019d297c/ 2023-02-09 12:03:19,064 DEBUG [Listener at localhost/45917] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 12:03:19,064 DEBUG [Listener at localhost/45917] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 12:03:19,064 DEBUG [Listener at localhost/45917] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=b99c55f7f2e0c44b0df4935d019d297c-94cd398824534c0cbe7c23903f2c0000 2023-02-09 12:03:19,064 DEBUG [Listener at localhost/45917] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 12:03:19,065 DEBUG [Listener at localhost/45917] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=b99c55f7f2e0c44b0df4935d019d297c-63f4561ad5ed4c74a59322bdaef7255d 2023-02-09 12:03:19,065 DEBUG [Listener at localhost/45917] util.CommonFSUtils(699): |----------c9287bd8c1c12cde6a38f884d6d1fbbb/ 2023-02-09 12:03:19,065 DEBUG [Listener at localhost/45917] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 12:03:19,065 DEBUG [Listener at localhost/45917] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 12:03:19,065 DEBUG [Listener at localhost/45917] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=c9287bd8c1c12cde6a38f884d6d1fbbb-f882f9e0a80042a2adb0884d6f9b155b 2023-02-09 12:03:19,065 DEBUG [Listener at localhost/45917] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 12:03:19,066 DEBUG [Listener at localhost/45917] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=c9287bd8c1c12cde6a38f884d6d1fbbb-26d95beeb35a4408bb773da53399c110 2023-02-09 12:03:19,066 DEBUG [Listener at localhost/45917] util.CommonFSUtils(699): |----------e9940616385adfef1b4a360461e5f6aa/ 2023-02-09 12:03:19,066 DEBUG [Listener at localhost/45917] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 12:03:19,066 DEBUG [Listener at localhost/45917] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 12:03:19,066 DEBUG [Listener at localhost/45917] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=e9940616385adfef1b4a360461e5f6aa-bcdb11218c9f46cf8c299011dd9e4b42 2023-02-09 12:03:19,066 DEBUG [Listener at localhost/45917] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 12:03:19,066 DEBUG [Listener at localhost/45917] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=e9940616385adfef1b4a360461e5f6aa-0ab74d50238540b885d761b90bf75a42 2023-02-09 12:03:19,067 DEBUG [Listener at localhost/45917] util.CommonFSUtils(699): |----------f16214bbc54fdfa480400f03bb3486f8/ 2023-02-09 12:03:19,067 DEBUG [Listener at localhost/45917] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 12:03:19,067 DEBUG [Listener at localhost/45917] util.CommonFSUtils(699): |----------fa5605bcfd9107cd3d59527f4cebc62e/ 2023-02-09 12:03:19,067 DEBUG [Listener at localhost/45917] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 12:03:19,067 DEBUG [Listener at localhost/45917] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 12:03:19,068 DEBUG [Listener at localhost/45917] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=fa5605bcfd9107cd3d59527f4cebc62e-7e583d31e28e4a1e917a7e4d60c2c99a 2023-02-09 12:03:19,068 DEBUG [Listener at localhost/45917] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 12:03:19,068 DEBUG [Listener at localhost/45917] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=fa5605bcfd9107cd3d59527f4cebc62e-52439242bcef409e9eba30d4bb0b203f 2023-02-09 12:03:19,068 DEBUG [Listener at localhost/45917] util.CommonFSUtils(699): |----------fc93a9dbe44dab8e3d7c7b74ab677eef/ 2023-02-09 12:03:19,068 DEBUG [Listener at localhost/45917] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 12:03:19,071 INFO [Listener at localhost/45917] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-09 12:03:19,634 DEBUG [Listener at localhost/45917] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675944196408.afaa39f80fc4e48681467bdcafa36d2f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:19,635 INFO [Listener at localhost/45917] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 12:03:19,636 DEBUG [Listener at localhost/45917] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 12:03:19,638 INFO [StoreOpener-afaa39f80fc4e48681467bdcafa36d2f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region afaa39f80fc4e48681467bdcafa36d2f 2023-02-09 12:03:19,639 DEBUG [StoreOpener-afaa39f80fc4e48681467bdcafa36d2f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37789/user/jenkins/test-data/12ba8186-be0f-7e8f-11c9-39faac04ac44/testWithMockedMapReduceMultiRegion/f4926c28-1e41-4d0c-8178-9c3baa5c6e58/data/default/testWithMockedMapReduceMultiRegion/afaa39f80fc4e48681467bdcafa36d2f/f1 2023-02-09 12:03:19,640 INFO [StoreOpener-afaa39f80fc4e48681467bdcafa36d2f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region afaa39f80fc4e48681467bdcafa36d2f columnFamilyName f1 2023-02-09 12:03:19,644 DEBUG [StoreOpener-afaa39f80fc4e48681467bdcafa36d2f-1] regionserver.HStore(539): loaded hdfs://localhost:37789/user/jenkins/test-data/12ba8186-be0f-7e8f-11c9-39faac04ac44/testWithMockedMapReduceMultiRegion/f4926c28-1e41-4d0c-8178-9c3baa5c6e58/data/default/testWithMockedMapReduceMultiRegion/afaa39f80fc4e48681467bdcafa36d2f/f1/testWithMockedMapReduceMultiRegion=afaa39f80fc4e48681467bdcafa36d2f-45667bdb0bae410fb9518dfbea89c676 2023-02-09 12:03:19,644 INFO [StoreOpener-afaa39f80fc4e48681467bdcafa36d2f-1] regionserver.HStore(310): Store=afaa39f80fc4e48681467bdcafa36d2f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:19,644 INFO [StoreOpener-afaa39f80fc4e48681467bdcafa36d2f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region afaa39f80fc4e48681467bdcafa36d2f 2023-02-09 12:03:19,645 DEBUG [StoreOpener-afaa39f80fc4e48681467bdcafa36d2f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37789/user/jenkins/test-data/12ba8186-be0f-7e8f-11c9-39faac04ac44/testWithMockedMapReduceMultiRegion/f4926c28-1e41-4d0c-8178-9c3baa5c6e58/data/default/testWithMockedMapReduceMultiRegion/afaa39f80fc4e48681467bdcafa36d2f/f2 2023-02-09 12:03:19,645 INFO [StoreOpener-afaa39f80fc4e48681467bdcafa36d2f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region afaa39f80fc4e48681467bdcafa36d2f columnFamilyName f2 2023-02-09 12:03:19,649 DEBUG [StoreOpener-afaa39f80fc4e48681467bdcafa36d2f-1] regionserver.HStore(539): loaded hdfs://localhost:37789/user/jenkins/test-data/12ba8186-be0f-7e8f-11c9-39faac04ac44/testWithMockedMapReduceMultiRegion/f4926c28-1e41-4d0c-8178-9c3baa5c6e58/data/default/testWithMockedMapReduceMultiRegion/afaa39f80fc4e48681467bdcafa36d2f/f2/testWithMockedMapReduceMultiRegion=afaa39f80fc4e48681467bdcafa36d2f-40dfc38126d2460f857d68fc85e45ce2 2023-02-09 12:03:19,649 INFO [StoreOpener-afaa39f80fc4e48681467bdcafa36d2f-1] regionserver.HStore(310): Store=afaa39f80fc4e48681467bdcafa36d2f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:19,649 DEBUG [Listener at localhost/45917] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 12:03:19,649 INFO [Listener at localhost/45917] regionserver.HRegion(1071): Opened afaa39f80fc4e48681467bdcafa36d2f; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68831619, jitterRate=0.02567104995250702}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 12:03:19,649 DEBUG [Listener at localhost/45917] regionserver.HRegion(964): Region open journal for afaa39f80fc4e48681467bdcafa36d2f: Writing region info on filesystem at 1675944199637Initializing all the Stores at 1675944199637Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944199637Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944199638 (+1 ms)Region opened successfully at 1675944199649 (+11 ms) 2023-02-09 12:03:19,661 DEBUG [Listener at localhost/45917] regionserver.HRegion(1603): Closing afaa39f80fc4e48681467bdcafa36d2f, disabling compactions & flushes 2023-02-09 12:03:19,662 INFO [Listener at localhost/45917] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675944196408.afaa39f80fc4e48681467bdcafa36d2f. 2023-02-09 12:03:19,662 DEBUG [Listener at localhost/45917] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675944196408.afaa39f80fc4e48681467bdcafa36d2f. 2023-02-09 12:03:19,663 DEBUG [Listener at localhost/45917] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675944196408.afaa39f80fc4e48681467bdcafa36d2f. after waiting 0 ms 2023-02-09 12:03:19,663 DEBUG [Listener at localhost/45917] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675944196408.afaa39f80fc4e48681467bdcafa36d2f. 2023-02-09 12:03:19,663 INFO [Listener at localhost/45917] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675944196408.afaa39f80fc4e48681467bdcafa36d2f. 2023-02-09 12:03:19,663 DEBUG [Listener at localhost/45917] regionserver.HRegion(1557): Region close journal for afaa39f80fc4e48681467bdcafa36d2f: Waiting for close lock at 1675944199661Disabling compacts and flushes for region at 1675944199661Disabling writes for close at 1675944199663 (+2 ms)Writing region close event to WAL at 1675944199663Closed at 1675944199663 2023-02-09 12:03:19,664 DEBUG [Listener at localhost/45917] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1675944196408.b99c55f7f2e0c44b0df4935d019d297c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:19,664 INFO [Listener at localhost/45917] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 12:03:19,665 DEBUG [Listener at localhost/45917] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 12:03:19,667 INFO [StoreOpener-b99c55f7f2e0c44b0df4935d019d297c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b99c55f7f2e0c44b0df4935d019d297c 2023-02-09 12:03:19,668 DEBUG [StoreOpener-b99c55f7f2e0c44b0df4935d019d297c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37789/user/jenkins/test-data/12ba8186-be0f-7e8f-11c9-39faac04ac44/testWithMockedMapReduceMultiRegion/f4926c28-1e41-4d0c-8178-9c3baa5c6e58/data/default/testWithMockedMapReduceMultiRegion/b99c55f7f2e0c44b0df4935d019d297c/f1 2023-02-09 12:03:19,668 INFO [StoreOpener-b99c55f7f2e0c44b0df4935d019d297c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b99c55f7f2e0c44b0df4935d019d297c columnFamilyName f1 2023-02-09 12:03:19,673 DEBUG [StoreOpener-b99c55f7f2e0c44b0df4935d019d297c-1] regionserver.HStore(539): loaded hdfs://localhost:37789/user/jenkins/test-data/12ba8186-be0f-7e8f-11c9-39faac04ac44/testWithMockedMapReduceMultiRegion/f4926c28-1e41-4d0c-8178-9c3baa5c6e58/data/default/testWithMockedMapReduceMultiRegion/b99c55f7f2e0c44b0df4935d019d297c/f1/testWithMockedMapReduceMultiRegion=b99c55f7f2e0c44b0df4935d019d297c-94cd398824534c0cbe7c23903f2c0000 2023-02-09 12:03:19,673 INFO [StoreOpener-b99c55f7f2e0c44b0df4935d019d297c-1] regionserver.HStore(310): Store=b99c55f7f2e0c44b0df4935d019d297c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:19,673 INFO [StoreOpener-b99c55f7f2e0c44b0df4935d019d297c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b99c55f7f2e0c44b0df4935d019d297c 2023-02-09 12:03:19,674 DEBUG [StoreOpener-b99c55f7f2e0c44b0df4935d019d297c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37789/user/jenkins/test-data/12ba8186-be0f-7e8f-11c9-39faac04ac44/testWithMockedMapReduceMultiRegion/f4926c28-1e41-4d0c-8178-9c3baa5c6e58/data/default/testWithMockedMapReduceMultiRegion/b99c55f7f2e0c44b0df4935d019d297c/f2 2023-02-09 12:03:19,674 INFO [StoreOpener-b99c55f7f2e0c44b0df4935d019d297c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b99c55f7f2e0c44b0df4935d019d297c columnFamilyName f2 2023-02-09 12:03:19,679 DEBUG [StoreOpener-b99c55f7f2e0c44b0df4935d019d297c-1] regionserver.HStore(539): loaded hdfs://localhost:37789/user/jenkins/test-data/12ba8186-be0f-7e8f-11c9-39faac04ac44/testWithMockedMapReduceMultiRegion/f4926c28-1e41-4d0c-8178-9c3baa5c6e58/data/default/testWithMockedMapReduceMultiRegion/b99c55f7f2e0c44b0df4935d019d297c/f2/testWithMockedMapReduceMultiRegion=b99c55f7f2e0c44b0df4935d019d297c-63f4561ad5ed4c74a59322bdaef7255d 2023-02-09 12:03:19,679 INFO [StoreOpener-b99c55f7f2e0c44b0df4935d019d297c-1] regionserver.HStore(310): Store=b99c55f7f2e0c44b0df4935d019d297c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:19,679 DEBUG [Listener at localhost/45917] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 12:03:19,679 INFO [Listener at localhost/45917] regionserver.HRegion(1071): Opened b99c55f7f2e0c44b0df4935d019d297c; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60144089, jitterRate=-0.10378323495388031}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 12:03:19,679 DEBUG [Listener at localhost/45917] regionserver.HRegion(964): Region open journal for b99c55f7f2e0c44b0df4935d019d297c: Writing region info on filesystem at 1675944199665Initializing all the Stores at 1675944199666 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944199666Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944199666Region opened successfully at 1675944199679 (+13 ms) 2023-02-09 12:03:19,689 DEBUG [Listener at localhost/45917] regionserver.HRegion(1603): Closing b99c55f7f2e0c44b0df4935d019d297c, disabling compactions & flushes 2023-02-09 12:03:19,689 INFO [Listener at localhost/45917] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1675944196408.b99c55f7f2e0c44b0df4935d019d297c. 2023-02-09 12:03:19,689 DEBUG [Listener at localhost/45917] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1675944196408.b99c55f7f2e0c44b0df4935d019d297c. 2023-02-09 12:03:19,689 DEBUG [Listener at localhost/45917] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1675944196408.b99c55f7f2e0c44b0df4935d019d297c. after waiting 0 ms 2023-02-09 12:03:19,689 DEBUG [Listener at localhost/45917] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1675944196408.b99c55f7f2e0c44b0df4935d019d297c. 2023-02-09 12:03:19,690 INFO [Listener at localhost/45917] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1675944196408.b99c55f7f2e0c44b0df4935d019d297c. 2023-02-09 12:03:19,690 DEBUG [Listener at localhost/45917] regionserver.HRegion(1557): Region close journal for b99c55f7f2e0c44b0df4935d019d297c: Waiting for close lock at 1675944199689Disabling compacts and flushes for region at 1675944199689Disabling writes for close at 1675944199689Writing region close event to WAL at 1675944199690 (+1 ms)Closed at 1675944199690 2023-02-09 12:03:19,691 DEBUG [Listener at localhost/45917] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675944196408.c9287bd8c1c12cde6a38f884d6d1fbbb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:19,691 INFO [Listener at localhost/45917] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 12:03:19,692 DEBUG [Listener at localhost/45917] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 12:03:19,694 INFO [StoreOpener-c9287bd8c1c12cde6a38f884d6d1fbbb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c9287bd8c1c12cde6a38f884d6d1fbbb 2023-02-09 12:03:19,695 DEBUG [StoreOpener-c9287bd8c1c12cde6a38f884d6d1fbbb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37789/user/jenkins/test-data/12ba8186-be0f-7e8f-11c9-39faac04ac44/testWithMockedMapReduceMultiRegion/f4926c28-1e41-4d0c-8178-9c3baa5c6e58/data/default/testWithMockedMapReduceMultiRegion/c9287bd8c1c12cde6a38f884d6d1fbbb/f1 2023-02-09 12:03:19,695 INFO [StoreOpener-c9287bd8c1c12cde6a38f884d6d1fbbb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c9287bd8c1c12cde6a38f884d6d1fbbb columnFamilyName f1 2023-02-09 12:03:19,699 DEBUG [StoreOpener-c9287bd8c1c12cde6a38f884d6d1fbbb-1] regionserver.HStore(539): loaded hdfs://localhost:37789/user/jenkins/test-data/12ba8186-be0f-7e8f-11c9-39faac04ac44/testWithMockedMapReduceMultiRegion/f4926c28-1e41-4d0c-8178-9c3baa5c6e58/data/default/testWithMockedMapReduceMultiRegion/c9287bd8c1c12cde6a38f884d6d1fbbb/f1/testWithMockedMapReduceMultiRegion=c9287bd8c1c12cde6a38f884d6d1fbbb-f882f9e0a80042a2adb0884d6f9b155b 2023-02-09 12:03:19,699 INFO [StoreOpener-c9287bd8c1c12cde6a38f884d6d1fbbb-1] regionserver.HStore(310): Store=c9287bd8c1c12cde6a38f884d6d1fbbb/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:19,699 INFO [StoreOpener-c9287bd8c1c12cde6a38f884d6d1fbbb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c9287bd8c1c12cde6a38f884d6d1fbbb 2023-02-09 12:03:19,700 DEBUG [StoreOpener-c9287bd8c1c12cde6a38f884d6d1fbbb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37789/user/jenkins/test-data/12ba8186-be0f-7e8f-11c9-39faac04ac44/testWithMockedMapReduceMultiRegion/f4926c28-1e41-4d0c-8178-9c3baa5c6e58/data/default/testWithMockedMapReduceMultiRegion/c9287bd8c1c12cde6a38f884d6d1fbbb/f2 2023-02-09 12:03:19,700 INFO [StoreOpener-c9287bd8c1c12cde6a38f884d6d1fbbb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c9287bd8c1c12cde6a38f884d6d1fbbb columnFamilyName f2 2023-02-09 12:03:19,704 DEBUG [StoreOpener-c9287bd8c1c12cde6a38f884d6d1fbbb-1] regionserver.HStore(539): loaded hdfs://localhost:37789/user/jenkins/test-data/12ba8186-be0f-7e8f-11c9-39faac04ac44/testWithMockedMapReduceMultiRegion/f4926c28-1e41-4d0c-8178-9c3baa5c6e58/data/default/testWithMockedMapReduceMultiRegion/c9287bd8c1c12cde6a38f884d6d1fbbb/f2/testWithMockedMapReduceMultiRegion=c9287bd8c1c12cde6a38f884d6d1fbbb-26d95beeb35a4408bb773da53399c110 2023-02-09 12:03:19,704 INFO [StoreOpener-c9287bd8c1c12cde6a38f884d6d1fbbb-1] regionserver.HStore(310): Store=c9287bd8c1c12cde6a38f884d6d1fbbb/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:19,704 DEBUG [Listener at localhost/45917] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 12:03:19,704 INFO [Listener at localhost/45917] regionserver.HRegion(1071): Opened c9287bd8c1c12cde6a38f884d6d1fbbb; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61484494, jitterRate=-0.08380964398384094}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 12:03:19,704 DEBUG [Listener at localhost/45917] regionserver.HRegion(964): Region open journal for c9287bd8c1c12cde6a38f884d6d1fbbb: Writing region info on filesystem at 1675944199692Initializing all the Stores at 1675944199693 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944199693Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944199693Region opened successfully at 1675944199704 (+11 ms) 2023-02-09 12:03:19,713 DEBUG [Listener at localhost/45917] regionserver.HRegion(1603): Closing c9287bd8c1c12cde6a38f884d6d1fbbb, disabling compactions & flushes 2023-02-09 12:03:19,714 INFO [Listener at localhost/45917] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675944196408.c9287bd8c1c12cde6a38f884d6d1fbbb. 2023-02-09 12:03:19,714 DEBUG [Listener at localhost/45917] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675944196408.c9287bd8c1c12cde6a38f884d6d1fbbb. 2023-02-09 12:03:19,714 DEBUG [Listener at localhost/45917] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675944196408.c9287bd8c1c12cde6a38f884d6d1fbbb. after waiting 0 ms 2023-02-09 12:03:19,714 DEBUG [Listener at localhost/45917] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675944196408.c9287bd8c1c12cde6a38f884d6d1fbbb. 2023-02-09 12:03:19,715 INFO [Listener at localhost/45917] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675944196408.c9287bd8c1c12cde6a38f884d6d1fbbb. 2023-02-09 12:03:19,715 DEBUG [Listener at localhost/45917] regionserver.HRegion(1557): Region close journal for c9287bd8c1c12cde6a38f884d6d1fbbb: Waiting for close lock at 1675944199713Disabling compacts and flushes for region at 1675944199713Disabling writes for close at 1675944199714 (+1 ms)Writing region close event to WAL at 1675944199715 (+1 ms)Closed at 1675944199715 2023-02-09 12:03:19,715 DEBUG [Listener at localhost/45917] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1675944196408.0f9ec56206c8a4a22ea16c5e609aa91e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:19,715 INFO [Listener at localhost/45917] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 12:03:19,717 DEBUG [Listener at localhost/45917] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 12:03:19,721 INFO [StoreOpener-0f9ec56206c8a4a22ea16c5e609aa91e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0f9ec56206c8a4a22ea16c5e609aa91e 2023-02-09 12:03:19,722 DEBUG [StoreOpener-0f9ec56206c8a4a22ea16c5e609aa91e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37789/user/jenkins/test-data/12ba8186-be0f-7e8f-11c9-39faac04ac44/testWithMockedMapReduceMultiRegion/f4926c28-1e41-4d0c-8178-9c3baa5c6e58/data/default/testWithMockedMapReduceMultiRegion/0f9ec56206c8a4a22ea16c5e609aa91e/f1 2023-02-09 12:03:19,723 INFO [StoreOpener-0f9ec56206c8a4a22ea16c5e609aa91e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0f9ec56206c8a4a22ea16c5e609aa91e columnFamilyName f1 2023-02-09 12:03:19,727 DEBUG [StoreOpener-0f9ec56206c8a4a22ea16c5e609aa91e-1] regionserver.HStore(539): loaded hdfs://localhost:37789/user/jenkins/test-data/12ba8186-be0f-7e8f-11c9-39faac04ac44/testWithMockedMapReduceMultiRegion/f4926c28-1e41-4d0c-8178-9c3baa5c6e58/data/default/testWithMockedMapReduceMultiRegion/0f9ec56206c8a4a22ea16c5e609aa91e/f1/testWithMockedMapReduceMultiRegion=0f9ec56206c8a4a22ea16c5e609aa91e-7745e4e0d53045c8bf7543e500d089ce 2023-02-09 12:03:19,728 INFO [StoreOpener-0f9ec56206c8a4a22ea16c5e609aa91e-1] regionserver.HStore(310): Store=0f9ec56206c8a4a22ea16c5e609aa91e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:19,728 INFO [StoreOpener-0f9ec56206c8a4a22ea16c5e609aa91e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0f9ec56206c8a4a22ea16c5e609aa91e 2023-02-09 12:03:19,729 DEBUG [StoreOpener-0f9ec56206c8a4a22ea16c5e609aa91e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37789/user/jenkins/test-data/12ba8186-be0f-7e8f-11c9-39faac04ac44/testWithMockedMapReduceMultiRegion/f4926c28-1e41-4d0c-8178-9c3baa5c6e58/data/default/testWithMockedMapReduceMultiRegion/0f9ec56206c8a4a22ea16c5e609aa91e/f2 2023-02-09 12:03:19,729 INFO [StoreOpener-0f9ec56206c8a4a22ea16c5e609aa91e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0f9ec56206c8a4a22ea16c5e609aa91e columnFamilyName f2 2023-02-09 12:03:19,733 DEBUG [StoreOpener-0f9ec56206c8a4a22ea16c5e609aa91e-1] regionserver.HStore(539): loaded hdfs://localhost:37789/user/jenkins/test-data/12ba8186-be0f-7e8f-11c9-39faac04ac44/testWithMockedMapReduceMultiRegion/f4926c28-1e41-4d0c-8178-9c3baa5c6e58/data/default/testWithMockedMapReduceMultiRegion/0f9ec56206c8a4a22ea16c5e609aa91e/f2/testWithMockedMapReduceMultiRegion=0f9ec56206c8a4a22ea16c5e609aa91e-fa427154844642f3968726ae9a652297 2023-02-09 12:03:19,734 INFO [StoreOpener-0f9ec56206c8a4a22ea16c5e609aa91e-1] regionserver.HStore(310): Store=0f9ec56206c8a4a22ea16c5e609aa91e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:19,734 DEBUG [Listener at localhost/45917] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 12:03:19,734 INFO [Listener at localhost/45917] regionserver.HRegion(1071): Opened 0f9ec56206c8a4a22ea16c5e609aa91e; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73640574, jitterRate=0.09733006358146667}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 12:03:19,734 DEBUG [Listener at localhost/45917] regionserver.HRegion(964): Region open journal for 0f9ec56206c8a4a22ea16c5e609aa91e: Writing region info on filesystem at 1675944199717Initializing all the Stores at 1675944199717Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944199718 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944199721 (+3 ms)Region opened successfully at 1675944199734 (+13 ms) 2023-02-09 12:03:19,747 DEBUG [Listener at localhost/45917] regionserver.HRegion(1603): Closing 0f9ec56206c8a4a22ea16c5e609aa91e, disabling compactions & flushes 2023-02-09 12:03:19,747 INFO [Listener at localhost/45917] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1675944196408.0f9ec56206c8a4a22ea16c5e609aa91e. 2023-02-09 12:03:19,747 DEBUG [Listener at localhost/45917] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1675944196408.0f9ec56206c8a4a22ea16c5e609aa91e. 2023-02-09 12:03:19,747 DEBUG [Listener at localhost/45917] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1675944196408.0f9ec56206c8a4a22ea16c5e609aa91e. after waiting 0 ms 2023-02-09 12:03:19,747 DEBUG [Listener at localhost/45917] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1675944196408.0f9ec56206c8a4a22ea16c5e609aa91e. 2023-02-09 12:03:19,752 INFO [Listener at localhost/45917] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1675944196408.0f9ec56206c8a4a22ea16c5e609aa91e. 2023-02-09 12:03:19,752 DEBUG [Listener at localhost/45917] regionserver.HRegion(1557): Region close journal for 0f9ec56206c8a4a22ea16c5e609aa91e: Waiting for close lock at 1675944199747Disabling compacts and flushes for region at 1675944199747Disabling writes for close at 1675944199747Writing region close event to WAL at 1675944199752 (+5 ms)Closed at 1675944199752 2023-02-09 12:03:19,753 DEBUG [Listener at localhost/45917] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1675944196408.fc93a9dbe44dab8e3d7c7b74ab677eef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:19,753 INFO [Listener at localhost/45917] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 12:03:19,754 DEBUG [Listener at localhost/45917] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 12:03:19,756 INFO [StoreOpener-fc93a9dbe44dab8e3d7c7b74ab677eef-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region fc93a9dbe44dab8e3d7c7b74ab677eef 2023-02-09 12:03:19,758 DEBUG [StoreOpener-fc93a9dbe44dab8e3d7c7b74ab677eef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37789/user/jenkins/test-data/12ba8186-be0f-7e8f-11c9-39faac04ac44/testWithMockedMapReduceMultiRegion/f4926c28-1e41-4d0c-8178-9c3baa5c6e58/data/default/testWithMockedMapReduceMultiRegion/fc93a9dbe44dab8e3d7c7b74ab677eef/f1 2023-02-09 12:03:19,758 INFO [StoreOpener-fc93a9dbe44dab8e3d7c7b74ab677eef-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fc93a9dbe44dab8e3d7c7b74ab677eef columnFamilyName f1 2023-02-09 12:03:19,758 INFO [StoreOpener-fc93a9dbe44dab8e3d7c7b74ab677eef-1] regionserver.HStore(310): Store=fc93a9dbe44dab8e3d7c7b74ab677eef/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:19,759 INFO [StoreOpener-fc93a9dbe44dab8e3d7c7b74ab677eef-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region fc93a9dbe44dab8e3d7c7b74ab677eef 2023-02-09 12:03:19,760 DEBUG [StoreOpener-fc93a9dbe44dab8e3d7c7b74ab677eef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37789/user/jenkins/test-data/12ba8186-be0f-7e8f-11c9-39faac04ac44/testWithMockedMapReduceMultiRegion/f4926c28-1e41-4d0c-8178-9c3baa5c6e58/data/default/testWithMockedMapReduceMultiRegion/fc93a9dbe44dab8e3d7c7b74ab677eef/f2 2023-02-09 12:03:19,760 INFO [StoreOpener-fc93a9dbe44dab8e3d7c7b74ab677eef-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fc93a9dbe44dab8e3d7c7b74ab677eef columnFamilyName f2 2023-02-09 12:03:19,760 INFO [StoreOpener-fc93a9dbe44dab8e3d7c7b74ab677eef-1] regionserver.HStore(310): Store=fc93a9dbe44dab8e3d7c7b74ab677eef/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:19,761 DEBUG [Listener at localhost/45917] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 12:03:19,761 INFO [Listener at localhost/45917] regionserver.HRegion(1071): Opened fc93a9dbe44dab8e3d7c7b74ab677eef; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62018572, jitterRate=-0.07585126161575317}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 12:03:19,761 DEBUG [Listener at localhost/45917] regionserver.HRegion(964): Region open journal for fc93a9dbe44dab8e3d7c7b74ab677eef: Writing region info on filesystem at 1675944199754Initializing all the Stores at 1675944199755 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944199755Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944199755Region opened successfully at 1675944199761 (+6 ms) 2023-02-09 12:03:19,761 DEBUG [Listener at localhost/45917] regionserver.HRegion(1603): Closing fc93a9dbe44dab8e3d7c7b74ab677eef, disabling compactions & flushes 2023-02-09 12:03:19,761 INFO [Listener at localhost/45917] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1675944196408.fc93a9dbe44dab8e3d7c7b74ab677eef. 2023-02-09 12:03:19,761 DEBUG [Listener at localhost/45917] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1675944196408.fc93a9dbe44dab8e3d7c7b74ab677eef. 2023-02-09 12:03:19,761 DEBUG [Listener at localhost/45917] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1675944196408.fc93a9dbe44dab8e3d7c7b74ab677eef. after waiting 0 ms 2023-02-09 12:03:19,761 DEBUG [Listener at localhost/45917] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1675944196408.fc93a9dbe44dab8e3d7c7b74ab677eef. 2023-02-09 12:03:19,762 INFO [Listener at localhost/45917] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1675944196408.fc93a9dbe44dab8e3d7c7b74ab677eef. 2023-02-09 12:03:19,762 DEBUG [Listener at localhost/45917] regionserver.HRegion(1557): Region close journal for fc93a9dbe44dab8e3d7c7b74ab677eef: Waiting for close lock at 1675944199761Disabling compacts and flushes for region at 1675944199761Disabling writes for close at 1675944199761Writing region close event to WAL at 1675944199762 (+1 ms)Closed at 1675944199762 2023-02-09 12:03:19,762 DEBUG [Listener at localhost/45917] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1675944196408.f16214bbc54fdfa480400f03bb3486f8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:19,762 INFO [Listener at localhost/45917] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 12:03:19,764 DEBUG [Listener at localhost/45917] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 12:03:19,766 INFO [StoreOpener-f16214bbc54fdfa480400f03bb3486f8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f16214bbc54fdfa480400f03bb3486f8 2023-02-09 12:03:19,767 DEBUG [StoreOpener-f16214bbc54fdfa480400f03bb3486f8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37789/user/jenkins/test-data/12ba8186-be0f-7e8f-11c9-39faac04ac44/testWithMockedMapReduceMultiRegion/f4926c28-1e41-4d0c-8178-9c3baa5c6e58/data/default/testWithMockedMapReduceMultiRegion/f16214bbc54fdfa480400f03bb3486f8/f1 2023-02-09 12:03:19,767 INFO [StoreOpener-f16214bbc54fdfa480400f03bb3486f8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f16214bbc54fdfa480400f03bb3486f8 columnFamilyName f1 2023-02-09 12:03:19,768 INFO [StoreOpener-f16214bbc54fdfa480400f03bb3486f8-1] regionserver.HStore(310): Store=f16214bbc54fdfa480400f03bb3486f8/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:19,768 INFO [StoreOpener-f16214bbc54fdfa480400f03bb3486f8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f16214bbc54fdfa480400f03bb3486f8 2023-02-09 12:03:19,769 DEBUG [StoreOpener-f16214bbc54fdfa480400f03bb3486f8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37789/user/jenkins/test-data/12ba8186-be0f-7e8f-11c9-39faac04ac44/testWithMockedMapReduceMultiRegion/f4926c28-1e41-4d0c-8178-9c3baa5c6e58/data/default/testWithMockedMapReduceMultiRegion/f16214bbc54fdfa480400f03bb3486f8/f2 2023-02-09 12:03:19,769 INFO [StoreOpener-f16214bbc54fdfa480400f03bb3486f8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f16214bbc54fdfa480400f03bb3486f8 columnFamilyName f2 2023-02-09 12:03:19,770 INFO [StoreOpener-f16214bbc54fdfa480400f03bb3486f8-1] regionserver.HStore(310): Store=f16214bbc54fdfa480400f03bb3486f8/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:19,770 DEBUG [Listener at localhost/45917] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 12:03:19,770 INFO [Listener at localhost/45917] regionserver.HRegion(1071): Opened f16214bbc54fdfa480400f03bb3486f8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59905817, jitterRate=-0.10733376443386078}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 12:03:19,770 DEBUG [Listener at localhost/45917] regionserver.HRegion(964): Region open journal for f16214bbc54fdfa480400f03bb3486f8: Writing region info on filesystem at 1675944199764Initializing all the Stores at 1675944199765 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944199765Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944199765Region opened successfully at 1675944199770 (+5 ms) 2023-02-09 12:03:19,770 DEBUG [Listener at localhost/45917] regionserver.HRegion(1603): Closing f16214bbc54fdfa480400f03bb3486f8, disabling compactions & flushes 2023-02-09 12:03:19,770 INFO [Listener at localhost/45917] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1675944196408.f16214bbc54fdfa480400f03bb3486f8. 2023-02-09 12:03:19,770 DEBUG [Listener at localhost/45917] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1675944196408.f16214bbc54fdfa480400f03bb3486f8. 2023-02-09 12:03:19,770 DEBUG [Listener at localhost/45917] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1675944196408.f16214bbc54fdfa480400f03bb3486f8. after waiting 0 ms 2023-02-09 12:03:19,770 DEBUG [Listener at localhost/45917] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1675944196408.f16214bbc54fdfa480400f03bb3486f8. 2023-02-09 12:03:19,771 INFO [Listener at localhost/45917] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1675944196408.f16214bbc54fdfa480400f03bb3486f8. 2023-02-09 12:03:19,771 DEBUG [Listener at localhost/45917] regionserver.HRegion(1557): Region close journal for f16214bbc54fdfa480400f03bb3486f8: Waiting for close lock at 1675944199770Disabling compacts and flushes for region at 1675944199770Disabling writes for close at 1675944199770Writing region close event to WAL at 1675944199771 (+1 ms)Closed at 1675944199771 2023-02-09 12:03:19,771 DEBUG [Listener at localhost/45917] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1675944196408.fa5605bcfd9107cd3d59527f4cebc62e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:19,771 INFO [Listener at localhost/45917] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 12:03:19,772 DEBUG [Listener at localhost/45917] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 12:03:19,777 INFO [StoreOpener-fa5605bcfd9107cd3d59527f4cebc62e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region fa5605bcfd9107cd3d59527f4cebc62e 2023-02-09 12:03:19,777 DEBUG [StoreOpener-fa5605bcfd9107cd3d59527f4cebc62e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37789/user/jenkins/test-data/12ba8186-be0f-7e8f-11c9-39faac04ac44/testWithMockedMapReduceMultiRegion/f4926c28-1e41-4d0c-8178-9c3baa5c6e58/data/default/testWithMockedMapReduceMultiRegion/fa5605bcfd9107cd3d59527f4cebc62e/f1 2023-02-09 12:03:19,778 INFO [StoreOpener-fa5605bcfd9107cd3d59527f4cebc62e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fa5605bcfd9107cd3d59527f4cebc62e columnFamilyName f1 2023-02-09 12:03:19,782 DEBUG [StoreOpener-fa5605bcfd9107cd3d59527f4cebc62e-1] regionserver.HStore(539): loaded hdfs://localhost:37789/user/jenkins/test-data/12ba8186-be0f-7e8f-11c9-39faac04ac44/testWithMockedMapReduceMultiRegion/f4926c28-1e41-4d0c-8178-9c3baa5c6e58/data/default/testWithMockedMapReduceMultiRegion/fa5605bcfd9107cd3d59527f4cebc62e/f1/testWithMockedMapReduceMultiRegion=fa5605bcfd9107cd3d59527f4cebc62e-7e583d31e28e4a1e917a7e4d60c2c99a 2023-02-09 12:03:19,782 INFO [StoreOpener-fa5605bcfd9107cd3d59527f4cebc62e-1] regionserver.HStore(310): Store=fa5605bcfd9107cd3d59527f4cebc62e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:19,782 INFO [StoreOpener-fa5605bcfd9107cd3d59527f4cebc62e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region fa5605bcfd9107cd3d59527f4cebc62e 2023-02-09 12:03:19,783 DEBUG [StoreOpener-fa5605bcfd9107cd3d59527f4cebc62e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37789/user/jenkins/test-data/12ba8186-be0f-7e8f-11c9-39faac04ac44/testWithMockedMapReduceMultiRegion/f4926c28-1e41-4d0c-8178-9c3baa5c6e58/data/default/testWithMockedMapReduceMultiRegion/fa5605bcfd9107cd3d59527f4cebc62e/f2 2023-02-09 12:03:19,783 INFO [StoreOpener-fa5605bcfd9107cd3d59527f4cebc62e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fa5605bcfd9107cd3d59527f4cebc62e columnFamilyName f2 2023-02-09 12:03:19,787 DEBUG [StoreOpener-fa5605bcfd9107cd3d59527f4cebc62e-1] regionserver.HStore(539): loaded hdfs://localhost:37789/user/jenkins/test-data/12ba8186-be0f-7e8f-11c9-39faac04ac44/testWithMockedMapReduceMultiRegion/f4926c28-1e41-4d0c-8178-9c3baa5c6e58/data/default/testWithMockedMapReduceMultiRegion/fa5605bcfd9107cd3d59527f4cebc62e/f2/testWithMockedMapReduceMultiRegion=fa5605bcfd9107cd3d59527f4cebc62e-52439242bcef409e9eba30d4bb0b203f 2023-02-09 12:03:19,788 INFO [StoreOpener-fa5605bcfd9107cd3d59527f4cebc62e-1] regionserver.HStore(310): Store=fa5605bcfd9107cd3d59527f4cebc62e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:19,788 DEBUG [Listener at localhost/45917] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 12:03:19,788 INFO [Listener at localhost/45917] regionserver.HRegion(1071): Opened fa5605bcfd9107cd3d59527f4cebc62e; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72594001, jitterRate=0.08173491060733795}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 12:03:19,788 DEBUG [Listener at localhost/45917] regionserver.HRegion(964): Region open journal for fa5605bcfd9107cd3d59527f4cebc62e: Writing region info on filesystem at 1675944199773Initializing all the Stores at 1675944199773Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944199773Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944199776 (+3 ms)Region opened successfully at 1675944199788 (+12 ms) 2023-02-09 12:03:19,797 DEBUG [Listener at localhost/45917] regionserver.HRegion(1603): Closing fa5605bcfd9107cd3d59527f4cebc62e, disabling compactions & flushes 2023-02-09 12:03:19,797 INFO [Listener at localhost/45917] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1675944196408.fa5605bcfd9107cd3d59527f4cebc62e. 2023-02-09 12:03:19,797 DEBUG [Listener at localhost/45917] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1675944196408.fa5605bcfd9107cd3d59527f4cebc62e. 2023-02-09 12:03:19,797 DEBUG [Listener at localhost/45917] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1675944196408.fa5605bcfd9107cd3d59527f4cebc62e. after waiting 0 ms 2023-02-09 12:03:19,797 DEBUG [Listener at localhost/45917] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1675944196408.fa5605bcfd9107cd3d59527f4cebc62e. 2023-02-09 12:03:19,798 INFO [Listener at localhost/45917] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1675944196408.fa5605bcfd9107cd3d59527f4cebc62e. 2023-02-09 12:03:19,798 DEBUG [Listener at localhost/45917] regionserver.HRegion(1557): Region close journal for fa5605bcfd9107cd3d59527f4cebc62e: Waiting for close lock at 1675944199797Disabling compacts and flushes for region at 1675944199797Disabling writes for close at 1675944199797Writing region close event to WAL at 1675944199798 (+1 ms)Closed at 1675944199798 2023-02-09 12:03:19,799 DEBUG [Listener at localhost/45917] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1675944196408.47f38db786eccf0b6b5d6e2a84049446.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:19,799 INFO [Listener at localhost/45917] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 12:03:19,801 DEBUG [Listener at localhost/45917] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 12:03:19,804 INFO [StoreOpener-47f38db786eccf0b6b5d6e2a84049446-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 47f38db786eccf0b6b5d6e2a84049446 2023-02-09 12:03:19,804 DEBUG [StoreOpener-47f38db786eccf0b6b5d6e2a84049446-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37789/user/jenkins/test-data/12ba8186-be0f-7e8f-11c9-39faac04ac44/testWithMockedMapReduceMultiRegion/f4926c28-1e41-4d0c-8178-9c3baa5c6e58/data/default/testWithMockedMapReduceMultiRegion/47f38db786eccf0b6b5d6e2a84049446/f1 2023-02-09 12:03:19,805 INFO [StoreOpener-47f38db786eccf0b6b5d6e2a84049446-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 47f38db786eccf0b6b5d6e2a84049446 columnFamilyName f1 2023-02-09 12:03:19,811 DEBUG [StoreOpener-47f38db786eccf0b6b5d6e2a84049446-1] regionserver.HStore(539): loaded hdfs://localhost:37789/user/jenkins/test-data/12ba8186-be0f-7e8f-11c9-39faac04ac44/testWithMockedMapReduceMultiRegion/f4926c28-1e41-4d0c-8178-9c3baa5c6e58/data/default/testWithMockedMapReduceMultiRegion/47f38db786eccf0b6b5d6e2a84049446/f1/testWithMockedMapReduceMultiRegion=47f38db786eccf0b6b5d6e2a84049446-9a868e1c73ca48b1b00b08c882a075e5 2023-02-09 12:03:19,811 INFO [StoreOpener-47f38db786eccf0b6b5d6e2a84049446-1] regionserver.HStore(310): Store=47f38db786eccf0b6b5d6e2a84049446/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:19,811 INFO [StoreOpener-47f38db786eccf0b6b5d6e2a84049446-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 47f38db786eccf0b6b5d6e2a84049446 2023-02-09 12:03:19,811 DEBUG [StoreOpener-47f38db786eccf0b6b5d6e2a84049446-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37789/user/jenkins/test-data/12ba8186-be0f-7e8f-11c9-39faac04ac44/testWithMockedMapReduceMultiRegion/f4926c28-1e41-4d0c-8178-9c3baa5c6e58/data/default/testWithMockedMapReduceMultiRegion/47f38db786eccf0b6b5d6e2a84049446/f2 2023-02-09 12:03:19,812 INFO [StoreOpener-47f38db786eccf0b6b5d6e2a84049446-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 47f38db786eccf0b6b5d6e2a84049446 columnFamilyName f2 2023-02-09 12:03:19,815 DEBUG [StoreOpener-47f38db786eccf0b6b5d6e2a84049446-1] regionserver.HStore(539): loaded hdfs://localhost:37789/user/jenkins/test-data/12ba8186-be0f-7e8f-11c9-39faac04ac44/testWithMockedMapReduceMultiRegion/f4926c28-1e41-4d0c-8178-9c3baa5c6e58/data/default/testWithMockedMapReduceMultiRegion/47f38db786eccf0b6b5d6e2a84049446/f2/testWithMockedMapReduceMultiRegion=47f38db786eccf0b6b5d6e2a84049446-083e48d50b6b45ecad79c9eea6bb0380 2023-02-09 12:03:19,816 INFO [StoreOpener-47f38db786eccf0b6b5d6e2a84049446-1] regionserver.HStore(310): Store=47f38db786eccf0b6b5d6e2a84049446/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:19,816 DEBUG [Listener at localhost/45917] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 12:03:19,816 INFO [Listener at localhost/45917] regionserver.HRegion(1071): Opened 47f38db786eccf0b6b5d6e2a84049446; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58880025, jitterRate=-0.12261925637722015}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 12:03:19,816 DEBUG [Listener at localhost/45917] regionserver.HRegion(964): Region open journal for 47f38db786eccf0b6b5d6e2a84049446: Writing region info on filesystem at 1675944199801Initializing all the Stores at 1675944199802 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944199802Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944199803 (+1 ms)Region opened successfully at 1675944199816 (+13 ms) 2023-02-09 12:03:19,824 DEBUG [Listener at localhost/45917] regionserver.HRegion(1603): Closing 47f38db786eccf0b6b5d6e2a84049446, disabling compactions & flushes 2023-02-09 12:03:19,824 INFO [Listener at localhost/45917] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1675944196408.47f38db786eccf0b6b5d6e2a84049446. 2023-02-09 12:03:19,824 DEBUG [Listener at localhost/45917] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1675944196408.47f38db786eccf0b6b5d6e2a84049446. 2023-02-09 12:03:19,824 DEBUG [Listener at localhost/45917] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1675944196408.47f38db786eccf0b6b5d6e2a84049446. after waiting 0 ms 2023-02-09 12:03:19,824 DEBUG [Listener at localhost/45917] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1675944196408.47f38db786eccf0b6b5d6e2a84049446. 2023-02-09 12:03:19,826 INFO [Listener at localhost/45917] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1675944196408.47f38db786eccf0b6b5d6e2a84049446. 2023-02-09 12:03:19,826 DEBUG [Listener at localhost/45917] regionserver.HRegion(1557): Region close journal for 47f38db786eccf0b6b5d6e2a84049446: Waiting for close lock at 1675944199824Disabling compacts and flushes for region at 1675944199824Disabling writes for close at 1675944199824Writing region close event to WAL at 1675944199826 (+2 ms)Closed at 1675944199826 2023-02-09 12:03:19,827 DEBUG [Listener at localhost/45917] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1675944196408.e9940616385adfef1b4a360461e5f6aa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:19,827 INFO [Listener at localhost/45917] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 12:03:19,828 DEBUG [Listener at localhost/45917] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 12:03:19,830 INFO [StoreOpener-e9940616385adfef1b4a360461e5f6aa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e9940616385adfef1b4a360461e5f6aa 2023-02-09 12:03:19,831 DEBUG [StoreOpener-e9940616385adfef1b4a360461e5f6aa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37789/user/jenkins/test-data/12ba8186-be0f-7e8f-11c9-39faac04ac44/testWithMockedMapReduceMultiRegion/f4926c28-1e41-4d0c-8178-9c3baa5c6e58/data/default/testWithMockedMapReduceMultiRegion/e9940616385adfef1b4a360461e5f6aa/f1 2023-02-09 12:03:19,831 INFO [StoreOpener-e9940616385adfef1b4a360461e5f6aa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e9940616385adfef1b4a360461e5f6aa columnFamilyName f1 2023-02-09 12:03:19,835 DEBUG [StoreOpener-e9940616385adfef1b4a360461e5f6aa-1] regionserver.HStore(539): loaded hdfs://localhost:37789/user/jenkins/test-data/12ba8186-be0f-7e8f-11c9-39faac04ac44/testWithMockedMapReduceMultiRegion/f4926c28-1e41-4d0c-8178-9c3baa5c6e58/data/default/testWithMockedMapReduceMultiRegion/e9940616385adfef1b4a360461e5f6aa/f1/testWithMockedMapReduceMultiRegion=e9940616385adfef1b4a360461e5f6aa-bcdb11218c9f46cf8c299011dd9e4b42 2023-02-09 12:03:19,835 INFO [StoreOpener-e9940616385adfef1b4a360461e5f6aa-1] regionserver.HStore(310): Store=e9940616385adfef1b4a360461e5f6aa/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:19,835 INFO [StoreOpener-e9940616385adfef1b4a360461e5f6aa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e9940616385adfef1b4a360461e5f6aa 2023-02-09 12:03:19,836 DEBUG [StoreOpener-e9940616385adfef1b4a360461e5f6aa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37789/user/jenkins/test-data/12ba8186-be0f-7e8f-11c9-39faac04ac44/testWithMockedMapReduceMultiRegion/f4926c28-1e41-4d0c-8178-9c3baa5c6e58/data/default/testWithMockedMapReduceMultiRegion/e9940616385adfef1b4a360461e5f6aa/f2 2023-02-09 12:03:19,836 INFO [StoreOpener-e9940616385adfef1b4a360461e5f6aa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e9940616385adfef1b4a360461e5f6aa columnFamilyName f2 2023-02-09 12:03:19,839 DEBUG [StoreOpener-e9940616385adfef1b4a360461e5f6aa-1] regionserver.HStore(539): loaded hdfs://localhost:37789/user/jenkins/test-data/12ba8186-be0f-7e8f-11c9-39faac04ac44/testWithMockedMapReduceMultiRegion/f4926c28-1e41-4d0c-8178-9c3baa5c6e58/data/default/testWithMockedMapReduceMultiRegion/e9940616385adfef1b4a360461e5f6aa/f2/testWithMockedMapReduceMultiRegion=e9940616385adfef1b4a360461e5f6aa-0ab74d50238540b885d761b90bf75a42 2023-02-09 12:03:19,839 INFO [StoreOpener-e9940616385adfef1b4a360461e5f6aa-1] regionserver.HStore(310): Store=e9940616385adfef1b4a360461e5f6aa/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:19,840 DEBUG [Listener at localhost/45917] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 12:03:19,840 INFO [Listener at localhost/45917] regionserver.HRegion(1071): Opened e9940616385adfef1b4a360461e5f6aa; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69163514, jitterRate=0.030616670846939087}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 12:03:19,840 DEBUG [Listener at localhost/45917] regionserver.HRegion(964): Region open journal for e9940616385adfef1b4a360461e5f6aa: Writing region info on filesystem at 1675944199828Initializing all the Stores at 1675944199829 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944199829Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944199829Region opened successfully at 1675944199840 (+11 ms) 2023-02-09 12:03:19,849 DEBUG [Listener at localhost/45917] regionserver.HRegion(1603): Closing e9940616385adfef1b4a360461e5f6aa, disabling compactions & flushes 2023-02-09 12:03:19,849 INFO [Listener at localhost/45917] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1675944196408.e9940616385adfef1b4a360461e5f6aa. 2023-02-09 12:03:19,849 DEBUG [Listener at localhost/45917] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1675944196408.e9940616385adfef1b4a360461e5f6aa. 2023-02-09 12:03:19,849 DEBUG [Listener at localhost/45917] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1675944196408.e9940616385adfef1b4a360461e5f6aa. after waiting 0 ms 2023-02-09 12:03:19,849 DEBUG [Listener at localhost/45917] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1675944196408.e9940616385adfef1b4a360461e5f6aa. 2023-02-09 12:03:19,850 INFO [Listener at localhost/45917] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1675944196408.e9940616385adfef1b4a360461e5f6aa. 2023-02-09 12:03:19,850 DEBUG [Listener at localhost/45917] regionserver.HRegion(1557): Region close journal for e9940616385adfef1b4a360461e5f6aa: Waiting for close lock at 1675944199849Disabling compacts and flushes for region at 1675944199849Disabling writes for close at 1675944199849Writing region close event to WAL at 1675944199850 (+1 ms)Closed at 1675944199850 2023-02-09 12:03:19,850 DEBUG [Listener at localhost/45917] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1675944196408.63c860f86a4badc3807b95d70675d9f2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:19,851 INFO [Listener at localhost/45917] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 12:03:19,852 DEBUG [Listener at localhost/45917] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 12:03:19,854 INFO [StoreOpener-63c860f86a4badc3807b95d70675d9f2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 63c860f86a4badc3807b95d70675d9f2 2023-02-09 12:03:19,854 DEBUG [StoreOpener-63c860f86a4badc3807b95d70675d9f2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37789/user/jenkins/test-data/12ba8186-be0f-7e8f-11c9-39faac04ac44/testWithMockedMapReduceMultiRegion/f4926c28-1e41-4d0c-8178-9c3baa5c6e58/data/default/testWithMockedMapReduceMultiRegion/63c860f86a4badc3807b95d70675d9f2/f1 2023-02-09 12:03:19,854 INFO [StoreOpener-63c860f86a4badc3807b95d70675d9f2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 63c860f86a4badc3807b95d70675d9f2 columnFamilyName f1 2023-02-09 12:03:19,858 DEBUG [StoreOpener-63c860f86a4badc3807b95d70675d9f2-1] regionserver.HStore(539): loaded hdfs://localhost:37789/user/jenkins/test-data/12ba8186-be0f-7e8f-11c9-39faac04ac44/testWithMockedMapReduceMultiRegion/f4926c28-1e41-4d0c-8178-9c3baa5c6e58/data/default/testWithMockedMapReduceMultiRegion/63c860f86a4badc3807b95d70675d9f2/f1/testWithMockedMapReduceMultiRegion=63c860f86a4badc3807b95d70675d9f2-49bcf0e4eb2f4cedaf1a96860f156b39 2023-02-09 12:03:19,858 INFO [StoreOpener-63c860f86a4badc3807b95d70675d9f2-1] regionserver.HStore(310): Store=63c860f86a4badc3807b95d70675d9f2/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:19,858 INFO [StoreOpener-63c860f86a4badc3807b95d70675d9f2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 63c860f86a4badc3807b95d70675d9f2 2023-02-09 12:03:19,858 DEBUG [StoreOpener-63c860f86a4badc3807b95d70675d9f2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37789/user/jenkins/test-data/12ba8186-be0f-7e8f-11c9-39faac04ac44/testWithMockedMapReduceMultiRegion/f4926c28-1e41-4d0c-8178-9c3baa5c6e58/data/default/testWithMockedMapReduceMultiRegion/63c860f86a4badc3807b95d70675d9f2/f2 2023-02-09 12:03:19,859 INFO [StoreOpener-63c860f86a4badc3807b95d70675d9f2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 63c860f86a4badc3807b95d70675d9f2 columnFamilyName f2 2023-02-09 12:03:19,862 DEBUG [StoreOpener-63c860f86a4badc3807b95d70675d9f2-1] regionserver.HStore(539): loaded hdfs://localhost:37789/user/jenkins/test-data/12ba8186-be0f-7e8f-11c9-39faac04ac44/testWithMockedMapReduceMultiRegion/f4926c28-1e41-4d0c-8178-9c3baa5c6e58/data/default/testWithMockedMapReduceMultiRegion/63c860f86a4badc3807b95d70675d9f2/f2/testWithMockedMapReduceMultiRegion=63c860f86a4badc3807b95d70675d9f2-bb51a85678c242a391d763a9944f1f4f 2023-02-09 12:03:19,862 INFO [StoreOpener-63c860f86a4badc3807b95d70675d9f2-1] regionserver.HStore(310): Store=63c860f86a4badc3807b95d70675d9f2/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:19,862 DEBUG [Listener at localhost/45917] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 12:03:19,862 INFO [Listener at localhost/45917] regionserver.HRegion(1071): Opened 63c860f86a4badc3807b95d70675d9f2; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60702376, jitterRate=-0.09546411037445068}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 12:03:19,862 DEBUG [Listener at localhost/45917] regionserver.HRegion(964): Region open journal for 63c860f86a4badc3807b95d70675d9f2: Writing region info on filesystem at 1675944199852Initializing all the Stores at 1675944199853 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944199853Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944199853Region opened successfully at 1675944199862 (+9 ms) 2023-02-09 12:03:19,870 DEBUG [Listener at localhost/45917] regionserver.HRegion(1603): Closing 63c860f86a4badc3807b95d70675d9f2, disabling compactions & flushes 2023-02-09 12:03:19,870 INFO [Listener at localhost/45917] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1675944196408.63c860f86a4badc3807b95d70675d9f2. 2023-02-09 12:03:19,870 DEBUG [Listener at localhost/45917] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1675944196408.63c860f86a4badc3807b95d70675d9f2. 2023-02-09 12:03:19,870 DEBUG [Listener at localhost/45917] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1675944196408.63c860f86a4badc3807b95d70675d9f2. after waiting 0 ms 2023-02-09 12:03:19,870 DEBUG [Listener at localhost/45917] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1675944196408.63c860f86a4badc3807b95d70675d9f2. 2023-02-09 12:03:19,871 INFO [Listener at localhost/45917] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1675944196408.63c860f86a4badc3807b95d70675d9f2. 2023-02-09 12:03:19,871 DEBUG [Listener at localhost/45917] regionserver.HRegion(1557): Region close journal for 63c860f86a4badc3807b95d70675d9f2: Waiting for close lock at 1675944199870Disabling compacts and flushes for region at 1675944199870Disabling writes for close at 1675944199870Writing region close event to WAL at 1675944199871 (+1 ms)Closed at 1675944199871 2023-02-09 12:03:19,874 INFO [Listener at localhost/45917] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:19,874 INFO [Listener at localhost/45917] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:19,875 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36247] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMockedMapReduceMultiRegion" 2023-02-09 12:03:19,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36247] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceMultiRegion 2023-02-09 12:03:19,878 INFO [Listener at localhost/45917] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:19,878 INFO [Listener at localhost/45917] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:19,878 INFO [Listener at localhost/45917] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-09 12:03:19,879 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36247] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceMultiRegion 2023-02-09 12:03:19,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36247] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-09 12:03:19,881 INFO [Listener at localhost/45917] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:19,881 INFO [Listener at localhost/45917] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:19,882 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675944199882"}]},"ts":"1675944199882"} 2023-02-09 12:03:19,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36247] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-09 12:03:19,883 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLING in hbase:meta 2023-02-09 12:03:19,885 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceMultiRegion to state=DISABLING 2023-02-09 12:03:19,885 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=fc93a9dbe44dab8e3d7c7b74ab677eef, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e9940616385adfef1b4a360461e5f6aa, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=63c860f86a4badc3807b95d70675d9f2, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c9287bd8c1c12cde6a38f884d6d1fbbb, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=afaa39f80fc4e48681467bdcafa36d2f, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=fa5605bcfd9107cd3d59527f4cebc62e, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=47f38db786eccf0b6b5d6e2a84049446, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=0f9ec56206c8a4a22ea16c5e609aa91e, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b99c55f7f2e0c44b0df4935d019d297c, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f16214bbc54fdfa480400f03bb3486f8, UNASSIGN}] 2023-02-09 12:03:19,887 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c9287bd8c1c12cde6a38f884d6d1fbbb, UNASSIGN 2023-02-09 12:03:19,887 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=fc93a9dbe44dab8e3d7c7b74ab677eef, UNASSIGN 2023-02-09 12:03:19,887 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=63c860f86a4badc3807b95d70675d9f2, UNASSIGN 2023-02-09 12:03:19,887 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e9940616385adfef1b4a360461e5f6aa, UNASSIGN 2023-02-09 12:03:19,887 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f16214bbc54fdfa480400f03bb3486f8, UNASSIGN 2023-02-09 12:03:19,888 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=c9287bd8c1c12cde6a38f884d6d1fbbb, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36313,1675944195173 2023-02-09 12:03:19,888 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=fc93a9dbe44dab8e3d7c7b74ab677eef, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36427,1675944195143 2023-02-09 12:03:19,888 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1675944196408.c9287bd8c1c12cde6a38f884d6d1fbbb.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675944199888"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675944199888"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675944199888"}]},"ts":"1675944199888"} 2023-02-09 12:03:19,888 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=63c860f86a4badc3807b95d70675d9f2, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36427,1675944195143 2023-02-09 12:03:19,888 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=e9940616385adfef1b4a360461e5f6aa, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36313,1675944195173 2023-02-09 12:03:19,888 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=f16214bbc54fdfa480400f03bb3486f8, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36313,1675944195173 2023-02-09 12:03:19,888 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1675944196408.e9940616385adfef1b4a360461e5f6aa.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675944199888"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675944199888"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675944199888"}]},"ts":"1675944199888"} 2023-02-09 12:03:19,888 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1675944196408.63c860f86a4badc3807b95d70675d9f2.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675944199888"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675944199888"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675944199888"}]},"ts":"1675944199888"} 2023-02-09 12:03:19,888 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1675944196408.fc93a9dbe44dab8e3d7c7b74ab677eef.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675944199888"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675944199888"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675944199888"}]},"ts":"1675944199888"} 2023-02-09 12:03:19,888 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1675944196408.f16214bbc54fdfa480400f03bb3486f8.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675944199888"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675944199888"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675944199888"}]},"ts":"1675944199888"} 2023-02-09 12:03:19,889 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=37, state=RUNNABLE; CloseRegionProcedure c9287bd8c1c12cde6a38f884d6d1fbbb, server=jenkins-hbase4.apache.org,36313,1675944195173}] 2023-02-09 12:03:19,890 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=35, state=RUNNABLE; CloseRegionProcedure e9940616385adfef1b4a360461e5f6aa, server=jenkins-hbase4.apache.org,36313,1675944195173}] 2023-02-09 12:03:19,890 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=36, state=RUNNABLE; CloseRegionProcedure 63c860f86a4badc3807b95d70675d9f2, server=jenkins-hbase4.apache.org,36427,1675944195143}] 2023-02-09 12:03:19,891 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=34, state=RUNNABLE; CloseRegionProcedure fc93a9dbe44dab8e3d7c7b74ab677eef, server=jenkins-hbase4.apache.org,36427,1675944195143}] 2023-02-09 12:03:19,892 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b99c55f7f2e0c44b0df4935d019d297c, UNASSIGN 2023-02-09 12:03:19,892 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=43, state=RUNNABLE; CloseRegionProcedure f16214bbc54fdfa480400f03bb3486f8, server=jenkins-hbase4.apache.org,36313,1675944195173}] 2023-02-09 12:03:19,892 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=0f9ec56206c8a4a22ea16c5e609aa91e, UNASSIGN 2023-02-09 12:03:19,893 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=b99c55f7f2e0c44b0df4935d019d297c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36427,1675944195143 2023-02-09 12:03:19,893 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1675944196408.b99c55f7f2e0c44b0df4935d019d297c.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675944199893"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675944199893"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675944199893"}]},"ts":"1675944199893"} 2023-02-09 12:03:19,893 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=47f38db786eccf0b6b5d6e2a84049446, UNASSIGN 2023-02-09 12:03:19,893 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=0f9ec56206c8a4a22ea16c5e609aa91e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36313,1675944195173 2023-02-09 12:03:19,893 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1675944196408.0f9ec56206c8a4a22ea16c5e609aa91e.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675944199893"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675944199893"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675944199893"}]},"ts":"1675944199893"} 2023-02-09 12:03:19,894 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=fa5605bcfd9107cd3d59527f4cebc62e, UNASSIGN 2023-02-09 12:03:19,894 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=47f38db786eccf0b6b5d6e2a84049446, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36427,1675944195143 2023-02-09 12:03:19,894 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1675944196408.47f38db786eccf0b6b5d6e2a84049446.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675944199894"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675944199894"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675944199894"}]},"ts":"1675944199894"} 2023-02-09 12:03:19,894 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=42, state=RUNNABLE; CloseRegionProcedure b99c55f7f2e0c44b0df4935d019d297c, server=jenkins-hbase4.apache.org,36427,1675944195143}] 2023-02-09 12:03:19,894 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=fa5605bcfd9107cd3d59527f4cebc62e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36313,1675944195173 2023-02-09 12:03:19,895 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=afaa39f80fc4e48681467bdcafa36d2f, UNASSIGN 2023-02-09 12:03:19,895 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1675944196408.fa5605bcfd9107cd3d59527f4cebc62e.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675944199894"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675944199894"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675944199894"}]},"ts":"1675944199894"} 2023-02-09 12:03:19,895 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=41, state=RUNNABLE; CloseRegionProcedure 0f9ec56206c8a4a22ea16c5e609aa91e, server=jenkins-hbase4.apache.org,36313,1675944195173}] 2023-02-09 12:03:19,895 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=40, state=RUNNABLE; CloseRegionProcedure 47f38db786eccf0b6b5d6e2a84049446, server=jenkins-hbase4.apache.org,36427,1675944195143}] 2023-02-09 12:03:19,896 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=afaa39f80fc4e48681467bdcafa36d2f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36427,1675944195143 2023-02-09 12:03:19,896 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1675944196408.afaa39f80fc4e48681467bdcafa36d2f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675944199896"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675944199896"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675944199896"}]},"ts":"1675944199896"} 2023-02-09 12:03:19,899 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=39, state=RUNNABLE; CloseRegionProcedure fa5605bcfd9107cd3d59527f4cebc62e, server=jenkins-hbase4.apache.org,36313,1675944195173}] 2023-02-09 12:03:19,900 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=38, state=RUNNABLE; CloseRegionProcedure afaa39f80fc4e48681467bdcafa36d2f, server=jenkins-hbase4.apache.org,36427,1675944195143}] 2023-02-09 12:03:19,982 INFO [Listener at localhost/45917] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:19,982 INFO [Listener at localhost/45917] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:19,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36247] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-09 12:03:20,041 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close f16214bbc54fdfa480400f03bb3486f8 2023-02-09 12:03:20,041 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing f16214bbc54fdfa480400f03bb3486f8, disabling compactions & flushes 2023-02-09 12:03:20,041 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1675944196408.f16214bbc54fdfa480400f03bb3486f8. 2023-02-09 12:03:20,041 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1675944196408.f16214bbc54fdfa480400f03bb3486f8. 2023-02-09 12:03:20,041 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1675944196408.f16214bbc54fdfa480400f03bb3486f8. after waiting 0 ms 2023-02-09 12:03:20,041 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1675944196408.f16214bbc54fdfa480400f03bb3486f8. 2023-02-09 12:03:20,043 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 63c860f86a4badc3807b95d70675d9f2 2023-02-09 12:03:20,043 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 63c860f86a4badc3807b95d70675d9f2, disabling compactions & flushes 2023-02-09 12:03:20,043 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1675944196408.63c860f86a4badc3807b95d70675d9f2. 2023-02-09 12:03:20,043 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1675944196408.63c860f86a4badc3807b95d70675d9f2. 2023-02-09 12:03:20,043 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1675944196408.63c860f86a4badc3807b95d70675d9f2. after waiting 0 ms 2023-02-09 12:03:20,043 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1675944196408.63c860f86a4badc3807b95d70675d9f2. 2023-02-09 12:03:20,045 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/f16214bbc54fdfa480400f03bb3486f8/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-09 12:03:20,046 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1675944196408.f16214bbc54fdfa480400f03bb3486f8. 2023-02-09 12:03:20,047 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for f16214bbc54fdfa480400f03bb3486f8: Waiting for close lock at 1675944200041Running coprocessor pre-close hooks at 1675944200041Disabling compacts and flushes for region at 1675944200041Disabling writes for close at 1675944200041Writing region close event to WAL at 1675944200042 (+1 ms)Running coprocessor post-close hooks at 1675944200045 (+3 ms)Closed at 1675944200046 (+1 ms) 2023-02-09 12:03:20,048 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/63c860f86a4badc3807b95d70675d9f2/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 12:03:20,048 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed f16214bbc54fdfa480400f03bb3486f8 2023-02-09 12:03:20,048 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close fa5605bcfd9107cd3d59527f4cebc62e 2023-02-09 12:03:20,048 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing fa5605bcfd9107cd3d59527f4cebc62e, disabling compactions & flushes 2023-02-09 12:03:20,048 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1675944196408.fa5605bcfd9107cd3d59527f4cebc62e. 2023-02-09 12:03:20,048 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1675944196408.fa5605bcfd9107cd3d59527f4cebc62e. 2023-02-09 12:03:20,048 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1675944196408.fa5605bcfd9107cd3d59527f4cebc62e. after waiting 0 ms 2023-02-09 12:03:20,048 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1675944196408.fa5605bcfd9107cd3d59527f4cebc62e. 2023-02-09 12:03:20,048 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=f16214bbc54fdfa480400f03bb3486f8, regionState=CLOSED 2023-02-09 12:03:20,049 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1675944196408.63c860f86a4badc3807b95d70675d9f2. 2023-02-09 12:03:20,049 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1675944196408.f16214bbc54fdfa480400f03bb3486f8.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675944200048"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675944200048"}]},"ts":"1675944200048"} 2023-02-09 12:03:20,049 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 63c860f86a4badc3807b95d70675d9f2: Waiting for close lock at 1675944200043Running coprocessor pre-close hooks at 1675944200043Disabling compacts and flushes for region at 1675944200043Disabling writes for close at 1675944200043Writing region close event to WAL at 1675944200044 (+1 ms)Running coprocessor post-close hooks at 1675944200048 (+4 ms)Closed at 1675944200049 (+1 ms) 2023-02-09 12:03:20,051 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 63c860f86a4badc3807b95d70675d9f2 2023-02-09 12:03:20,051 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close fc93a9dbe44dab8e3d7c7b74ab677eef 2023-02-09 12:03:20,051 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing fc93a9dbe44dab8e3d7c7b74ab677eef, disabling compactions & flushes 2023-02-09 12:03:20,051 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1675944196408.fc93a9dbe44dab8e3d7c7b74ab677eef. 2023-02-09 12:03:20,051 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1675944196408.fc93a9dbe44dab8e3d7c7b74ab677eef. 2023-02-09 12:03:20,051 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1675944196408.fc93a9dbe44dab8e3d7c7b74ab677eef. after waiting 0 ms 2023-02-09 12:03:20,051 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1675944196408.fc93a9dbe44dab8e3d7c7b74ab677eef. 2023-02-09 12:03:20,052 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=63c860f86a4badc3807b95d70675d9f2, regionState=CLOSED 2023-02-09 12:03:20,052 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1675944196408.63c860f86a4badc3807b95d70675d9f2.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675944200052"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675944200052"}]},"ts":"1675944200052"} 2023-02-09 12:03:20,053 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=43 2023-02-09 12:03:20,053 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=43, state=SUCCESS; CloseRegionProcedure f16214bbc54fdfa480400f03bb3486f8, server=jenkins-hbase4.apache.org,36313,1675944195173 in 159 msec 2023-02-09 12:03:20,053 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/fa5605bcfd9107cd3d59527f4cebc62e/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 12:03:20,055 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1675944196408.fa5605bcfd9107cd3d59527f4cebc62e. 2023-02-09 12:03:20,055 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for fa5605bcfd9107cd3d59527f4cebc62e: Waiting for close lock at 1675944200048Running coprocessor pre-close hooks at 1675944200048Disabling compacts and flushes for region at 1675944200048Disabling writes for close at 1675944200048Writing region close event to WAL at 1675944200050 (+2 ms)Running coprocessor post-close hooks at 1675944200054 (+4 ms)Closed at 1675944200055 (+1 ms) 2023-02-09 12:03:20,055 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f16214bbc54fdfa480400f03bb3486f8, UNASSIGN in 168 msec 2023-02-09 12:03:20,056 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=36 2023-02-09 12:03:20,056 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=36, state=SUCCESS; CloseRegionProcedure 63c860f86a4badc3807b95d70675d9f2, server=jenkins-hbase4.apache.org,36427,1675944195143 in 163 msec 2023-02-09 12:03:20,057 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed fa5605bcfd9107cd3d59527f4cebc62e 2023-02-09 12:03:20,057 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 0f9ec56206c8a4a22ea16c5e609aa91e 2023-02-09 12:03:20,057 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 0f9ec56206c8a4a22ea16c5e609aa91e, disabling compactions & flushes 2023-02-09 12:03:20,057 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1675944196408.0f9ec56206c8a4a22ea16c5e609aa91e. 2023-02-09 12:03:20,057 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1675944196408.0f9ec56206c8a4a22ea16c5e609aa91e. 2023-02-09 12:03:20,057 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1675944196408.0f9ec56206c8a4a22ea16c5e609aa91e. after waiting 0 ms 2023-02-09 12:03:20,057 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1675944196408.0f9ec56206c8a4a22ea16c5e609aa91e. 2023-02-09 12:03:20,057 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=fa5605bcfd9107cd3d59527f4cebc62e, regionState=CLOSED 2023-02-09 12:03:20,057 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=63c860f86a4badc3807b95d70675d9f2, UNASSIGN in 171 msec 2023-02-09 12:03:20,057 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1675944196408.fa5605bcfd9107cd3d59527f4cebc62e.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675944200057"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675944200057"}]},"ts":"1675944200057"} 2023-02-09 12:03:20,059 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/fc93a9dbe44dab8e3d7c7b74ab677eef/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-09 12:03:20,060 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1675944196408.fc93a9dbe44dab8e3d7c7b74ab677eef. 2023-02-09 12:03:20,060 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for fc93a9dbe44dab8e3d7c7b74ab677eef: Waiting for close lock at 1675944200051Running coprocessor pre-close hooks at 1675944200051Disabling compacts and flushes for region at 1675944200051Disabling writes for close at 1675944200051Writing region close event to WAL at 1675944200052 (+1 ms)Running coprocessor post-close hooks at 1675944200059 (+7 ms)Closed at 1675944200060 (+1 ms) 2023-02-09 12:03:20,061 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=39 2023-02-09 12:03:20,061 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=39, state=SUCCESS; CloseRegionProcedure fa5605bcfd9107cd3d59527f4cebc62e, server=jenkins-hbase4.apache.org,36313,1675944195173 in 162 msec 2023-02-09 12:03:20,062 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed fc93a9dbe44dab8e3d7c7b74ab677eef 2023-02-09 12:03:20,062 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close afaa39f80fc4e48681467bdcafa36d2f 2023-02-09 12:03:20,062 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing afaa39f80fc4e48681467bdcafa36d2f, disabling compactions & flushes 2023-02-09 12:03:20,062 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675944196408.afaa39f80fc4e48681467bdcafa36d2f. 2023-02-09 12:03:20,062 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675944196408.afaa39f80fc4e48681467bdcafa36d2f. 2023-02-09 12:03:20,062 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675944196408.afaa39f80fc4e48681467bdcafa36d2f. after waiting 0 ms 2023-02-09 12:03:20,062 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=fa5605bcfd9107cd3d59527f4cebc62e, UNASSIGN in 176 msec 2023-02-09 12:03:20,062 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675944196408.afaa39f80fc4e48681467bdcafa36d2f. 2023-02-09 12:03:20,062 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=fc93a9dbe44dab8e3d7c7b74ab677eef, regionState=CLOSED 2023-02-09 12:03:20,062 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1675944196408.fc93a9dbe44dab8e3d7c7b74ab677eef.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675944200062"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675944200062"}]},"ts":"1675944200062"} 2023-02-09 12:03:20,064 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/0f9ec56206c8a4a22ea16c5e609aa91e/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 12:03:20,065 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1675944196408.0f9ec56206c8a4a22ea16c5e609aa91e. 2023-02-09 12:03:20,065 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 0f9ec56206c8a4a22ea16c5e609aa91e: Waiting for close lock at 1675944200057Running coprocessor pre-close hooks at 1675944200057Disabling compacts and flushes for region at 1675944200057Disabling writes for close at 1675944200057Writing region close event to WAL at 1675944200059 (+2 ms)Running coprocessor post-close hooks at 1675944200064 (+5 ms)Closed at 1675944200065 (+1 ms) 2023-02-09 12:03:20,067 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 0f9ec56206c8a4a22ea16c5e609aa91e 2023-02-09 12:03:20,067 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close e9940616385adfef1b4a360461e5f6aa 2023-02-09 12:03:20,067 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing e9940616385adfef1b4a360461e5f6aa, disabling compactions & flushes 2023-02-09 12:03:20,067 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1675944196408.e9940616385adfef1b4a360461e5f6aa. 2023-02-09 12:03:20,067 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1675944196408.e9940616385adfef1b4a360461e5f6aa. 2023-02-09 12:03:20,067 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1675944196408.e9940616385adfef1b4a360461e5f6aa. after waiting 0 ms 2023-02-09 12:03:20,067 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1675944196408.e9940616385adfef1b4a360461e5f6aa. 2023-02-09 12:03:20,068 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=0f9ec56206c8a4a22ea16c5e609aa91e, regionState=CLOSED 2023-02-09 12:03:20,068 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1675944196408.0f9ec56206c8a4a22ea16c5e609aa91e.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675944200068"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675944200068"}]},"ts":"1675944200068"} 2023-02-09 12:03:20,068 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=34 2023-02-09 12:03:20,068 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=34, state=SUCCESS; CloseRegionProcedure fc93a9dbe44dab8e3d7c7b74ab677eef, server=jenkins-hbase4.apache.org,36427,1675944195143 in 173 msec 2023-02-09 12:03:20,069 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/afaa39f80fc4e48681467bdcafa36d2f/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 12:03:20,069 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=fc93a9dbe44dab8e3d7c7b74ab677eef, UNASSIGN in 183 msec 2023-02-09 12:03:20,071 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675944196408.afaa39f80fc4e48681467bdcafa36d2f. 2023-02-09 12:03:20,071 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for afaa39f80fc4e48681467bdcafa36d2f: Waiting for close lock at 1675944200062Running coprocessor pre-close hooks at 1675944200062Disabling compacts and flushes for region at 1675944200062Disabling writes for close at 1675944200062Writing region close event to WAL at 1675944200063 (+1 ms)Running coprocessor post-close hooks at 1675944200070 (+7 ms)Closed at 1675944200071 (+1 ms) 2023-02-09 12:03:20,073 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed afaa39f80fc4e48681467bdcafa36d2f 2023-02-09 12:03:20,073 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close b99c55f7f2e0c44b0df4935d019d297c 2023-02-09 12:03:20,073 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing b99c55f7f2e0c44b0df4935d019d297c, disabling compactions & flushes 2023-02-09 12:03:20,073 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1675944196408.b99c55f7f2e0c44b0df4935d019d297c. 2023-02-09 12:03:20,073 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1675944196408.b99c55f7f2e0c44b0df4935d019d297c. 2023-02-09 12:03:20,073 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1675944196408.b99c55f7f2e0c44b0df4935d019d297c. after waiting 0 ms 2023-02-09 12:03:20,073 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1675944196408.b99c55f7f2e0c44b0df4935d019d297c. 2023-02-09 12:03:20,073 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=afaa39f80fc4e48681467bdcafa36d2f, regionState=CLOSED 2023-02-09 12:03:20,073 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1675944196408.afaa39f80fc4e48681467bdcafa36d2f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675944200073"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675944200073"}]},"ts":"1675944200073"} 2023-02-09 12:03:20,073 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=41 2023-02-09 12:03:20,073 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=41, state=SUCCESS; CloseRegionProcedure 0f9ec56206c8a4a22ea16c5e609aa91e, server=jenkins-hbase4.apache.org,36313,1675944195173 in 176 msec 2023-02-09 12:03:20,076 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/e9940616385adfef1b4a360461e5f6aa/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 12:03:20,076 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=0f9ec56206c8a4a22ea16c5e609aa91e, UNASSIGN in 188 msec 2023-02-09 12:03:20,078 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1675944196408.e9940616385adfef1b4a360461e5f6aa. 2023-02-09 12:03:20,078 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=38 2023-02-09 12:03:20,078 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for e9940616385adfef1b4a360461e5f6aa: Waiting for close lock at 1675944200067Running coprocessor pre-close hooks at 1675944200067Disabling compacts and flushes for region at 1675944200067Disabling writes for close at 1675944200067Writing region close event to WAL at 1675944200069 (+2 ms)Running coprocessor post-close hooks at 1675944200077 (+8 ms)Closed at 1675944200078 (+1 ms) 2023-02-09 12:03:20,078 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=38, state=SUCCESS; CloseRegionProcedure afaa39f80fc4e48681467bdcafa36d2f, server=jenkins-hbase4.apache.org,36427,1675944195143 in 174 msec 2023-02-09 12:03:20,080 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=afaa39f80fc4e48681467bdcafa36d2f, UNASSIGN in 193 msec 2023-02-09 12:03:20,080 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed e9940616385adfef1b4a360461e5f6aa 2023-02-09 12:03:20,080 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close c9287bd8c1c12cde6a38f884d6d1fbbb 2023-02-09 12:03:20,080 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing c9287bd8c1c12cde6a38f884d6d1fbbb, disabling compactions & flushes 2023-02-09 12:03:20,080 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675944196408.c9287bd8c1c12cde6a38f884d6d1fbbb. 2023-02-09 12:03:20,080 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675944196408.c9287bd8c1c12cde6a38f884d6d1fbbb. 2023-02-09 12:03:20,080 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675944196408.c9287bd8c1c12cde6a38f884d6d1fbbb. after waiting 0 ms 2023-02-09 12:03:20,080 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675944196408.c9287bd8c1c12cde6a38f884d6d1fbbb. 2023-02-09 12:03:20,081 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=e9940616385adfef1b4a360461e5f6aa, regionState=CLOSED 2023-02-09 12:03:20,081 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1675944196408.e9940616385adfef1b4a360461e5f6aa.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675944200081"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675944200081"}]},"ts":"1675944200081"} 2023-02-09 12:03:20,082 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/b99c55f7f2e0c44b0df4935d019d297c/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 12:03:20,083 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1675944196408.b99c55f7f2e0c44b0df4935d019d297c. 2023-02-09 12:03:20,083 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for b99c55f7f2e0c44b0df4935d019d297c: Waiting for close lock at 1675944200073Running coprocessor pre-close hooks at 1675944200073Disabling compacts and flushes for region at 1675944200073Disabling writes for close at 1675944200073Writing region close event to WAL at 1675944200076 (+3 ms)Running coprocessor post-close hooks at 1675944200082 (+6 ms)Closed at 1675944200083 (+1 ms) 2023-02-09 12:03:20,085 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/c9287bd8c1c12cde6a38f884d6d1fbbb/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 12:03:20,087 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675944196408.c9287bd8c1c12cde6a38f884d6d1fbbb. 2023-02-09 12:03:20,087 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for c9287bd8c1c12cde6a38f884d6d1fbbb: Waiting for close lock at 1675944200080Running coprocessor pre-close hooks at 1675944200080Disabling compacts and flushes for region at 1675944200080Disabling writes for close at 1675944200080Writing region close event to WAL at 1675944200082 (+2 ms)Running coprocessor post-close hooks at 1675944200086 (+4 ms)Closed at 1675944200087 (+1 ms) 2023-02-09 12:03:20,089 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed b99c55f7f2e0c44b0df4935d019d297c 2023-02-09 12:03:20,089 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 47f38db786eccf0b6b5d6e2a84049446 2023-02-09 12:03:20,089 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 47f38db786eccf0b6b5d6e2a84049446, disabling compactions & flushes 2023-02-09 12:03:20,089 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1675944196408.47f38db786eccf0b6b5d6e2a84049446. 2023-02-09 12:03:20,089 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1675944196408.47f38db786eccf0b6b5d6e2a84049446. 2023-02-09 12:03:20,090 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1675944196408.47f38db786eccf0b6b5d6e2a84049446. after waiting 0 ms 2023-02-09 12:03:20,090 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1675944196408.47f38db786eccf0b6b5d6e2a84049446. 2023-02-09 12:03:20,090 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=b99c55f7f2e0c44b0df4935d019d297c, regionState=CLOSED 2023-02-09 12:03:20,090 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1675944196408.b99c55f7f2e0c44b0df4935d019d297c.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675944200090"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675944200090"}]},"ts":"1675944200090"} 2023-02-09 12:03:20,090 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed c9287bd8c1c12cde6a38f884d6d1fbbb 2023-02-09 12:03:20,091 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=35 2023-02-09 12:03:20,091 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=35, state=SUCCESS; CloseRegionProcedure e9940616385adfef1b4a360461e5f6aa, server=jenkins-hbase4.apache.org,36313,1675944195173 in 192 msec 2023-02-09 12:03:20,091 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=c9287bd8c1c12cde6a38f884d6d1fbbb, regionState=CLOSED 2023-02-09 12:03:20,091 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1675944196408.c9287bd8c1c12cde6a38f884d6d1fbbb.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675944200091"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675944200091"}]},"ts":"1675944200091"} 2023-02-09 12:03:20,092 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e9940616385adfef1b4a360461e5f6aa, UNASSIGN in 206 msec 2023-02-09 12:03:20,094 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=42 2023-02-09 12:03:20,094 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=42, state=SUCCESS; CloseRegionProcedure b99c55f7f2e0c44b0df4935d019d297c, server=jenkins-hbase4.apache.org,36427,1675944195143 in 198 msec 2023-02-09 12:03:20,095 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=37 2023-02-09 12:03:20,095 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=37, state=SUCCESS; CloseRegionProcedure c9287bd8c1c12cde6a38f884d6d1fbbb, server=jenkins-hbase4.apache.org,36313,1675944195173 in 204 msec 2023-02-09 12:03:20,096 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/default/testWithMockedMapReduceMultiRegion/47f38db786eccf0b6b5d6e2a84049446/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 12:03:20,098 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1675944196408.47f38db786eccf0b6b5d6e2a84049446. 2023-02-09 12:03:20,098 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 47f38db786eccf0b6b5d6e2a84049446: Waiting for close lock at 1675944200089Running coprocessor pre-close hooks at 1675944200089Disabling compacts and flushes for region at 1675944200089Disabling writes for close at 1675944200090 (+1 ms)Writing region close event to WAL at 1675944200092 (+2 ms)Running coprocessor post-close hooks at 1675944200097 (+5 ms)Closed at 1675944200098 (+1 ms) 2023-02-09 12:03:20,099 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b99c55f7f2e0c44b0df4935d019d297c, UNASSIGN in 209 msec 2023-02-09 12:03:20,099 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 47f38db786eccf0b6b5d6e2a84049446 2023-02-09 12:03:20,100 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c9287bd8c1c12cde6a38f884d6d1fbbb, UNASSIGN in 210 msec 2023-02-09 12:03:20,100 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=47f38db786eccf0b6b5d6e2a84049446, regionState=CLOSED 2023-02-09 12:03:20,100 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1675944196408.47f38db786eccf0b6b5d6e2a84049446.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675944200100"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675944200100"}]},"ts":"1675944200100"} 2023-02-09 12:03:20,102 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=40 2023-02-09 12:03:20,102 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=40, state=SUCCESS; CloseRegionProcedure 47f38db786eccf0b6b5d6e2a84049446, server=jenkins-hbase4.apache.org,36427,1675944195143 in 206 msec 2023-02-09 12:03:20,103 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=33 2023-02-09 12:03:20,103 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=47f38db786eccf0b6b5d6e2a84049446, UNASSIGN in 217 msec 2023-02-09 12:03:20,103 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675944200103"}]},"ts":"1675944200103"} 2023-02-09 12:03:20,104 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLED in hbase:meta 2023-02-09 12:03:20,106 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceMultiRegion to state=DISABLED 2023-02-09 12:03:20,107 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceMultiRegion in 227 msec 2023-02-09 12:03:20,184 INFO [Listener at localhost/45917] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:20,184 INFO [Listener at localhost/45917] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:20,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36247] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-09 12:03:20,186 INFO [Listener at localhost/45917] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 33 completed 2023-02-09 12:03:20,186 INFO [Listener at localhost/45917] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:20,186 INFO [Listener at localhost/45917] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:20,187 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36247] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testWithMockedMapReduceMultiRegion 2023-02-09 12:03:20,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36247] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-09 12:03:20,189 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-09 12:03:20,189 INFO [Listener at localhost/45917] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:20,189 INFO [Listener at localhost/45917] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:20,190 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-09 12:03:20,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36247] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-09 12:03:20,199 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/fc93a9dbe44dab8e3d7c7b74ab677eef 2023-02-09 12:03:20,199 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/e9940616385adfef1b4a360461e5f6aa 2023-02-09 12:03:20,199 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/47f38db786eccf0b6b5d6e2a84049446 2023-02-09 12:03:20,199 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/0f9ec56206c8a4a22ea16c5e609aa91e 2023-02-09 12:03:20,199 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/fa5605bcfd9107cd3d59527f4cebc62e 2023-02-09 12:03:20,199 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/afaa39f80fc4e48681467bdcafa36d2f 2023-02-09 12:03:20,199 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/c9287bd8c1c12cde6a38f884d6d1fbbb 2023-02-09 12:03:20,199 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/63c860f86a4badc3807b95d70675d9f2 2023-02-09 12:03:20,204 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/afaa39f80fc4e48681467bdcafa36d2f/f1, FileablePath, hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/afaa39f80fc4e48681467bdcafa36d2f/f2, FileablePath, hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/afaa39f80fc4e48681467bdcafa36d2f/recovered.edits] 2023-02-09 12:03:20,204 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/fc93a9dbe44dab8e3d7c7b74ab677eef/f1, FileablePath, hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/fc93a9dbe44dab8e3d7c7b74ab677eef/f2, FileablePath, hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/fc93a9dbe44dab8e3d7c7b74ab677eef/recovered.edits] 2023-02-09 12:03:20,205 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/0f9ec56206c8a4a22ea16c5e609aa91e/f1, FileablePath, hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/0f9ec56206c8a4a22ea16c5e609aa91e/f2, FileablePath, hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/0f9ec56206c8a4a22ea16c5e609aa91e/recovered.edits] 2023-02-09 12:03:20,205 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/fa5605bcfd9107cd3d59527f4cebc62e/f1, FileablePath, hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/fa5605bcfd9107cd3d59527f4cebc62e/f2, FileablePath, hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/fa5605bcfd9107cd3d59527f4cebc62e/recovered.edits] 2023-02-09 12:03:20,206 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/47f38db786eccf0b6b5d6e2a84049446/f1, FileablePath, hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/47f38db786eccf0b6b5d6e2a84049446/f2, FileablePath, hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/47f38db786eccf0b6b5d6e2a84049446/recovered.edits] 2023-02-09 12:03:20,206 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/e9940616385adfef1b4a360461e5f6aa/f1, FileablePath, hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/e9940616385adfef1b4a360461e5f6aa/f2, FileablePath, hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/e9940616385adfef1b4a360461e5f6aa/recovered.edits] 2023-02-09 12:03:20,206 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/c9287bd8c1c12cde6a38f884d6d1fbbb/f1, FileablePath, hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/c9287bd8c1c12cde6a38f884d6d1fbbb/f2, FileablePath, hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/c9287bd8c1c12cde6a38f884d6d1fbbb/recovered.edits] 2023-02-09 12:03:20,207 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/63c860f86a4badc3807b95d70675d9f2/f1, FileablePath, hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/63c860f86a4badc3807b95d70675d9f2/f2, FileablePath, hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/63c860f86a4badc3807b95d70675d9f2/recovered.edits] 2023-02-09 12:03:20,214 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/63c860f86a4badc3807b95d70675d9f2/f1/49bcf0e4eb2f4cedaf1a96860f156b39 to hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/archive/data/default/testWithMockedMapReduceMultiRegion/63c860f86a4badc3807b95d70675d9f2/f1/49bcf0e4eb2f4cedaf1a96860f156b39 2023-02-09 12:03:20,215 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/0f9ec56206c8a4a22ea16c5e609aa91e/f1/7745e4e0d53045c8bf7543e500d089ce to hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/archive/data/default/testWithMockedMapReduceMultiRegion/0f9ec56206c8a4a22ea16c5e609aa91e/f1/7745e4e0d53045c8bf7543e500d089ce 2023-02-09 12:03:20,215 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/fa5605bcfd9107cd3d59527f4cebc62e/f1/7e583d31e28e4a1e917a7e4d60c2c99a to hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/archive/data/default/testWithMockedMapReduceMultiRegion/fa5605bcfd9107cd3d59527f4cebc62e/f1/7e583d31e28e4a1e917a7e4d60c2c99a 2023-02-09 12:03:20,216 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/c9287bd8c1c12cde6a38f884d6d1fbbb/f1/2b66780410cf44c2915d3878c4508012 to hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/archive/data/default/testWithMockedMapReduceMultiRegion/c9287bd8c1c12cde6a38f884d6d1fbbb/f1/2b66780410cf44c2915d3878c4508012 2023-02-09 12:03:20,216 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/afaa39f80fc4e48681467bdcafa36d2f/f1/45667bdb0bae410fb9518dfbea89c676 to hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/archive/data/default/testWithMockedMapReduceMultiRegion/afaa39f80fc4e48681467bdcafa36d2f/f1/45667bdb0bae410fb9518dfbea89c676 2023-02-09 12:03:20,216 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/e9940616385adfef1b4a360461e5f6aa/f1/bcdb11218c9f46cf8c299011dd9e4b42 to hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/archive/data/default/testWithMockedMapReduceMultiRegion/e9940616385adfef1b4a360461e5f6aa/f1/bcdb11218c9f46cf8c299011dd9e4b42 2023-02-09 12:03:20,216 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/47f38db786eccf0b6b5d6e2a84049446/f1/9a868e1c73ca48b1b00b08c882a075e5 to hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/archive/data/default/testWithMockedMapReduceMultiRegion/47f38db786eccf0b6b5d6e2a84049446/f1/9a868e1c73ca48b1b00b08c882a075e5 2023-02-09 12:03:20,218 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/fa5605bcfd9107cd3d59527f4cebc62e/f1/987c61d18e724e1db2a84a9e6a904801 to hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/archive/data/default/testWithMockedMapReduceMultiRegion/fa5605bcfd9107cd3d59527f4cebc62e/f1/987c61d18e724e1db2a84a9e6a904801 2023-02-09 12:03:20,218 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/63c860f86a4badc3807b95d70675d9f2/f1/bcb108f353b74ee88d5f54a27b08c4ea to hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/archive/data/default/testWithMockedMapReduceMultiRegion/63c860f86a4badc3807b95d70675d9f2/f1/bcb108f353b74ee88d5f54a27b08c4ea 2023-02-09 12:03:20,218 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/0f9ec56206c8a4a22ea16c5e609aa91e/f1/c6b7bfc862ed4bbca181f39553232046 to hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/archive/data/default/testWithMockedMapReduceMultiRegion/0f9ec56206c8a4a22ea16c5e609aa91e/f1/c6b7bfc862ed4bbca181f39553232046 2023-02-09 12:03:20,218 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/c9287bd8c1c12cde6a38f884d6d1fbbb/f1/f882f9e0a80042a2adb0884d6f9b155b to hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/archive/data/default/testWithMockedMapReduceMultiRegion/c9287bd8c1c12cde6a38f884d6d1fbbb/f1/f882f9e0a80042a2adb0884d6f9b155b 2023-02-09 12:03:20,219 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/afaa39f80fc4e48681467bdcafa36d2f/f1/ae246e93eb144c0796619499bb32b656 to hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/archive/data/default/testWithMockedMapReduceMultiRegion/afaa39f80fc4e48681467bdcafa36d2f/f1/ae246e93eb144c0796619499bb32b656 2023-02-09 12:03:20,219 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/fc93a9dbe44dab8e3d7c7b74ab677eef/recovered.edits/6.seqid to hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/archive/data/default/testWithMockedMapReduceMultiRegion/fc93a9dbe44dab8e3d7c7b74ab677eef/recovered.edits/6.seqid 2023-02-09 12:03:20,220 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/47f38db786eccf0b6b5d6e2a84049446/f1/e250ef82050641a290816ee9cb8c12ee to hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/archive/data/default/testWithMockedMapReduceMultiRegion/47f38db786eccf0b6b5d6e2a84049446/f1/e250ef82050641a290816ee9cb8c12ee 2023-02-09 12:03:20,220 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/fc93a9dbe44dab8e3d7c7b74ab677eef 2023-02-09 12:03:20,220 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/e9940616385adfef1b4a360461e5f6aa/f1/f140e052de8c49e7b37c74f2a79ceaf0 to hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/archive/data/default/testWithMockedMapReduceMultiRegion/e9940616385adfef1b4a360461e5f6aa/f1/f140e052de8c49e7b37c74f2a79ceaf0 2023-02-09 12:03:20,220 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/b99c55f7f2e0c44b0df4935d019d297c 2023-02-09 12:03:20,224 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/63c860f86a4badc3807b95d70675d9f2/f2/3a89b2a2855445ea92262d7d26e17039 to hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/archive/data/default/testWithMockedMapReduceMultiRegion/63c860f86a4badc3807b95d70675d9f2/f2/3a89b2a2855445ea92262d7d26e17039 2023-02-09 12:03:20,225 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/b99c55f7f2e0c44b0df4935d019d297c/f1, FileablePath, hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/b99c55f7f2e0c44b0df4935d019d297c/f2, FileablePath, hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/b99c55f7f2e0c44b0df4935d019d297c/recovered.edits] 2023-02-09 12:03:20,226 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/fa5605bcfd9107cd3d59527f4cebc62e/f2/52439242bcef409e9eba30d4bb0b203f to hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/archive/data/default/testWithMockedMapReduceMultiRegion/fa5605bcfd9107cd3d59527f4cebc62e/f2/52439242bcef409e9eba30d4bb0b203f 2023-02-09 12:03:20,226 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/afaa39f80fc4e48681467bdcafa36d2f/f2/40dfc38126d2460f857d68fc85e45ce2 to hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/archive/data/default/testWithMockedMapReduceMultiRegion/afaa39f80fc4e48681467bdcafa36d2f/f2/40dfc38126d2460f857d68fc85e45ce2 2023-02-09 12:03:20,226 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/0f9ec56206c8a4a22ea16c5e609aa91e/f2/f9c4ac2febfc4e5b9a43d7db215d27a6 to hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/archive/data/default/testWithMockedMapReduceMultiRegion/0f9ec56206c8a4a22ea16c5e609aa91e/f2/f9c4ac2febfc4e5b9a43d7db215d27a6 2023-02-09 12:03:20,227 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/63c860f86a4badc3807b95d70675d9f2/f2/bb51a85678c242a391d763a9944f1f4f to hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/archive/data/default/testWithMockedMapReduceMultiRegion/63c860f86a4badc3807b95d70675d9f2/f2/bb51a85678c242a391d763a9944f1f4f 2023-02-09 12:03:20,227 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/47f38db786eccf0b6b5d6e2a84049446/f2/083e48d50b6b45ecad79c9eea6bb0380 to hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/archive/data/default/testWithMockedMapReduceMultiRegion/47f38db786eccf0b6b5d6e2a84049446/f2/083e48d50b6b45ecad79c9eea6bb0380 2023-02-09 12:03:20,227 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/c9287bd8c1c12cde6a38f884d6d1fbbb/f2/26d95beeb35a4408bb773da53399c110 to hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/archive/data/default/testWithMockedMapReduceMultiRegion/c9287bd8c1c12cde6a38f884d6d1fbbb/f2/26d95beeb35a4408bb773da53399c110 2023-02-09 12:03:20,228 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/e9940616385adfef1b4a360461e5f6aa/f2/0ab74d50238540b885d761b90bf75a42 to hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/archive/data/default/testWithMockedMapReduceMultiRegion/e9940616385adfef1b4a360461e5f6aa/f2/0ab74d50238540b885d761b90bf75a42 2023-02-09 12:03:20,228 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/afaa39f80fc4e48681467bdcafa36d2f/f2/6e02aeced4fc4f839841173f00e80dd6 to hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/archive/data/default/testWithMockedMapReduceMultiRegion/afaa39f80fc4e48681467bdcafa36d2f/f2/6e02aeced4fc4f839841173f00e80dd6 2023-02-09 12:03:20,228 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/0f9ec56206c8a4a22ea16c5e609aa91e/f2/fa427154844642f3968726ae9a652297 to hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/archive/data/default/testWithMockedMapReduceMultiRegion/0f9ec56206c8a4a22ea16c5e609aa91e/f2/fa427154844642f3968726ae9a652297 2023-02-09 12:03:20,229 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/fa5605bcfd9107cd3d59527f4cebc62e/f2/71bc7297758042f89cfaf51eafa90f6c to hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/archive/data/default/testWithMockedMapReduceMultiRegion/fa5605bcfd9107cd3d59527f4cebc62e/f2/71bc7297758042f89cfaf51eafa90f6c 2023-02-09 12:03:20,230 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/c9287bd8c1c12cde6a38f884d6d1fbbb/f2/3beb1a5dc3d248af8e5e46f033f10e80 to hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/archive/data/default/testWithMockedMapReduceMultiRegion/c9287bd8c1c12cde6a38f884d6d1fbbb/f2/3beb1a5dc3d248af8e5e46f033f10e80 2023-02-09 12:03:20,230 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/47f38db786eccf0b6b5d6e2a84049446/f2/572c04a36d754e8f915f0b3a3764b53f to hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/archive/data/default/testWithMockedMapReduceMultiRegion/47f38db786eccf0b6b5d6e2a84049446/f2/572c04a36d754e8f915f0b3a3764b53f 2023-02-09 12:03:20,231 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/e9940616385adfef1b4a360461e5f6aa/f2/d507caa9ec4d419880719935795c2df7 to hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/archive/data/default/testWithMockedMapReduceMultiRegion/e9940616385adfef1b4a360461e5f6aa/f2/d507caa9ec4d419880719935795c2df7 2023-02-09 12:03:20,233 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/63c860f86a4badc3807b95d70675d9f2/recovered.edits/12.seqid to hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/archive/data/default/testWithMockedMapReduceMultiRegion/63c860f86a4badc3807b95d70675d9f2/recovered.edits/12.seqid 2023-02-09 12:03:20,234 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/63c860f86a4badc3807b95d70675d9f2 2023-02-09 12:03:20,234 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/f16214bbc54fdfa480400f03bb3486f8 2023-02-09 12:03:20,234 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/b99c55f7f2e0c44b0df4935d019d297c/f1/94cd398824534c0cbe7c23903f2c0000 to hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/archive/data/default/testWithMockedMapReduceMultiRegion/b99c55f7f2e0c44b0df4935d019d297c/f1/94cd398824534c0cbe7c23903f2c0000 2023-02-09 12:03:20,234 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/afaa39f80fc4e48681467bdcafa36d2f/recovered.edits/12.seqid to hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/archive/data/default/testWithMockedMapReduceMultiRegion/afaa39f80fc4e48681467bdcafa36d2f/recovered.edits/12.seqid 2023-02-09 12:03:20,235 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/0f9ec56206c8a4a22ea16c5e609aa91e/recovered.edits/12.seqid to hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/archive/data/default/testWithMockedMapReduceMultiRegion/0f9ec56206c8a4a22ea16c5e609aa91e/recovered.edits/12.seqid 2023-02-09 12:03:20,235 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/fa5605bcfd9107cd3d59527f4cebc62e/recovered.edits/12.seqid to hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/archive/data/default/testWithMockedMapReduceMultiRegion/fa5605bcfd9107cd3d59527f4cebc62e/recovered.edits/12.seqid 2023-02-09 12:03:20,235 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/afaa39f80fc4e48681467bdcafa36d2f 2023-02-09 12:03:20,236 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/0f9ec56206c8a4a22ea16c5e609aa91e 2023-02-09 12:03:20,236 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/fa5605bcfd9107cd3d59527f4cebc62e 2023-02-09 12:03:20,236 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/c9287bd8c1c12cde6a38f884d6d1fbbb/recovered.edits/12.seqid to hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/archive/data/default/testWithMockedMapReduceMultiRegion/c9287bd8c1c12cde6a38f884d6d1fbbb/recovered.edits/12.seqid 2023-02-09 12:03:20,237 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/b99c55f7f2e0c44b0df4935d019d297c/f1/ce72ff2589934ac38e7b916f22a95c85 to hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/archive/data/default/testWithMockedMapReduceMultiRegion/b99c55f7f2e0c44b0df4935d019d297c/f1/ce72ff2589934ac38e7b916f22a95c85 2023-02-09 12:03:20,237 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/c9287bd8c1c12cde6a38f884d6d1fbbb 2023-02-09 12:03:20,237 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/47f38db786eccf0b6b5d6e2a84049446/recovered.edits/12.seqid to hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/archive/data/default/testWithMockedMapReduceMultiRegion/47f38db786eccf0b6b5d6e2a84049446/recovered.edits/12.seqid 2023-02-09 12:03:20,237 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/f16214bbc54fdfa480400f03bb3486f8/f1, FileablePath, hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/f16214bbc54fdfa480400f03bb3486f8/f2, FileablePath, hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/f16214bbc54fdfa480400f03bb3486f8/recovered.edits] 2023-02-09 12:03:20,237 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/e9940616385adfef1b4a360461e5f6aa/recovered.edits/12.seqid to hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/archive/data/default/testWithMockedMapReduceMultiRegion/e9940616385adfef1b4a360461e5f6aa/recovered.edits/12.seqid 2023-02-09 12:03:20,238 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/47f38db786eccf0b6b5d6e2a84049446 2023-02-09 12:03:20,240 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/e9940616385adfef1b4a360461e5f6aa 2023-02-09 12:03:20,242 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/b99c55f7f2e0c44b0df4935d019d297c/f2/060cf4f6ef4c41ceaf4a88c27e5315f9 to hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/archive/data/default/testWithMockedMapReduceMultiRegion/b99c55f7f2e0c44b0df4935d019d297c/f2/060cf4f6ef4c41ceaf4a88c27e5315f9 2023-02-09 12:03:20,243 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/b99c55f7f2e0c44b0df4935d019d297c/f2/63f4561ad5ed4c74a59322bdaef7255d to hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/archive/data/default/testWithMockedMapReduceMultiRegion/b99c55f7f2e0c44b0df4935d019d297c/f2/63f4561ad5ed4c74a59322bdaef7255d 2023-02-09 12:03:20,244 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/f16214bbc54fdfa480400f03bb3486f8/recovered.edits/6.seqid to hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/archive/data/default/testWithMockedMapReduceMultiRegion/f16214bbc54fdfa480400f03bb3486f8/recovered.edits/6.seqid 2023-02-09 12:03:20,244 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/f16214bbc54fdfa480400f03bb3486f8 2023-02-09 12:03:20,245 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/b99c55f7f2e0c44b0df4935d019d297c/recovered.edits/12.seqid to hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/archive/data/default/testWithMockedMapReduceMultiRegion/b99c55f7f2e0c44b0df4935d019d297c/recovered.edits/12.seqid 2023-02-09 12:03:20,246 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/.tmp/data/default/testWithMockedMapReduceMultiRegion/b99c55f7f2e0c44b0df4935d019d297c 2023-02-09 12:03:20,246 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-09 12:03:20,248 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-09 12:03:20,251 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMockedMapReduceMultiRegion from hbase:meta 2023-02-09 12:03:20,253 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceMultiRegion' descriptor. 2023-02-09 12:03:20,254 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-09 12:03:20,254 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceMultiRegion' from region states. 2023-02-09 12:03:20,254 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,,1675944196408.fc93a9dbe44dab8e3d7c7b74ab677eef.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675944200254"}]},"ts":"9223372036854775807"} 2023-02-09 12:03:20,254 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,aaa,1675944196408.e9940616385adfef1b4a360461e5f6aa.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675944200254"}]},"ts":"9223372036854775807"} 2023-02-09 12:03:20,254 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1675944196408.63c860f86a4badc3807b95d70675d9f2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675944200254"}]},"ts":"9223372036854775807"} 2023-02-09 12:03:20,254 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1675944196408.c9287bd8c1c12cde6a38f884d6d1fbbb.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675944200254"}]},"ts":"9223372036854775807"} 2023-02-09 12:03:20,254 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1675944196408.afaa39f80fc4e48681467bdcafa36d2f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675944200254"}]},"ts":"9223372036854775807"} 2023-02-09 12:03:20,254 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1675944196408.fa5605bcfd9107cd3d59527f4cebc62e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675944200254"}]},"ts":"9223372036854775807"} 2023-02-09 12:03:20,255 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1675944196408.47f38db786eccf0b6b5d6e2a84049446.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675944200254"}]},"ts":"9223372036854775807"} 2023-02-09 12:03:20,255 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,t43,1675944196408.0f9ec56206c8a4a22ea16c5e609aa91e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675944200254"}]},"ts":"9223372036854775807"} 2023-02-09 12:03:20,255 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,wWV,1675944196408.b99c55f7f2e0c44b0df4935d019d297c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675944200254"}]},"ts":"9223372036854775807"} 2023-02-09 12:03:20,255 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,zz{,1675944196408.f16214bbc54fdfa480400f03bb3486f8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675944200254"}]},"ts":"9223372036854775807"} 2023-02-09 12:03:20,257 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-09 12:03:20,257 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => fc93a9dbe44dab8e3d7c7b74ab677eef, NAME => 'testWithMockedMapReduceMultiRegion,,1675944196408.fc93a9dbe44dab8e3d7c7b74ab677eef.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => e9940616385adfef1b4a360461e5f6aa, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1675944196408.e9940616385adfef1b4a360461e5f6aa.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => 63c860f86a4badc3807b95d70675d9f2, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1675944196408.63c860f86a4badc3807b95d70675d9f2.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => c9287bd8c1c12cde6a38f884d6d1fbbb, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675944196408.c9287bd8c1c12cde6a38f884d6d1fbbb.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => afaa39f80fc4e48681467bdcafa36d2f, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675944196408.afaa39f80fc4e48681467bdcafa36d2f.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => fa5605bcfd9107cd3d59527f4cebc62e, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1675944196408.fa5605bcfd9107cd3d59527f4cebc62e.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => 47f38db786eccf0b6b5d6e2a84049446, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1675944196408.47f38db786eccf0b6b5d6e2a84049446.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => 0f9ec56206c8a4a22ea16c5e609aa91e, NAME => 'testWithMockedMapReduceMultiRegion,t43,1675944196408.0f9ec56206c8a4a22ea16c5e609aa91e.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => b99c55f7f2e0c44b0df4935d019d297c, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1675944196408.b99c55f7f2e0c44b0df4935d019d297c.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => f16214bbc54fdfa480400f03bb3486f8, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1675944196408.f16214bbc54fdfa480400f03bb3486f8.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-09 12:03:20,257 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceMultiRegion' as deleted. 2023-02-09 12:03:20,257 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1675944200257"}]},"ts":"9223372036854775807"} 2023-02-09 12:03:20,258 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceMultiRegion state from META 2023-02-09 12:03:20,260 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-09 12:03:20,261 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion in 73 msec 2023-02-09 12:03:20,290 INFO [Listener at localhost/45917] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:20,291 INFO [Listener at localhost/45917] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:20,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36247] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-09 12:03:20,292 INFO [Listener at localhost/45917] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 54 completed 2023-02-09 12:03:20,292 INFO [Listener at localhost/45917] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-09 12:03:20,292 INFO [Listener at localhost/45917] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-09 12:03:20,292 DEBUG [Listener at localhost/45917] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1e849cf9 to 127.0.0.1:62567 2023-02-09 12:03:20,293 DEBUG [Listener at localhost/45917] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 12:03:20,293 DEBUG [Listener at localhost/45917] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-09 12:03:20,293 DEBUG [Listener at localhost/45917] util.JVMClusterUtil(257): Found active master hash=153293241, stopped=false 2023-02-09 12:03:20,293 INFO [Listener at localhost/45917] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,36247,1675944195090 2023-02-09 12:03:20,296 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): regionserver:36427-0x10038f6ddbf0001, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 12:03:20,296 INFO [Listener at localhost/45917] procedure2.ProcedureExecutor(629): Stopping 2023-02-09 12:03:20,296 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 12:03:20,296 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 12:03:20,296 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): regionserver:36313-0x10038f6ddbf0002, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 12:03:20,298 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36427-0x10038f6ddbf0001, quorum=127.0.0.1:62567, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 12:03:20,298 DEBUG [Listener at localhost/45917] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x687f995a to 127.0.0.1:62567 2023-02-09 12:03:20,298 DEBUG [Listener at localhost/45917] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 12:03:20,298 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 12:03:20,298 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36313-0x10038f6ddbf0002, quorum=127.0.0.1:62567, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 12:03:20,298 INFO [Listener at localhost/45917] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,36427,1675944195143' ***** 2023-02-09 12:03:20,298 INFO [Listener at localhost/45917] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-09 12:03:20,298 INFO [Listener at localhost/45917] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,36313,1675944195173' ***** 2023-02-09 12:03:20,298 INFO [Listener at localhost/45917] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-09 12:03:20,299 INFO [RS:0;jenkins-hbase4:36427] regionserver.HeapMemoryManager(220): Stopping 2023-02-09 12:03:20,299 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-09 12:03:20,299 INFO [RS:0;jenkins-hbase4:36427] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-09 12:03:20,299 INFO [RS:1;jenkins-hbase4:36313] regionserver.HeapMemoryManager(220): Stopping 2023-02-09 12:03:20,300 INFO [RS:0;jenkins-hbase4:36427] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-09 12:03:20,300 INFO [RS:1;jenkins-hbase4:36313] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-09 12:03:20,300 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-09 12:03:20,300 INFO [RS:0;jenkins-hbase4:36427] regionserver.HRegionServer(3304): Received CLOSE for 12fbf7cab2a9a9b03d763d819172cf87 2023-02-09 12:03:20,300 INFO [RS:1;jenkins-hbase4:36313] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-09 12:03:20,301 INFO [RS:0;jenkins-hbase4:36427] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,36427,1675944195143 2023-02-09 12:03:20,301 INFO [RS:1;jenkins-hbase4:36313] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,36313,1675944195173 2023-02-09 12:03:20,302 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 12fbf7cab2a9a9b03d763d819172cf87, disabling compactions & flushes 2023-02-09 12:03:20,302 DEBUG [RS:1;jenkins-hbase4:36313] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x502eb045 to 127.0.0.1:62567 2023-02-09 12:03:20,302 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675944195755.12fbf7cab2a9a9b03d763d819172cf87. 2023-02-09 12:03:20,302 DEBUG [RS:0;jenkins-hbase4:36427] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x49d184ca to 127.0.0.1:62567 2023-02-09 12:03:20,302 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675944195755.12fbf7cab2a9a9b03d763d819172cf87. 2023-02-09 12:03:20,302 DEBUG [RS:0;jenkins-hbase4:36427] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 12:03:20,302 DEBUG [RS:1;jenkins-hbase4:36313] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 12:03:20,302 INFO [RS:0;jenkins-hbase4:36427] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-09 12:03:20,302 INFO [RS:1;jenkins-hbase4:36313] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-09 12:03:20,302 INFO [RS:1;jenkins-hbase4:36313] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-09 12:03:20,302 INFO [RS:1;jenkins-hbase4:36313] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-09 12:03:20,302 DEBUG [RS:0;jenkins-hbase4:36427] regionserver.HRegionServer(1479): Online Regions={12fbf7cab2a9a9b03d763d819172cf87=hbase:namespace,,1675944195755.12fbf7cab2a9a9b03d763d819172cf87.} 2023-02-09 12:03:20,302 INFO [RS:1;jenkins-hbase4:36313] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-09 12:03:20,302 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675944195755.12fbf7cab2a9a9b03d763d819172cf87. after waiting 0 ms 2023-02-09 12:03:20,302 DEBUG [RS:0;jenkins-hbase4:36427] regionserver.HRegionServer(1505): Waiting on 12fbf7cab2a9a9b03d763d819172cf87 2023-02-09 12:03:20,302 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675944195755.12fbf7cab2a9a9b03d763d819172cf87. 2023-02-09 12:03:20,302 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 12fbf7cab2a9a9b03d763d819172cf87 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-09 12:03:20,303 INFO [RS:1;jenkins-hbase4:36313] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-09 12:03:20,303 DEBUG [RS:1;jenkins-hbase4:36313] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-09 12:03:20,303 DEBUG [RS:1;jenkins-hbase4:36313] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-09 12:03:20,305 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-09 12:03:20,305 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-09 12:03:20,305 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-09 12:03:20,305 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-09 12:03:20,305 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-09 12:03:20,305 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=28.36 KB heapSize=44.48 KB 2023-02-09 12:03:20,312 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/hbase/namespace/12fbf7cab2a9a9b03d763d819172cf87/.tmp/info/08bf3bf28cd24b7498be7ae8804bc521 2023-02-09 12:03:20,313 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=25.73 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/hbase/meta/1588230740/.tmp/info/fbf37cbc1648477c99f24f933aac19ff 2023-02-09 12:03:20,316 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fbf37cbc1648477c99f24f933aac19ff 2023-02-09 12:03:20,317 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/hbase/namespace/12fbf7cab2a9a9b03d763d819172cf87/.tmp/info/08bf3bf28cd24b7498be7ae8804bc521 as hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/hbase/namespace/12fbf7cab2a9a9b03d763d819172cf87/info/08bf3bf28cd24b7498be7ae8804bc521 2023-02-09 12:03:20,321 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/hbase/namespace/12fbf7cab2a9a9b03d763d819172cf87/info/08bf3bf28cd24b7498be7ae8804bc521, entries=2, sequenceid=6, filesize=4.8 K 2023-02-09 12:03:20,322 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 12fbf7cab2a9a9b03d763d819172cf87 in 20ms, sequenceid=6, compaction requested=false 2023-02-09 12:03:20,325 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.14 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/hbase/meta/1588230740/.tmp/rep_barrier/071cdf71d4a44f059fa70784eb58989b 2023-02-09 12:03:20,326 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/hbase/namespace/12fbf7cab2a9a9b03d763d819172cf87/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-09 12:03:20,328 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675944195755.12fbf7cab2a9a9b03d763d819172cf87. 2023-02-09 12:03:20,328 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 12fbf7cab2a9a9b03d763d819172cf87: Waiting for close lock at 1675944200301Running coprocessor pre-close hooks at 1675944200301Disabling compacts and flushes for region at 1675944200301Disabling writes for close at 1675944200302 (+1 ms)Obtaining lock to block concurrent updates at 1675944200302Preparing flush snapshotting stores in 12fbf7cab2a9a9b03d763d819172cf87 at 1675944200302Finished memstore snapshotting hbase:namespace,,1675944195755.12fbf7cab2a9a9b03d763d819172cf87., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1675944200303 (+1 ms)Flushing stores of hbase:namespace,,1675944195755.12fbf7cab2a9a9b03d763d819172cf87. at 1675944200305 (+2 ms)Flushing 12fbf7cab2a9a9b03d763d819172cf87/info: creating writer at 1675944200305Flushing 12fbf7cab2a9a9b03d763d819172cf87/info: appending metadata at 1675944200307 (+2 ms)Flushing 12fbf7cab2a9a9b03d763d819172cf87/info: closing flushed file at 1675944200307Flushing 12fbf7cab2a9a9b03d763d819172cf87/info: reopening flushed file at 1675944200317 (+10 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 12fbf7cab2a9a9b03d763d819172cf87 in 20ms, sequenceid=6, compaction requested=false at 1675944200322 (+5 ms)Writing region close event to WAL at 1675944200324 (+2 ms)Running coprocessor post-close hooks at 1675944200327 (+3 ms)Closed at 1675944200328 (+1 ms) 2023-02-09 12:03:20,328 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1675944195755.12fbf7cab2a9a9b03d763d819172cf87. 2023-02-09 12:03:20,330 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 071cdf71d4a44f059fa70784eb58989b 2023-02-09 12:03:20,337 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.49 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/hbase/meta/1588230740/.tmp/table/f19b889aa5be42a9801bd8f9a8d82b42 2023-02-09 12:03:20,341 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f19b889aa5be42a9801bd8f9a8d82b42 2023-02-09 12:03:20,342 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/hbase/meta/1588230740/.tmp/info/fbf37cbc1648477c99f24f933aac19ff as hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/hbase/meta/1588230740/info/fbf37cbc1648477c99f24f933aac19ff 2023-02-09 12:03:20,346 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fbf37cbc1648477c99f24f933aac19ff 2023-02-09 12:03:20,346 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/hbase/meta/1588230740/info/fbf37cbc1648477c99f24f933aac19ff, entries=30, sequenceid=57, filesize=8.3 K 2023-02-09 12:03:20,347 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/hbase/meta/1588230740/.tmp/rep_barrier/071cdf71d4a44f059fa70784eb58989b as hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/hbase/meta/1588230740/rep_barrier/071cdf71d4a44f059fa70784eb58989b 2023-02-09 12:03:20,351 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 071cdf71d4a44f059fa70784eb58989b 2023-02-09 12:03:20,351 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/hbase/meta/1588230740/rep_barrier/071cdf71d4a44f059fa70784eb58989b, entries=10, sequenceid=57, filesize=6.1 K 2023-02-09 12:03:20,352 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/hbase/meta/1588230740/.tmp/table/f19b889aa5be42a9801bd8f9a8d82b42 as hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/hbase/meta/1588230740/table/f19b889aa5be42a9801bd8f9a8d82b42 2023-02-09 12:03:20,356 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f19b889aa5be42a9801bd8f9a8d82b42 2023-02-09 12:03:20,356 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/hbase/meta/1588230740/table/f19b889aa5be42a9801bd8f9a8d82b42, entries=13, sequenceid=57, filesize=6.1 K 2023-02-09 12:03:20,357 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~28.36 KB/29041, heapSize ~44.44 KB/45504, currentSize=0 B/0 for 1588230740 in 52ms, sequenceid=57, compaction requested=false 2023-02-09 12:03:20,360 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-09 12:03:20,361 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-09 12:03:20,362 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-09 12:03:20,362 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675944200303Running coprocessor pre-close hooks at 1675944200303Disabling compacts and flushes for region at 1675944200303Disabling writes for close at 1675944200305 (+2 ms)Obtaining lock to block concurrent updates at 1675944200305Preparing flush snapshotting stores in 1588230740 at 1675944200305Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=29041, getHeapSize=45504, getOffHeapSize=0, getCellsCount=207 at 1675944200305Flushing stores of hbase:meta,,1.1588230740 at 1675944200306 (+1 ms)Flushing 1588230740/info: creating writer at 1675944200306Flushing 1588230740/info: appending metadata at 1675944200308 (+2 ms)Flushing 1588230740/info: closing flushed file at 1675944200308Flushing 1588230740/rep_barrier: creating writer at 1675944200316 (+8 ms)Flushing 1588230740/rep_barrier: appending metadata at 1675944200318 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1675944200318Flushing 1588230740/table: creating writer at 1675944200330 (+12 ms)Flushing 1588230740/table: appending metadata at 1675944200332 (+2 ms)Flushing 1588230740/table: closing flushed file at 1675944200332Flushing 1588230740/info: reopening flushed file at 1675944200343 (+11 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1675944200348 (+5 ms)Flushing 1588230740/table: reopening flushed file at 1675944200352 (+4 ms)Finished flush of dataSize ~28.36 KB/29041, heapSize ~44.44 KB/45504, currentSize=0 B/0 for 1588230740 in 52ms, sequenceid=57, compaction requested=false at 1675944200357 (+5 ms)Writing region close event to WAL at 1675944200358 (+1 ms)Running coprocessor post-close hooks at 1675944200361 (+3 ms)Closed at 1675944200362 (+1 ms) 2023-02-09 12:03:20,362 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-09 12:03:20,377 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-09 12:03:20,377 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-09 12:03:20,450 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-09 12:03:20,450 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-09 12:03:20,454 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-09 12:03:20,454 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-09 12:03:20,502 INFO [RS:0;jenkins-hbase4:36427] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,36427,1675944195143; all regions closed. 2023-02-09 12:03:20,503 INFO [RS:1;jenkins-hbase4:36313] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,36313,1675944195173; all regions closed. 2023-02-09 12:03:20,505 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/WALs/jenkins-hbase4.apache.org,36313,1675944195173/jenkins-hbase4.apache.org%2C36313%2C1675944195173.meta.1675944195700.meta not finished, retry = 0 2023-02-09 12:03:20,506 DEBUG [RS:0;jenkins-hbase4:36427] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/oldWALs 2023-02-09 12:03:20,507 INFO [RS:0;jenkins-hbase4:36427] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36427%2C1675944195143:(num 1675944196126) 2023-02-09 12:03:20,507 DEBUG [RS:0;jenkins-hbase4:36427] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 12:03:20,507 INFO [RS:0;jenkins-hbase4:36427] regionserver.LeaseManager(133): Closed leases 2023-02-09 12:03:20,507 INFO [RS:0;jenkins-hbase4:36427] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-09 12:03:20,507 INFO [RS:0;jenkins-hbase4:36427] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-09 12:03:20,507 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 12:03:20,507 INFO [RS:0;jenkins-hbase4:36427] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-09 12:03:20,507 INFO [RS:0;jenkins-hbase4:36427] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-09 12:03:20,508 INFO [RS:0;jenkins-hbase4:36427] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36427 2023-02-09 12:03:20,510 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): regionserver:36427-0x10038f6ddbf0001, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36427,1675944195143 2023-02-09 12:03:20,510 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): regionserver:36313-0x10038f6ddbf0002, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36427,1675944195143 2023-02-09 12:03:20,510 ERROR [Listener at localhost/45917-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@10626d9a rejected from java.util.concurrent.ThreadPoolExecutor@145deb4e[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 12:03:20,511 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): regionserver:36313-0x10038f6ddbf0002, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 12:03:20,510 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 12:03:20,511 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): regionserver:36427-0x10038f6ddbf0001, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 12:03:20,511 ERROR [Listener at localhost/45917-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6349b9c4 rejected from java.util.concurrent.ThreadPoolExecutor@145deb4e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 12:03:20,511 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,36427,1675944195143] 2023-02-09 12:03:20,512 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,36427,1675944195143; numProcessing=1 2023-02-09 12:03:20,512 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,36427,1675944195143 already deleted, retry=false 2023-02-09 12:03:20,512 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,36427,1675944195143 expired; onlineServers=1 2023-02-09 12:03:20,607 DEBUG [RS:1;jenkins-hbase4:36313] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/oldWALs 2023-02-09 12:03:20,608 INFO [RS:1;jenkins-hbase4:36313] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36313%2C1675944195173.meta:.meta(num 1675944195700) 2023-02-09 12:03:20,611 DEBUG [RS:1;jenkins-hbase4:36313] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/oldWALs 2023-02-09 12:03:20,611 INFO [RS:1;jenkins-hbase4:36313] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36313%2C1675944195173:(num 1675944196474) 2023-02-09 12:03:20,611 DEBUG [RS:1;jenkins-hbase4:36313] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 12:03:20,611 INFO [RS:1;jenkins-hbase4:36313] regionserver.LeaseManager(133): Closed leases 2023-02-09 12:03:20,611 INFO [RS:1;jenkins-hbase4:36313] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-09 12:03:20,612 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 12:03:20,613 INFO [RS:1;jenkins-hbase4:36313] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36313 2023-02-09 12:03:20,615 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 12:03:20,615 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): regionserver:36313-0x10038f6ddbf0002, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36313,1675944195173 2023-02-09 12:03:20,615 ERROR [Listener at localhost/45917-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3c024ce4 rejected from java.util.concurrent.ThreadPoolExecutor@383dcfbc[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 12:03:20,616 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,36313,1675944195173] 2023-02-09 12:03:20,616 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,36313,1675944195173; numProcessing=2 2023-02-09 12:03:20,617 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,36313,1675944195173 already deleted, retry=false 2023-02-09 12:03:20,618 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,36313,1675944195173 expired; onlineServers=0 2023-02-09 12:03:20,618 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,36247,1675944195090' ***** 2023-02-09 12:03:20,618 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-09 12:03:20,618 DEBUG [M:0;jenkins-hbase4:36247] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@d1c9445, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 12:03:20,619 INFO [M:0;jenkins-hbase4:36247] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,36247,1675944195090 2023-02-09 12:03:20,619 INFO [M:0;jenkins-hbase4:36247] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,36247,1675944195090; all regions closed. 2023-02-09 12:03:20,619 DEBUG [M:0;jenkins-hbase4:36247] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 12:03:20,619 DEBUG [M:0;jenkins-hbase4:36247] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-09 12:03:20,619 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-09 12:03:20,619 DEBUG [M:0;jenkins-hbase4:36247] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-09 12:03:20,619 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675944195343] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675944195343,5,FailOnTimeoutGroup] 2023-02-09 12:03:20,619 INFO [M:0;jenkins-hbase4:36247] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-09 12:03:20,619 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675944195342] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675944195342,5,FailOnTimeoutGroup] 2023-02-09 12:03:20,620 INFO [M:0;jenkins-hbase4:36247] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-09 12:03:20,620 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-09 12:03:20,620 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 12:03:20,620 INFO [M:0;jenkins-hbase4:36247] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-09 12:03:20,620 DEBUG [M:0;jenkins-hbase4:36247] master.HMaster(1502): Stopping service threads 2023-02-09 12:03:20,620 INFO [M:0;jenkins-hbase4:36247] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-09 12:03:20,621 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 12:03:20,621 ERROR [M:0;jenkins-hbase4:36247] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-09 12:03:20,621 INFO [M:0;jenkins-hbase4:36247] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-09 12:03:20,621 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-09 12:03:20,622 DEBUG [M:0;jenkins-hbase4:36247] zookeeper.ZKUtil(398): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-09 12:03:20,622 WARN [M:0;jenkins-hbase4:36247] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-09 12:03:20,622 INFO [M:0;jenkins-hbase4:36247] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-09 12:03:20,622 INFO [M:0;jenkins-hbase4:36247] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-09 12:03:20,622 DEBUG [M:0;jenkins-hbase4:36247] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-09 12:03:20,622 INFO [M:0;jenkins-hbase4:36247] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 12:03:20,622 DEBUG [M:0;jenkins-hbase4:36247] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 12:03:20,622 DEBUG [M:0;jenkins-hbase4:36247] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-09 12:03:20,622 DEBUG [M:0;jenkins-hbase4:36247] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 12:03:20,622 INFO [M:0;jenkins-hbase4:36247] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=167.12 KB heapSize=200.04 KB 2023-02-09 12:03:20,631 INFO [M:0;jenkins-hbase4:36247] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=167.12 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/9f011fe4781b4186b58284b71f125310 2023-02-09 12:03:20,635 DEBUG [M:0;jenkins-hbase4:36247] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/9f011fe4781b4186b58284b71f125310 as hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/9f011fe4781b4186b58284b71f125310 2023-02-09 12:03:20,638 INFO [M:0;jenkins-hbase4:36247] regionserver.HStore(1080): Added hdfs://localhost:37789/user/jenkins/test-data/cd0c7b75-d39a-ac49-4b08-31dfca5af5f5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/9f011fe4781b4186b58284b71f125310, entries=53, sequenceid=357, filesize=10.7 K 2023-02-09 12:03:20,639 INFO [M:0;jenkins-hbase4:36247] regionserver.HRegion(2947): Finished flush of dataSize ~167.12 KB/171134, heapSize ~200.02 KB/204824, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 17ms, sequenceid=357, compaction requested=false 2023-02-09 12:03:20,640 INFO [M:0;jenkins-hbase4:36247] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 12:03:20,640 DEBUG [M:0;jenkins-hbase4:36247] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675944200622Disabling compacts and flushes for region at 1675944200622Disabling writes for close at 1675944200622Obtaining lock to block concurrent updates at 1675944200622Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1675944200622Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=171134, getHeapSize=204824, getOffHeapSize=0, getCellsCount=442 at 1675944200623 (+1 ms)Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1675944200623Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1675944200624 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1675944200626 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1675944200626Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1675944200635 (+9 ms)Finished flush of dataSize ~167.12 KB/171134, heapSize ~200.02 KB/204824, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 17ms, sequenceid=357, compaction requested=false at 1675944200639 (+4 ms)Writing region close event to WAL at 1675944200640 (+1 ms)Closed at 1675944200640 2023-02-09 12:03:20,642 INFO [M:0;jenkins-hbase4:36247] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-09 12:03:20,642 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 12:03:20,643 INFO [M:0;jenkins-hbase4:36247] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36247 2023-02-09 12:03:20,647 DEBUG [M:0;jenkins-hbase4:36247] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,36247,1675944195090 already deleted, retry=false 2023-02-09 12:03:20,799 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 12:03:20,799 INFO [M:0;jenkins-hbase4:36247] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,36247,1675944195090; zookeeper connection closed. 2023-02-09 12:03:20,799 ERROR [Listener at localhost/45917-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@410280d6 rejected from java.util.concurrent.ThreadPoolExecutor@453d0c2e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 56] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 12:03:20,800 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): master:36247-0x10038f6ddbf0000, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 12:03:20,800 ERROR [Listener at localhost/45917-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6424e223 rejected from java.util.concurrent.ThreadPoolExecutor@453d0c2e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 56] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 12:03:20,899 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): regionserver:36313-0x10038f6ddbf0002, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 12:03:20,899 INFO [RS:1;jenkins-hbase4:36313] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,36313,1675944195173; zookeeper connection closed. 2023-02-09 12:03:20,899 ERROR [Listener at localhost/45917-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@62436e70 rejected from java.util.concurrent.ThreadPoolExecutor@383dcfbc[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 12:03:20,899 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4696d588] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4696d588 2023-02-09 12:03:20,899 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): regionserver:36313-0x10038f6ddbf0002, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 12:03:20,899 ERROR [Listener at localhost/45917-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1a9e0da2 rejected from java.util.concurrent.ThreadPoolExecutor@383dcfbc[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 12:03:20,999 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): regionserver:36427-0x10038f6ddbf0001, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 12:03:20,999 INFO [RS:0;jenkins-hbase4:36427] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,36427,1675944195143; zookeeper connection closed. 2023-02-09 12:03:20,999 ERROR [Listener at localhost/45917-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1bb89657 rejected from java.util.concurrent.ThreadPoolExecutor@145deb4e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 12:03:20,999 DEBUG [Listener at localhost/45917-EventThread] zookeeper.ZKWatcher(600): regionserver:36427-0x10038f6ddbf0001, quorum=127.0.0.1:62567, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 12:03:20,999 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@6ac2ba4f] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@6ac2ba4f 2023-02-09 12:03:20,999 ERROR [Listener at localhost/45917-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1f59909d rejected from java.util.concurrent.ThreadPoolExecutor@145deb4e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 12:03:21,000 INFO [Listener at localhost/45917] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-09 12:03:21,001 WARN [Listener at localhost/45917] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-09 12:03:21,004 INFO [Listener at localhost/45917] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 12:03:21,047 WARN [BP-1298614035-172.31.14.131-1675944194511 heartbeating to localhost/127.0.0.1:37789] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1298614035-172.31.14.131-1675944194511 (Datanode Uuid 9e7edff9-9630-4e84-88ac-8475f0716e48) service to localhost/127.0.0.1:37789 2023-02-09 12:03:21,048 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/35ed02a8-f559-1c2d-13a8-c134fd0b88e5/cluster_c27b68cd-a75b-1a1f-0532-0158b09d8a10/dfs/data/data3/current/BP-1298614035-172.31.14.131-1675944194511] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 12:03:21,048 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/35ed02a8-f559-1c2d-13a8-c134fd0b88e5/cluster_c27b68cd-a75b-1a1f-0532-0158b09d8a10/dfs/data/data4/current/BP-1298614035-172.31.14.131-1675944194511] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 12:03:21,114 WARN [Listener at localhost/45917] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-09 12:03:21,117 INFO [Listener at localhost/45917] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 12:03:21,222 WARN [BP-1298614035-172.31.14.131-1675944194511 heartbeating to localhost/127.0.0.1:37789] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-09 12:03:21,222 WARN [BP-1298614035-172.31.14.131-1675944194511 heartbeating to localhost/127.0.0.1:37789] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1298614035-172.31.14.131-1675944194511 (Datanode Uuid 7dad4d72-e2b9-4796-a947-b9c64057bbde) service to localhost/127.0.0.1:37789 2023-02-09 12:03:21,223 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/35ed02a8-f559-1c2d-13a8-c134fd0b88e5/cluster_c27b68cd-a75b-1a1f-0532-0158b09d8a10/dfs/data/data1/current/BP-1298614035-172.31.14.131-1675944194511] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 12:03:21,223 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/35ed02a8-f559-1c2d-13a8-c134fd0b88e5/cluster_c27b68cd-a75b-1a1f-0532-0158b09d8a10/dfs/data/data2/current/BP-1298614035-172.31.14.131-1675944194511] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 12:03:21,236 INFO [Listener at localhost/45917] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 12:03:21,357 INFO [Listener at localhost/45917] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-09 12:03:21,413 INFO [Listener at localhost/45917] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-09 12:03:21,429 INFO [Listener at localhost/45917] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=231 (was 180) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:37789 from jenkins.hfs.6 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-12 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/45917.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-14-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:37789 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins@localhost:37789 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/45917 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/45917.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:37789 from jenkins.hfs.7 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-17-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-11 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.6@localhost:37789 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/45917.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/45917.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-16-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/45917.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-12-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/45917.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-14-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-10 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-16-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/45917.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LeaseRenewer:jenkins.hfs.7@localhost:37789 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:37789 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: (jenkins-hbase4.apache.org,36247,1675944195090)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-16-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/45917.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-14-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/45917.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-15-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/45917.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) - Thread LEAK? -, OpenFileDescriptor=637 (was 570) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=316 (was 318), ProcessCount=166 (was 166), AvailableMemoryMB=3260 (was 3334) 2023-02-09 12:03:21,439 INFO [Listener at localhost/45917] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=231, OpenFileDescriptor=637, MaxFileDescriptor=60000, SystemLoadAverage=316, ProcessCount=166, AvailableMemoryMB=3260 2023-02-09 12:03:21,450 INFO [Listener at localhost/45917] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/35ed02a8-f559-1c2d-13a8-c134fd0b88e5/hadoop.log.dir so I do NOT create it in target/test-data/ef2a5dd0-b40b-91f8-1c82-262fc51be60e 2023-02-09 12:03:21,450 WARN [Listener at localhost/45917] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/35ed02a8-f559-1c2d-13a8-c134fd0b88e5/hadoop.log.dir Erasing configuration value by system value. 2023-02-09 12:03:21,450 INFO [Listener at localhost/45917] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/35ed02a8-f559-1c2d-13a8-c134fd0b88e5/hadoop.tmp.dir so I do NOT create it in target/test-data/ef2a5dd0-b40b-91f8-1c82-262fc51be60e 2023-02-09 12:03:21,450 WARN [Listener at localhost/45917] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/35ed02a8-f559-1c2d-13a8-c134fd0b88e5/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-09 12:03:21,450 DEBUG [Listener at localhost/45917] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef2a5dd0-b40b-91f8-1c82-262fc51be60e 2023-02-09 12:03:21,450 INFO [Listener at localhost/45917] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-09 12:03:21,450 INFO [Listener at localhost/45917] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef2a5dd0-b40b-91f8-1c82-262fc51be60e/cluster_17860aa0-bd4a-34ed-6f2a-39980d330674, deleteOnExit=true 2023-02-09 12:03:21,450 INFO [Listener at localhost/45917] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-09 12:03:21,450 INFO [Listener at localhost/45917] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef2a5dd0-b40b-91f8-1c82-262fc51be60e/test.cache.data in system properties and HBase conf 2023-02-09 12:03:21,450 INFO [Listener at localhost/45917] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef2a5dd0-b40b-91f8-1c82-262fc51be60e/hadoop.tmp.dir in system properties and HBase conf 2023-02-09 12:03:21,451 INFO [Listener at localhost/45917] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef2a5dd0-b40b-91f8-1c82-262fc51be60e/hadoop.log.dir in system properties and HBase conf 2023-02-09 12:03:21,451 INFO [Listener at localhost/45917] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef2a5dd0-b40b-91f8-1c82-262fc51be60e/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-09 12:03:21,451 INFO [Listener at localhost/45917] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef2a5dd0-b40b-91f8-1c82-262fc51be60e/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-09 12:03:21,451 INFO [Listener at localhost/45917] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-09 12:03:21,451 DEBUG [Listener at localhost/45917] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-09 12:03:21,451 INFO [Listener at localhost/45917] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef2a5dd0-b40b-91f8-1c82-262fc51be60e/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-09 12:03:21,451 INFO [Listener at localhost/45917] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef2a5dd0-b40b-91f8-1c82-262fc51be60e/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-09 12:03:21,451 INFO [Listener at localhost/45917] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef2a5dd0-b40b-91f8-1c82-262fc51be60e/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-09 12:03:21,451 INFO [Listener at localhost/45917] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef2a5dd0-b40b-91f8-1c82-262fc51be60e/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-09 12:03:21,451 INFO [Listener at localhost/45917] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef2a5dd0-b40b-91f8-1c82-262fc51be60e/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-09 12:03:21,452 INFO [Listener at localhost/45917] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef2a5dd0-b40b-91f8-1c82-262fc51be60e/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-09 12:03:21,452 INFO [Listener at localhost/45917] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef2a5dd0-b40b-91f8-1c82-262fc51be60e/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-09 12:03:21,452 INFO [Listener at localhost/45917] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef2a5dd0-b40b-91f8-1c82-262fc51be60e/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-09 12:03:21,452 INFO [Listener at localhost/45917] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef2a5dd0-b40b-91f8-1c82-262fc51be60e/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-09 12:03:21,452 INFO [Listener at localhost/45917] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef2a5dd0-b40b-91f8-1c82-262fc51be60e/nfs.dump.dir in system properties and HBase conf 2023-02-09 12:03:21,452 INFO [Listener at localhost/45917] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef2a5dd0-b40b-91f8-1c82-262fc51be60e/java.io.tmpdir in system properties and HBase conf 2023-02-09 12:03:21,452 INFO [Listener at localhost/45917] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef2a5dd0-b40b-91f8-1c82-262fc51be60e/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-09 12:03:21,452 INFO [Listener at localhost/45917] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef2a5dd0-b40b-91f8-1c82-262fc51be60e/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-09 12:03:21,452 INFO [Listener at localhost/45917] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef2a5dd0-b40b-91f8-1c82-262fc51be60e/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-09 12:03:21,456 WARN [Listener at localhost/45917] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-09 12:03:21,456 WARN [Listener at localhost/45917] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-09 12:03:21,494 WARN [Listener at localhost/45917] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 12:03:21,497 INFO [Listener at localhost/45917] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 12:03:21,504 INFO [Listener at localhost/45917] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef2a5dd0-b40b-91f8-1c82-262fc51be60e/java.io.tmpdir/Jetty_localhost_45185_hdfs____.7vyqo9/webapp 2023-02-09 12:03:21,599 INFO [Listener at localhost/45917] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45185 2023-02-09 12:03:21,603 WARN [Listener at localhost/45917] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-09 12:03:21,604 WARN [Listener at localhost/45917] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-09 12:03:21,652 WARN [Listener at localhost/43685] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 12:03:21,668 WARN [Listener at localhost/43685] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-09 12:03:21,671 WARN [Listener at localhost/43685] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 12:03:21,673 INFO [Listener at localhost/43685] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 12:03:21,679 INFO [Listener at localhost/43685] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef2a5dd0-b40b-91f8-1c82-262fc51be60e/java.io.tmpdir/Jetty_localhost_40453_datanode____.eiw56r/webapp 2023-02-09 12:03:21,772 INFO [Listener at localhost/43685] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40453 2023-02-09 12:03:21,784 WARN [Listener at localhost/41759] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 12:03:21,805 WARN [Listener at localhost/41759] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-09 12:03:21,807 WARN [Listener at localhost/41759] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 12:03:21,808 INFO [Listener at localhost/41759] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 12:03:21,813 INFO [Listener at localhost/41759] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef2a5dd0-b40b-91f8-1c82-262fc51be60e/java.io.tmpdir/Jetty_localhost_41429_datanode____.qzywjf/webapp 2023-02-09 12:03:21,893 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6e8b1f8cd2ca0927: Processing first storage report for DS-ece1c34a-bb73-4ff8-b512-48da2d6b27a9 from datanode 9cdb62c8-1cca-47ef-9856-12ec6ea5ea9b 2023-02-09 12:03:21,893 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6e8b1f8cd2ca0927: from storage DS-ece1c34a-bb73-4ff8-b512-48da2d6b27a9 node DatanodeRegistration(127.0.0.1:40655, datanodeUuid=9cdb62c8-1cca-47ef-9856-12ec6ea5ea9b, infoPort=46123, infoSecurePort=0, ipcPort=41759, storageInfo=lv=-57;cid=testClusterID;nsid=2008472437;c=1675944201459), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 12:03:21,893 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6e8b1f8cd2ca0927: Processing first storage report for DS-005b229e-aec6-492d-9180-05a13b32db88 from datanode 9cdb62c8-1cca-47ef-9856-12ec6ea5ea9b 2023-02-09 12:03:21,893 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6e8b1f8cd2ca0927: from storage DS-005b229e-aec6-492d-9180-05a13b32db88 node DatanodeRegistration(127.0.0.1:40655, datanodeUuid=9cdb62c8-1cca-47ef-9856-12ec6ea5ea9b, infoPort=46123, infoSecurePort=0, ipcPort=41759, storageInfo=lv=-57;cid=testClusterID;nsid=2008472437;c=1675944201459), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 12:03:21,922 INFO [Listener at localhost/41759] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41429 2023-02-09 12:03:21,930 WARN [Listener at localhost/40331] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 12:03:22,020 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x14544a28a555e94b: Processing first storage report for DS-d948935b-ff1f-4a82-90e8-6a9acca8e64d from datanode 48110d20-766f-422a-b35a-5d2929df0d79 2023-02-09 12:03:22,020 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x14544a28a555e94b: from storage DS-d948935b-ff1f-4a82-90e8-6a9acca8e64d node DatanodeRegistration(127.0.0.1:43801, datanodeUuid=48110d20-766f-422a-b35a-5d2929df0d79, infoPort=38409, infoSecurePort=0, ipcPort=40331, storageInfo=lv=-57;cid=testClusterID;nsid=2008472437;c=1675944201459), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 12:03:22,020 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x14544a28a555e94b: Processing first storage report for DS-b6af29a1-ba91-4e98-a887-dca9dd37c572 from datanode 48110d20-766f-422a-b35a-5d2929df0d79 2023-02-09 12:03:22,020 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x14544a28a555e94b: from storage DS-b6af29a1-ba91-4e98-a887-dca9dd37c572 node DatanodeRegistration(127.0.0.1:43801, datanodeUuid=48110d20-766f-422a-b35a-5d2929df0d79, infoPort=38409, infoSecurePort=0, ipcPort=40331, storageInfo=lv=-57;cid=testClusterID;nsid=2008472437;c=1675944201459), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 12:03:22,039 DEBUG [Listener at localhost/40331] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef2a5dd0-b40b-91f8-1c82-262fc51be60e 2023-02-09 12:03:22,044 INFO [Listener at localhost/40331] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef2a5dd0-b40b-91f8-1c82-262fc51be60e/cluster_17860aa0-bd4a-34ed-6f2a-39980d330674/zookeeper_0, clientPort=59731, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef2a5dd0-b40b-91f8-1c82-262fc51be60e/cluster_17860aa0-bd4a-34ed-6f2a-39980d330674/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef2a5dd0-b40b-91f8-1c82-262fc51be60e/cluster_17860aa0-bd4a-34ed-6f2a-39980d330674/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-09 12:03:22,045 INFO [Listener at localhost/40331] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=59731 2023-02-09 12:03:22,045 INFO [Listener at localhost/40331] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 12:03:22,046 INFO [Listener at localhost/40331] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 12:03:22,057 INFO [Listener at localhost/40331] util.FSUtils(479): Created version file at hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025 with version=8 2023-02-09 12:03:22,057 INFO [Listener at localhost/40331] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 12:03:22,058 INFO [Listener at localhost/40331] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 12:03:22,059 INFO [Listener at localhost/40331] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:43685/user/jenkins/test-data/6d53958e-ca40-ca19-3e95-5b9bb5074cbd/hbase-staging 2023-02-09 12:03:22,060 INFO [Listener at localhost/40331] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 12:03:22,061 INFO [Listener at localhost/40331] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 12:03:22,061 INFO [Listener at localhost/40331] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 12:03:22,061 INFO [Listener at localhost/40331] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 12:03:22,061 INFO [Listener at localhost/40331] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 12:03:22,061 INFO [Listener at localhost/40331] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 12:03:22,061 INFO [Listener at localhost/40331] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 12:03:22,062 INFO [Listener at localhost/40331] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46541 2023-02-09 12:03:22,062 INFO [Listener at localhost/40331] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 12:03:22,063 INFO [Listener at localhost/40331] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 12:03:22,063 INFO [Listener at localhost/40331] zookeeper.RecoverableZooKeeper(93): Process identifier=master:46541 connecting to ZooKeeper ensemble=127.0.0.1:59731 2023-02-09 12:03:22,072 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): master:465410x0, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 12:03:22,072 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:46541-0x10038f6f8fd0000 connected 2023-02-09 12:03:22,091 DEBUG [Listener at localhost/40331] zookeeper.ZKUtil(164): master:46541-0x10038f6f8fd0000, quorum=127.0.0.1:59731, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 12:03:22,092 DEBUG [Listener at localhost/40331] zookeeper.ZKUtil(164): master:46541-0x10038f6f8fd0000, quorum=127.0.0.1:59731, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 12:03:22,092 DEBUG [Listener at localhost/40331] zookeeper.ZKUtil(164): master:46541-0x10038f6f8fd0000, quorum=127.0.0.1:59731, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 12:03:22,095 DEBUG [Listener at localhost/40331] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46541 2023-02-09 12:03:22,095 DEBUG [Listener at localhost/40331] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46541 2023-02-09 12:03:22,095 DEBUG [Listener at localhost/40331] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46541 2023-02-09 12:03:22,095 DEBUG [Listener at localhost/40331] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46541 2023-02-09 12:03:22,096 DEBUG [Listener at localhost/40331] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46541 2023-02-09 12:03:22,096 INFO [Listener at localhost/40331] master.HMaster(439): hbase.rootdir=hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025, hbase.cluster.distributed=false 2023-02-09 12:03:22,108 INFO [Listener at localhost/40331] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 12:03:22,108 INFO [Listener at localhost/40331] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 12:03:22,108 INFO [Listener at localhost/40331] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 12:03:22,108 INFO [Listener at localhost/40331] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 12:03:22,108 INFO [Listener at localhost/40331] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 12:03:22,108 INFO [Listener at localhost/40331] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 12:03:22,108 INFO [Listener at localhost/40331] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 12:03:22,109 INFO [Listener at localhost/40331] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40905 2023-02-09 12:03:22,110 INFO [Listener at localhost/40331] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-09 12:03:22,115 DEBUG [Listener at localhost/40331] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 12:03:22,115 INFO [Listener at localhost/40331] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 12:03:22,116 INFO [Listener at localhost/40331] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 12:03:22,117 INFO [Listener at localhost/40331] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40905 connecting to ZooKeeper ensemble=127.0.0.1:59731 2023-02-09 12:03:22,121 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): regionserver:409050x0, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 12:03:22,122 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:40905-0x10038f6f8fd0001 connected 2023-02-09 12:03:22,122 DEBUG [Listener at localhost/40331] zookeeper.ZKUtil(164): regionserver:40905-0x10038f6f8fd0001, quorum=127.0.0.1:59731, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 12:03:22,122 DEBUG [Listener at localhost/40331] zookeeper.ZKUtil(164): regionserver:40905-0x10038f6f8fd0001, quorum=127.0.0.1:59731, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 12:03:22,123 DEBUG [Listener at localhost/40331] zookeeper.ZKUtil(164): regionserver:40905-0x10038f6f8fd0001, quorum=127.0.0.1:59731, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 12:03:22,123 DEBUG [Listener at localhost/40331] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40905 2023-02-09 12:03:22,124 DEBUG [Listener at localhost/40331] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40905 2023-02-09 12:03:22,127 DEBUG [Listener at localhost/40331] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40905 2023-02-09 12:03:22,127 DEBUG [Listener at localhost/40331] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40905 2023-02-09 12:03:22,128 DEBUG [Listener at localhost/40331] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40905 2023-02-09 12:03:22,138 INFO [Listener at localhost/40331] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 12:03:22,138 INFO [Listener at localhost/40331] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 12:03:22,138 INFO [Listener at localhost/40331] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 12:03:22,138 INFO [Listener at localhost/40331] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 12:03:22,139 INFO [Listener at localhost/40331] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 12:03:22,139 INFO [Listener at localhost/40331] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 12:03:22,139 INFO [Listener at localhost/40331] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 12:03:22,139 INFO [Listener at localhost/40331] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43751 2023-02-09 12:03:22,140 INFO [Listener at localhost/40331] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-09 12:03:22,140 DEBUG [Listener at localhost/40331] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 12:03:22,140 INFO [Listener at localhost/40331] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 12:03:22,141 INFO [Listener at localhost/40331] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 12:03:22,142 INFO [Listener at localhost/40331] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43751 connecting to ZooKeeper ensemble=127.0.0.1:59731 2023-02-09 12:03:22,145 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): regionserver:437510x0, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 12:03:22,147 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:43751-0x10038f6f8fd0002 connected 2023-02-09 12:03:22,147 DEBUG [Listener at localhost/40331] zookeeper.ZKUtil(164): regionserver:43751-0x10038f6f8fd0002, quorum=127.0.0.1:59731, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 12:03:22,147 DEBUG [Listener at localhost/40331] zookeeper.ZKUtil(164): regionserver:43751-0x10038f6f8fd0002, quorum=127.0.0.1:59731, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 12:03:22,148 DEBUG [Listener at localhost/40331] zookeeper.ZKUtil(164): regionserver:43751-0x10038f6f8fd0002, quorum=127.0.0.1:59731, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 12:03:22,152 DEBUG [Listener at localhost/40331] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43751 2023-02-09 12:03:22,152 DEBUG [Listener at localhost/40331] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43751 2023-02-09 12:03:22,152 DEBUG [Listener at localhost/40331] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43751 2023-02-09 12:03:22,156 DEBUG [Listener at localhost/40331] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43751 2023-02-09 12:03:22,156 DEBUG [Listener at localhost/40331] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43751 2023-02-09 12:03:22,157 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,46541,1675944202060 2023-02-09 12:03:22,159 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): master:46541-0x10038f6f8fd0000, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-09 12:03:22,159 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:46541-0x10038f6f8fd0000, quorum=127.0.0.1:59731, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,46541,1675944202060 2023-02-09 12:03:22,162 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): master:46541-0x10038f6f8fd0000, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 12:03:22,162 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): regionserver:40905-0x10038f6f8fd0001, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 12:03:22,162 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): master:46541-0x10038f6f8fd0000, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 12:03:22,162 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): regionserver:43751-0x10038f6f8fd0002, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 12:03:22,163 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:46541-0x10038f6f8fd0000, quorum=127.0.0.1:59731, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-09 12:03:22,164 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:46541-0x10038f6f8fd0000, quorum=127.0.0.1:59731, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-09 12:03:22,164 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,46541,1675944202060 from backup master directory 2023-02-09 12:03:22,165 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): master:46541-0x10038f6f8fd0000, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,46541,1675944202060 2023-02-09 12:03:22,165 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): master:46541-0x10038f6f8fd0000, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-09 12:03:22,165 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 12:03:22,165 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,46541,1675944202060 2023-02-09 12:03:22,178 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/hbase.id with ID: 69c2fb49-bcc9-4027-8e18-533e045e470b 2023-02-09 12:03:22,187 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 12:03:22,189 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): master:46541-0x10038f6f8fd0000, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 12:03:22,198 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x2cfc6628 to 127.0.0.1:59731 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 12:03:22,201 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@59b7e1e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 12:03:22,201 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-09 12:03:22,202 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-09 12:03:22,203 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 12:03:22,204 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/MasterData/data/master/store-tmp 2023-02-09 12:03:22,211 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:22,211 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-09 12:03:22,211 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 12:03:22,211 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 12:03:22,211 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-09 12:03:22,211 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 12:03:22,211 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 12:03:22,211 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675944202211Disabling compacts and flushes for region at 1675944202211Disabling writes for close at 1675944202211Writing region close event to WAL at 1675944202211Closed at 1675944202211 2023-02-09 12:03:22,212 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/MasterData/WALs/jenkins-hbase4.apache.org,46541,1675944202060 2023-02-09 12:03:22,213 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46541%2C1675944202060, suffix=, logDir=hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/MasterData/WALs/jenkins-hbase4.apache.org,46541,1675944202060, archiveDir=hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/MasterData/oldWALs, maxLogs=10 2023-02-09 12:03:22,230 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40655,DS-ece1c34a-bb73-4ff8-b512-48da2d6b27a9,DISK] 2023-02-09 12:03:22,230 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43801,DS-d948935b-ff1f-4a82-90e8-6a9acca8e64d,DISK] 2023-02-09 12:03:22,231 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/MasterData/WALs/jenkins-hbase4.apache.org,46541,1675944202060/jenkins-hbase4.apache.org%2C46541%2C1675944202060.1675944202214 2023-02-09 12:03:22,232 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40655,DS-ece1c34a-bb73-4ff8-b512-48da2d6b27a9,DISK], DatanodeInfoWithStorage[127.0.0.1:43801,DS-d948935b-ff1f-4a82-90e8-6a9acca8e64d,DISK]] 2023-02-09 12:03:22,232 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-09 12:03:22,232 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:22,232 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 12:03:22,232 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 12:03:22,234 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-09 12:03:22,235 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-09 12:03:22,236 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-09 12:03:22,236 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:22,237 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-09 12:03:22,237 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-09 12:03:22,239 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 12:03:22,240 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 12:03:22,240 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63442696, jitterRate=-0.054630160331726074}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 12:03:22,240 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1675944202232Initializing all the Stores at 1675944202233 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944202233Cleaning up temporary data from old regions at 1675944202237 (+4 ms)Cleaning up detritus from prior splits at 1675944202237Region opened successfully at 1675944202240 (+3 ms) 2023-02-09 12:03:22,241 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-09 12:03:22,242 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-09 12:03:22,242 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-09 12:03:22,242 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-09 12:03:22,242 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-09 12:03:22,242 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-09 12:03:22,242 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-09 12:03:22,243 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-09 12:03:22,244 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-09 12:03:22,253 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-09 12:03:22,254 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-09 12:03:22,254 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46541-0x10038f6f8fd0000, quorum=127.0.0.1:59731, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-09 12:03:22,254 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-09 12:03:22,254 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46541-0x10038f6f8fd0000, quorum=127.0.0.1:59731, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-09 12:03:22,257 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): master:46541-0x10038f6f8fd0000, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 12:03:22,258 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46541-0x10038f6f8fd0000, quorum=127.0.0.1:59731, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-09 12:03:22,258 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46541-0x10038f6f8fd0000, quorum=127.0.0.1:59731, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-09 12:03:22,259 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46541-0x10038f6f8fd0000, quorum=127.0.0.1:59731, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-09 12:03:22,260 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): master:46541-0x10038f6f8fd0000, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 12:03:22,260 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): regionserver:43751-0x10038f6f8fd0002, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 12:03:22,260 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): master:46541-0x10038f6f8fd0000, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 12:03:22,260 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): regionserver:40905-0x10038f6f8fd0001, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 12:03:22,260 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,46541,1675944202060, sessionid=0x10038f6f8fd0000, setting cluster-up flag (Was=false) 2023-02-09 12:03:22,266 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): master:46541-0x10038f6f8fd0000, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 12:03:22,270 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-09 12:03:22,271 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,46541,1675944202060 2023-02-09 12:03:22,274 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): master:46541-0x10038f6f8fd0000, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 12:03:22,278 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-09 12:03:22,279 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,46541,1675944202060 2023-02-09 12:03:22,279 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/.hbase-snapshot/.tmp 2023-02-09 12:03:22,280 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-09 12:03:22,281 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 12:03:22,281 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 12:03:22,281 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 12:03:22,281 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 12:03:22,281 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-09 12:03:22,281 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:22,281 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 12:03:22,281 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:22,285 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1675944232285 2023-02-09 12:03:22,285 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-09 12:03:22,285 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-09 12:03:22,285 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-09 12:03:22,285 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-09 12:03:22,286 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-09 12:03:22,286 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-09 12:03:22,286 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:22,286 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-09 12:03:22,286 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-09 12:03:22,286 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-09 12:03:22,286 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-09 12:03:22,287 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-09 12:03:22,287 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-09 12:03:22,287 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-09 12:03:22,287 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675944202287,5,FailOnTimeoutGroup] 2023-02-09 12:03:22,287 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675944202287,5,FailOnTimeoutGroup] 2023-02-09 12:03:22,287 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:22,287 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-09 12:03:22,287 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:22,287 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:22,287 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-09 12:03:22,298 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-09 12:03:22,299 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-09 12:03:22,299 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025 2023-02-09 12:03:22,309 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:22,310 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-09 12:03:22,311 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/data/hbase/meta/1588230740/info 2023-02-09 12:03:22,311 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-09 12:03:22,312 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:22,312 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-09 12:03:22,313 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/data/hbase/meta/1588230740/rep_barrier 2023-02-09 12:03:22,313 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-09 12:03:22,313 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:22,313 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-09 12:03:22,314 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/data/hbase/meta/1588230740/table 2023-02-09 12:03:22,314 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-09 12:03:22,315 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:22,315 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/data/hbase/meta/1588230740 2023-02-09 12:03:22,315 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/data/hbase/meta/1588230740 2023-02-09 12:03:22,317 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-09 12:03:22,318 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-09 12:03:22,319 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 12:03:22,319 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64863185, jitterRate=-0.03346322476863861}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-09 12:03:22,320 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1675944202309Initializing all the Stores at 1675944202310 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675944202310Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944202310Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675944202310Cleaning up temporary data from old regions at 1675944202316 (+6 ms)Cleaning up detritus from prior splits at 1675944202316Region opened successfully at 1675944202320 (+4 ms) 2023-02-09 12:03:22,320 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-09 12:03:22,320 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-09 12:03:22,320 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-09 12:03:22,320 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-09 12:03:22,320 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-09 12:03:22,320 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-09 12:03:22,320 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675944202320Disabling compacts and flushes for region at 1675944202320Disabling writes for close at 1675944202320Writing region close event to WAL at 1675944202320Closed at 1675944202320 2023-02-09 12:03:22,321 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-09 12:03:22,321 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-09 12:03:22,321 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-09 12:03:22,322 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-09 12:03:22,324 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-09 12:03:22,358 INFO [RS:1;jenkins-hbase4:43751] regionserver.HRegionServer(952): ClusterId : 69c2fb49-bcc9-4027-8e18-533e045e470b 2023-02-09 12:03:22,359 DEBUG [RS:1;jenkins-hbase4:43751] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-09 12:03:22,359 INFO [RS:0;jenkins-hbase4:40905] regionserver.HRegionServer(952): ClusterId : 69c2fb49-bcc9-4027-8e18-533e045e470b 2023-02-09 12:03:22,359 DEBUG [RS:0;jenkins-hbase4:40905] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-09 12:03:22,361 DEBUG [RS:1;jenkins-hbase4:43751] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-09 12:03:22,361 DEBUG [RS:1;jenkins-hbase4:43751] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-09 12:03:22,362 DEBUG [RS:0;jenkins-hbase4:40905] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-09 12:03:22,362 DEBUG [RS:0;jenkins-hbase4:40905] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-09 12:03:22,364 DEBUG [RS:1;jenkins-hbase4:43751] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-09 12:03:22,365 DEBUG [RS:1;jenkins-hbase4:43751] zookeeper.ReadOnlyZKClient(139): Connect 0x58ea0c82 to 127.0.0.1:59731 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 12:03:22,365 DEBUG [RS:0;jenkins-hbase4:40905] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-09 12:03:22,366 DEBUG [RS:0;jenkins-hbase4:40905] zookeeper.ReadOnlyZKClient(139): Connect 0x106d4e93 to 127.0.0.1:59731 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 12:03:22,373 DEBUG [RS:1;jenkins-hbase4:43751] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@562de9ef, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 12:03:22,373 DEBUG [RS:1;jenkins-hbase4:43751] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@521267f2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 12:03:22,373 DEBUG [RS:0;jenkins-hbase4:40905] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1eaaa2ee, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 12:03:22,373 DEBUG [RS:0;jenkins-hbase4:40905] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1a9525e3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 12:03:22,382 DEBUG [RS:0;jenkins-hbase4:40905] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:40905 2023-02-09 12:03:22,382 DEBUG [RS:1;jenkins-hbase4:43751] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:43751 2023-02-09 12:03:22,382 INFO [RS:0;jenkins-hbase4:40905] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-09 12:03:22,382 INFO [RS:0;jenkins-hbase4:40905] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-09 12:03:22,382 INFO [RS:1;jenkins-hbase4:43751] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-09 12:03:22,382 DEBUG [RS:0;jenkins-hbase4:40905] regionserver.HRegionServer(1023): About to register with Master. 2023-02-09 12:03:22,382 INFO [RS:1;jenkins-hbase4:43751] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-09 12:03:22,382 DEBUG [RS:1;jenkins-hbase4:43751] regionserver.HRegionServer(1023): About to register with Master. 2023-02-09 12:03:22,382 INFO [RS:1;jenkins-hbase4:43751] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,46541,1675944202060 with isa=jenkins-hbase4.apache.org/172.31.14.131:43751, startcode=1675944202138 2023-02-09 12:03:22,382 INFO [RS:0;jenkins-hbase4:40905] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,46541,1675944202060 with isa=jenkins-hbase4.apache.org/172.31.14.131:40905, startcode=1675944202107 2023-02-09 12:03:22,383 DEBUG [RS:0;jenkins-hbase4:40905] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-09 12:03:22,383 DEBUG [RS:1;jenkins-hbase4:43751] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-09 12:03:22,384 INFO [RS-EventLoopGroup-15-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55555, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.9 (auth:SIMPLE), service=RegionServerStatusService 2023-02-09 12:03:22,384 INFO [RS-EventLoopGroup-15-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45809, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.8 (auth:SIMPLE), service=RegionServerStatusService 2023-02-09 12:03:22,386 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46541] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,43751,1675944202138 2023-02-09 12:03:22,386 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46541] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,40905,1675944202107 2023-02-09 12:03:22,387 DEBUG [RS:1;jenkins-hbase4:43751] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025 2023-02-09 12:03:22,387 DEBUG [RS:0;jenkins-hbase4:40905] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025 2023-02-09 12:03:22,387 DEBUG [RS:1;jenkins-hbase4:43751] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:43685 2023-02-09 12:03:22,387 DEBUG [RS:0;jenkins-hbase4:40905] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:43685 2023-02-09 12:03:22,387 DEBUG [RS:1;jenkins-hbase4:43751] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-09 12:03:22,387 DEBUG [RS:0;jenkins-hbase4:40905] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-09 12:03:22,391 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): master:46541-0x10038f6f8fd0000, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 12:03:22,391 DEBUG [RS:1;jenkins-hbase4:43751] zookeeper.ZKUtil(162): regionserver:43751-0x10038f6f8fd0002, quorum=127.0.0.1:59731, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43751,1675944202138 2023-02-09 12:03:22,391 DEBUG [RS:0;jenkins-hbase4:40905] zookeeper.ZKUtil(162): regionserver:40905-0x10038f6f8fd0001, quorum=127.0.0.1:59731, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40905,1675944202107 2023-02-09 12:03:22,391 WARN [RS:1;jenkins-hbase4:43751] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 12:03:22,392 WARN [RS:0;jenkins-hbase4:40905] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 12:03:22,392 INFO [RS:1;jenkins-hbase4:43751] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 12:03:22,392 INFO [RS:0;jenkins-hbase4:40905] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 12:03:22,392 DEBUG [RS:1;jenkins-hbase4:43751] regionserver.HRegionServer(1947): logDir=hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/WALs/jenkins-hbase4.apache.org,43751,1675944202138 2023-02-09 12:03:22,392 DEBUG [RS:0;jenkins-hbase4:40905] regionserver.HRegionServer(1947): logDir=hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/WALs/jenkins-hbase4.apache.org,40905,1675944202107 2023-02-09 12:03:22,392 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40905,1675944202107] 2023-02-09 12:03:22,393 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,43751,1675944202138] 2023-02-09 12:03:22,398 DEBUG [RS:0;jenkins-hbase4:40905] zookeeper.ZKUtil(162): regionserver:40905-0x10038f6f8fd0001, quorum=127.0.0.1:59731, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43751,1675944202138 2023-02-09 12:03:22,398 DEBUG [RS:1;jenkins-hbase4:43751] zookeeper.ZKUtil(162): regionserver:43751-0x10038f6f8fd0002, quorum=127.0.0.1:59731, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43751,1675944202138 2023-02-09 12:03:22,398 DEBUG [RS:0;jenkins-hbase4:40905] zookeeper.ZKUtil(162): regionserver:40905-0x10038f6f8fd0001, quorum=127.0.0.1:59731, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40905,1675944202107 2023-02-09 12:03:22,399 DEBUG [RS:1;jenkins-hbase4:43751] zookeeper.ZKUtil(162): regionserver:43751-0x10038f6f8fd0002, quorum=127.0.0.1:59731, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40905,1675944202107 2023-02-09 12:03:22,399 DEBUG [RS:0;jenkins-hbase4:40905] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-09 12:03:22,399 DEBUG [RS:1;jenkins-hbase4:43751] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-09 12:03:22,399 INFO [RS:0;jenkins-hbase4:40905] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-09 12:03:22,399 INFO [RS:1;jenkins-hbase4:43751] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-09 12:03:22,404 INFO [RS:0;jenkins-hbase4:40905] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-09 12:03:22,404 INFO [RS:1;jenkins-hbase4:43751] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-09 12:03:22,405 INFO [RS:0;jenkins-hbase4:40905] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 12:03:22,405 INFO [RS:0;jenkins-hbase4:40905] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:22,405 INFO [RS:1;jenkins-hbase4:43751] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 12:03:22,405 INFO [RS:1;jenkins-hbase4:43751] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:22,406 INFO [RS:0;jenkins-hbase4:40905] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-09 12:03:22,407 INFO [RS:1;jenkins-hbase4:43751] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-09 12:03:22,408 INFO [RS:1;jenkins-hbase4:43751] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:22,408 INFO [RS:0;jenkins-hbase4:40905] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:22,408 DEBUG [RS:1;jenkins-hbase4:43751] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:22,409 DEBUG [RS:0;jenkins-hbase4:40905] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:22,409 DEBUG [RS:1;jenkins-hbase4:43751] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:22,409 DEBUG [RS:0;jenkins-hbase4:40905] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:22,409 DEBUG [RS:1;jenkins-hbase4:43751] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:22,409 DEBUG [RS:0;jenkins-hbase4:40905] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:22,409 DEBUG [RS:1;jenkins-hbase4:43751] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:22,409 DEBUG [RS:0;jenkins-hbase4:40905] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:22,409 DEBUG [RS:1;jenkins-hbase4:43751] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:22,409 DEBUG [RS:0;jenkins-hbase4:40905] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:22,409 DEBUG [RS:1;jenkins-hbase4:43751] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 12:03:22,409 DEBUG [RS:0;jenkins-hbase4:40905] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 12:03:22,409 DEBUG [RS:1;jenkins-hbase4:43751] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:22,409 DEBUG [RS:0;jenkins-hbase4:40905] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:22,409 DEBUG [RS:1;jenkins-hbase4:43751] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:22,409 DEBUG [RS:0;jenkins-hbase4:40905] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:22,409 DEBUG [RS:1;jenkins-hbase4:43751] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:22,409 DEBUG [RS:0;jenkins-hbase4:40905] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:22,409 DEBUG [RS:1;jenkins-hbase4:43751] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:22,409 DEBUG [RS:0;jenkins-hbase4:40905] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:22,410 INFO [RS:0;jenkins-hbase4:40905] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:22,411 INFO [RS:0;jenkins-hbase4:40905] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:22,411 INFO [RS:0;jenkins-hbase4:40905] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:22,411 INFO [RS:1;jenkins-hbase4:43751] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:22,411 INFO [RS:1;jenkins-hbase4:43751] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:22,411 INFO [RS:1;jenkins-hbase4:43751] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:22,424 INFO [RS:1;jenkins-hbase4:43751] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-09 12:03:22,424 INFO [RS:1;jenkins-hbase4:43751] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43751,1675944202138-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:22,427 INFO [RS:0;jenkins-hbase4:40905] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-09 12:03:22,427 INFO [RS:0;jenkins-hbase4:40905] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40905,1675944202107-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:22,434 INFO [RS:1;jenkins-hbase4:43751] regionserver.Replication(203): jenkins-hbase4.apache.org,43751,1675944202138 started 2023-02-09 12:03:22,434 INFO [RS:1;jenkins-hbase4:43751] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,43751,1675944202138, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:43751, sessionid=0x10038f6f8fd0002 2023-02-09 12:03:22,434 DEBUG [RS:1;jenkins-hbase4:43751] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-09 12:03:22,434 DEBUG [RS:1;jenkins-hbase4:43751] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,43751,1675944202138 2023-02-09 12:03:22,435 DEBUG [RS:1;jenkins-hbase4:43751] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43751,1675944202138' 2023-02-09 12:03:22,435 DEBUG [RS:1;jenkins-hbase4:43751] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 12:03:22,435 DEBUG [RS:1;jenkins-hbase4:43751] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 12:03:22,435 DEBUG [RS:1;jenkins-hbase4:43751] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-09 12:03:22,435 DEBUG [RS:1;jenkins-hbase4:43751] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-09 12:03:22,435 DEBUG [RS:1;jenkins-hbase4:43751] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,43751,1675944202138 2023-02-09 12:03:22,435 DEBUG [RS:1;jenkins-hbase4:43751] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43751,1675944202138' 2023-02-09 12:03:22,435 DEBUG [RS:1;jenkins-hbase4:43751] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 12:03:22,435 DEBUG [RS:1;jenkins-hbase4:43751] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 12:03:22,436 DEBUG [RS:1;jenkins-hbase4:43751] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-09 12:03:22,436 INFO [RS:1;jenkins-hbase4:43751] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-09 12:03:22,436 INFO [RS:1;jenkins-hbase4:43751] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-09 12:03:22,442 INFO [RS:0;jenkins-hbase4:40905] regionserver.Replication(203): jenkins-hbase4.apache.org,40905,1675944202107 started 2023-02-09 12:03:22,442 INFO [RS:0;jenkins-hbase4:40905] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,40905,1675944202107, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40905, sessionid=0x10038f6f8fd0001 2023-02-09 12:03:22,442 DEBUG [RS:0;jenkins-hbase4:40905] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-09 12:03:22,442 DEBUG [RS:0;jenkins-hbase4:40905] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40905,1675944202107 2023-02-09 12:03:22,443 DEBUG [RS:0;jenkins-hbase4:40905] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40905,1675944202107' 2023-02-09 12:03:22,443 DEBUG [RS:0;jenkins-hbase4:40905] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 12:03:22,443 DEBUG [RS:0;jenkins-hbase4:40905] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 12:03:22,443 DEBUG [RS:0;jenkins-hbase4:40905] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-09 12:03:22,443 DEBUG [RS:0;jenkins-hbase4:40905] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-09 12:03:22,443 DEBUG [RS:0;jenkins-hbase4:40905] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40905,1675944202107 2023-02-09 12:03:22,443 DEBUG [RS:0;jenkins-hbase4:40905] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40905,1675944202107' 2023-02-09 12:03:22,443 DEBUG [RS:0;jenkins-hbase4:40905] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 12:03:22,444 DEBUG [RS:0;jenkins-hbase4:40905] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 12:03:22,444 DEBUG [RS:0;jenkins-hbase4:40905] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-09 12:03:22,444 INFO [RS:0;jenkins-hbase4:40905] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-09 12:03:22,444 INFO [RS:0;jenkins-hbase4:40905] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-09 12:03:22,474 DEBUG [jenkins-hbase4:46541] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-09 12:03:22,474 DEBUG [jenkins-hbase4:46541] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 12:03:22,475 DEBUG [jenkins-hbase4:46541] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 12:03:22,476 DEBUG [jenkins-hbase4:46541] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 12:03:22,476 DEBUG [jenkins-hbase4:46541] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 12:03:22,476 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,43751,1675944202138, state=OPENING 2023-02-09 12:03:22,477 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-09 12:03:22,478 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): master:46541-0x10038f6f8fd0000, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 12:03:22,479 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-09 12:03:22,481 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,43751,1675944202138}] 2023-02-09 12:03:22,635 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,43751,1675944202138 2023-02-09 12:03:22,635 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-09 12:03:22,636 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51516, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-09 12:03:22,640 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-09 12:03:22,640 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 12:03:22,641 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43751%2C1675944202138.meta, suffix=.meta, logDir=hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/WALs/jenkins-hbase4.apache.org,43751,1675944202138, archiveDir=hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/oldWALs, maxLogs=32 2023-02-09 12:03:22,654 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40655,DS-ece1c34a-bb73-4ff8-b512-48da2d6b27a9,DISK] 2023-02-09 12:03:22,654 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43801,DS-d948935b-ff1f-4a82-90e8-6a9acca8e64d,DISK] 2023-02-09 12:03:22,655 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/WALs/jenkins-hbase4.apache.org,43751,1675944202138/jenkins-hbase4.apache.org%2C43751%2C1675944202138.meta.1675944202641.meta 2023-02-09 12:03:22,656 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40655,DS-ece1c34a-bb73-4ff8-b512-48da2d6b27a9,DISK], DatanodeInfoWithStorage[127.0.0.1:43801,DS-d948935b-ff1f-4a82-90e8-6a9acca8e64d,DISK]] 2023-02-09 12:03:22,656 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-09 12:03:22,656 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-09 12:03:22,656 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-09 12:03:22,656 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-09 12:03:22,656 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-09 12:03:22,656 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:22,656 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-09 12:03:22,656 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-09 12:03:22,657 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-09 12:03:22,658 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/data/hbase/meta/1588230740/info 2023-02-09 12:03:22,658 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/data/hbase/meta/1588230740/info 2023-02-09 12:03:22,659 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-09 12:03:22,659 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:22,659 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-09 12:03:22,660 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/data/hbase/meta/1588230740/rep_barrier 2023-02-09 12:03:22,660 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/data/hbase/meta/1588230740/rep_barrier 2023-02-09 12:03:22,660 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-09 12:03:22,661 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:22,661 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-09 12:03:22,662 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/data/hbase/meta/1588230740/table 2023-02-09 12:03:22,662 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/data/hbase/meta/1588230740/table 2023-02-09 12:03:22,662 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-09 12:03:22,662 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:22,663 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/data/hbase/meta/1588230740 2023-02-09 12:03:22,664 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/data/hbase/meta/1588230740 2023-02-09 12:03:22,665 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-09 12:03:22,666 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-09 12:03:22,667 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68086299, jitterRate=0.014564916491508484}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-09 12:03:22,667 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1675944202657Writing region info on filesystem at 1675944202657Initializing all the Stores at 1675944202657Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675944202657Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944202657Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675944202657Cleaning up temporary data from old regions at 1675944202664 (+7 ms)Cleaning up detritus from prior splits at 1675944202665 (+1 ms)Running coprocessor post-open hooks at 1675944202667 (+2 ms)Region opened successfully at 1675944202667 2023-02-09 12:03:22,667 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1675944202635 2023-02-09 12:03:22,671 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-09 12:03:22,671 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-09 12:03:22,672 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,43751,1675944202138, state=OPEN 2023-02-09 12:03:22,675 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): master:46541-0x10038f6f8fd0000, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-09 12:03:22,675 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-09 12:03:22,676 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-09 12:03:22,676 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,43751,1675944202138 in 197 msec 2023-02-09 12:03:22,678 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-09 12:03:22,678 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 355 msec 2023-02-09 12:03:22,679 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 398 msec 2023-02-09 12:03:22,679 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1675944202159, completionTime=-1 2023-02-09 12:03:22,679 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-09 12:03:22,679 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-09 12:03:22,682 DEBUG [hconnection-0x429f0e70-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 12:03:22,683 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51530, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 12:03:22,684 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-09 12:03:22,685 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1675944262685 2023-02-09 12:03:22,685 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1675944322685 2023-02-09 12:03:22,685 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 5 msec 2023-02-09 12:03:22,691 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46541,1675944202060-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:22,691 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46541,1675944202060-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:22,691 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46541,1675944202060-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:22,691 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:46541, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:22,691 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:22,691 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-09 12:03:22,691 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-09 12:03:22,692 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-09 12:03:22,693 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 12:03:22,693 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-09 12:03:22,694 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 12:03:22,695 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/.tmp/data/hbase/namespace/523d07483eb4d0a357d9012ee95a1288 2023-02-09 12:03:22,695 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/.tmp/data/hbase/namespace/523d07483eb4d0a357d9012ee95a1288 empty. 2023-02-09 12:03:22,696 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/.tmp/data/hbase/namespace/523d07483eb4d0a357d9012ee95a1288 2023-02-09 12:03:22,696 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-09 12:03:22,706 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-09 12:03:22,707 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 523d07483eb4d0a357d9012ee95a1288, NAME => 'hbase:namespace,,1675944202691.523d07483eb4d0a357d9012ee95a1288.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/.tmp 2023-02-09 12:03:22,713 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675944202691.523d07483eb4d0a357d9012ee95a1288.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:22,713 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 523d07483eb4d0a357d9012ee95a1288, disabling compactions & flushes 2023-02-09 12:03:22,713 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675944202691.523d07483eb4d0a357d9012ee95a1288. 2023-02-09 12:03:22,713 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675944202691.523d07483eb4d0a357d9012ee95a1288. 2023-02-09 12:03:22,713 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675944202691.523d07483eb4d0a357d9012ee95a1288. after waiting 0 ms 2023-02-09 12:03:22,713 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675944202691.523d07483eb4d0a357d9012ee95a1288. 2023-02-09 12:03:22,713 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675944202691.523d07483eb4d0a357d9012ee95a1288. 2023-02-09 12:03:22,713 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 523d07483eb4d0a357d9012ee95a1288: Waiting for close lock at 1675944202713Disabling compacts and flushes for region at 1675944202713Disabling writes for close at 1675944202713Writing region close event to WAL at 1675944202713Closed at 1675944202713 2023-02-09 12:03:22,715 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 12:03:22,716 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1675944202691.523d07483eb4d0a357d9012ee95a1288.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675944202715"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675944202715"}]},"ts":"1675944202715"} 2023-02-09 12:03:22,718 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-09 12:03:22,719 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 12:03:22,719 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675944202719"}]},"ts":"1675944202719"} 2023-02-09 12:03:22,720 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-09 12:03:22,723 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 12:03:22,724 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 12:03:22,724 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 12:03:22,724 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 12:03:22,724 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=523d07483eb4d0a357d9012ee95a1288, ASSIGN}] 2023-02-09 12:03:22,726 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=523d07483eb4d0a357d9012ee95a1288, ASSIGN 2023-02-09 12:03:22,727 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=523d07483eb4d0a357d9012ee95a1288, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40905,1675944202107; forceNewPlan=false, retain=false 2023-02-09 12:03:22,877 INFO [jenkins-hbase4:46541] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-09 12:03:22,877 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=523d07483eb4d0a357d9012ee95a1288, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40905,1675944202107 2023-02-09 12:03:22,877 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1675944202691.523d07483eb4d0a357d9012ee95a1288.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675944202877"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675944202877"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675944202877"}]},"ts":"1675944202877"} 2023-02-09 12:03:22,879 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 523d07483eb4d0a357d9012ee95a1288, server=jenkins-hbase4.apache.org,40905,1675944202107}] 2023-02-09 12:03:23,031 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,40905,1675944202107 2023-02-09 12:03:23,031 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-09 12:03:23,033 INFO [RS-EventLoopGroup-16-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49288, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-09 12:03:23,037 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1675944202691.523d07483eb4d0a357d9012ee95a1288. 2023-02-09 12:03:23,038 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40905%2C1675944202107, suffix=, logDir=hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/WALs/jenkins-hbase4.apache.org,40905,1675944202107, archiveDir=hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/oldWALs, maxLogs=32 2023-02-09 12:03:23,051 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43801,DS-d948935b-ff1f-4a82-90e8-6a9acca8e64d,DISK] 2023-02-09 12:03:23,051 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40655,DS-ece1c34a-bb73-4ff8-b512-48da2d6b27a9,DISK] 2023-02-09 12:03:23,052 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/WALs/jenkins-hbase4.apache.org,40905,1675944202107/jenkins-hbase4.apache.org%2C40905%2C1675944202107.1675944203038 2023-02-09 12:03:23,052 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43801,DS-d948935b-ff1f-4a82-90e8-6a9acca8e64d,DISK], DatanodeInfoWithStorage[127.0.0.1:40655,DS-ece1c34a-bb73-4ff8-b512-48da2d6b27a9,DISK]] 2023-02-09 12:03:23,053 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 523d07483eb4d0a357d9012ee95a1288, NAME => 'hbase:namespace,,1675944202691.523d07483eb4d0a357d9012ee95a1288.', STARTKEY => '', ENDKEY => ''} 2023-02-09 12:03:23,053 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 523d07483eb4d0a357d9012ee95a1288 2023-02-09 12:03:23,053 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675944202691.523d07483eb4d0a357d9012ee95a1288.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:23,053 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 523d07483eb4d0a357d9012ee95a1288 2023-02-09 12:03:23,053 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 523d07483eb4d0a357d9012ee95a1288 2023-02-09 12:03:23,054 INFO [StoreOpener-523d07483eb4d0a357d9012ee95a1288-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 523d07483eb4d0a357d9012ee95a1288 2023-02-09 12:03:23,055 DEBUG [StoreOpener-523d07483eb4d0a357d9012ee95a1288-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/data/hbase/namespace/523d07483eb4d0a357d9012ee95a1288/info 2023-02-09 12:03:23,055 DEBUG [StoreOpener-523d07483eb4d0a357d9012ee95a1288-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/data/hbase/namespace/523d07483eb4d0a357d9012ee95a1288/info 2023-02-09 12:03:23,056 INFO [StoreOpener-523d07483eb4d0a357d9012ee95a1288-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 523d07483eb4d0a357d9012ee95a1288 columnFamilyName info 2023-02-09 12:03:23,056 INFO [StoreOpener-523d07483eb4d0a357d9012ee95a1288-1] regionserver.HStore(310): Store=523d07483eb4d0a357d9012ee95a1288/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:23,057 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/data/hbase/namespace/523d07483eb4d0a357d9012ee95a1288 2023-02-09 12:03:23,057 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/data/hbase/namespace/523d07483eb4d0a357d9012ee95a1288 2023-02-09 12:03:23,058 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 523d07483eb4d0a357d9012ee95a1288 2023-02-09 12:03:23,060 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/data/hbase/namespace/523d07483eb4d0a357d9012ee95a1288/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 12:03:23,060 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 523d07483eb4d0a357d9012ee95a1288; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66119279, jitterRate=-0.014745965600013733}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 12:03:23,060 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 523d07483eb4d0a357d9012ee95a1288: Running coprocessor pre-open hook at 1675944203053Writing region info on filesystem at 1675944203053Initializing all the Stores at 1675944203054 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675944203054Cleaning up temporary data from old regions at 1675944203057 (+3 ms)Cleaning up detritus from prior splits at 1675944203057Running coprocessor post-open hooks at 1675944203060 (+3 ms)Region opened successfully at 1675944203060 2023-02-09 12:03:23,061 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1675944202691.523d07483eb4d0a357d9012ee95a1288., pid=6, masterSystemTime=1675944203031 2023-02-09 12:03:23,064 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1675944202691.523d07483eb4d0a357d9012ee95a1288. 2023-02-09 12:03:23,065 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1675944202691.523d07483eb4d0a357d9012ee95a1288. 2023-02-09 12:03:23,065 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=523d07483eb4d0a357d9012ee95a1288, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40905,1675944202107 2023-02-09 12:03:23,065 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1675944202691.523d07483eb4d0a357d9012ee95a1288.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675944203065"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675944203065"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675944203065"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675944203065"}]},"ts":"1675944203065"} 2023-02-09 12:03:23,067 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-09 12:03:23,067 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 523d07483eb4d0a357d9012ee95a1288, server=jenkins-hbase4.apache.org,40905,1675944202107 in 187 msec 2023-02-09 12:03:23,069 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-09 12:03:23,069 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=523d07483eb4d0a357d9012ee95a1288, ASSIGN in 343 msec 2023-02-09 12:03:23,069 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 12:03:23,069 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675944203069"}]},"ts":"1675944203069"} 2023-02-09 12:03:23,070 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-09 12:03:23,072 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 12:03:23,073 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 381 msec 2023-02-09 12:03:23,093 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46541-0x10038f6f8fd0000, quorum=127.0.0.1:59731, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-09 12:03:23,094 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): master:46541-0x10038f6f8fd0000, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-09 12:03:23,094 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): master:46541-0x10038f6f8fd0000, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 12:03:23,096 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 12:03:23,098 INFO [RS-EventLoopGroup-16-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49298, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 12:03:23,100 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-09 12:03:23,107 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): master:46541-0x10038f6f8fd0000, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-09 12:03:23,110 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 11 msec 2023-02-09 12:03:23,122 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-09 12:03:23,127 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): master:46541-0x10038f6f8fd0000, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-09 12:03:23,129 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 8 msec 2023-02-09 12:03:23,137 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): master:46541-0x10038f6f8fd0000, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-09 12:03:23,139 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): master:46541-0x10038f6f8fd0000, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-09 12:03:23,139 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 0.974sec 2023-02-09 12:03:23,140 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-09 12:03:23,140 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-09 12:03:23,140 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-09 12:03:23,140 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46541,1675944202060-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-09 12:03:23,140 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46541,1675944202060-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-09 12:03:23,141 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-09 12:03:23,159 DEBUG [Listener at localhost/40331] zookeeper.ReadOnlyZKClient(139): Connect 0x0159d31e to 127.0.0.1:59731 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 12:03:23,166 DEBUG [Listener at localhost/40331] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5234c08b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 12:03:23,168 DEBUG [hconnection-0x45a0dc6c-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 12:03:23,169 INFO [RS-EventLoopGroup-17-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51534, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 12:03:23,170 INFO [Listener at localhost/40331] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,46541,1675944202060 2023-02-09 12:03:23,170 DEBUG [Listener at localhost/40331] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-09 12:03:23,171 INFO [Listener at localhost/40331] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:23,171 INFO [Listener at localhost/40331] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:23,175 DEBUG [Listener at localhost/40331] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-09 12:03:23,176 INFO [RS-EventLoopGroup-15-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33164, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-09 12:03:23,177 INFO [Listener at localhost/40331] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-09 12:03:23,177 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46541] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceSingleRegion 2023-02-09 12:03:23,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46541] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-09 12:03:23,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46541] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 94 connection: 172.31.14.131:33164 deadline: 1675944263177, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion 2023-02-09 12:03:23,178 INFO [Listener at localhost/40331] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceSingleRegion' 2023-02-09 12:03:23,178 INFO [Listener at localhost/40331] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:23,178 INFO [Listener at localhost/40331] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:23,180 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46541] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-09 12:03:23,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46541] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-09 12:03:23,182 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 12:03:23,182 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46541] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceSingleRegion" procId is: 10 2023-02-09 12:03:23,183 INFO [Listener at localhost/40331] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:23,183 INFO [Listener at localhost/40331] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:23,183 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 12:03:23,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46541] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 12:03:23,184 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/.tmp/data/default/testWithMockedMapReduceSingleRegion/2df0246306b6fab53c549ba2926c0eb4 2023-02-09 12:03:23,185 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/.tmp/data/default/testWithMockedMapReduceSingleRegion/2df0246306b6fab53c549ba2926c0eb4 empty. 2023-02-09 12:03:23,185 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/.tmp/data/default/testWithMockedMapReduceSingleRegion/2df0246306b6fab53c549ba2926c0eb4 2023-02-09 12:03:23,185 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-09 12:03:23,194 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/.tmp/data/default/testWithMockedMapReduceSingleRegion/.tabledesc/.tableinfo.0000000001 2023-02-09 12:03:23,195 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 2df0246306b6fab53c549ba2926c0eb4, NAME => 'testWithMockedMapReduceSingleRegion,,1675944203180.2df0246306b6fab53c549ba2926c0eb4.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/.tmp 2023-02-09 12:03:23,201 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1675944203180.2df0246306b6fab53c549ba2926c0eb4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:23,201 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1603): Closing 2df0246306b6fab53c549ba2926c0eb4, disabling compactions & flushes 2023-02-09 12:03:23,201 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1675944203180.2df0246306b6fab53c549ba2926c0eb4. 2023-02-09 12:03:23,201 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1675944203180.2df0246306b6fab53c549ba2926c0eb4. 2023-02-09 12:03:23,201 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1675944203180.2df0246306b6fab53c549ba2926c0eb4. after waiting 0 ms 2023-02-09 12:03:23,201 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1675944203180.2df0246306b6fab53c549ba2926c0eb4. 2023-02-09 12:03:23,201 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1675944203180.2df0246306b6fab53c549ba2926c0eb4. 2023-02-09 12:03:23,201 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1557): Region close journal for 2df0246306b6fab53c549ba2926c0eb4: Waiting for close lock at 1675944203201Disabling compacts and flushes for region at 1675944203201Disabling writes for close at 1675944203201Writing region close event to WAL at 1675944203201Closed at 1675944203201 2023-02-09 12:03:23,203 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 12:03:23,204 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1675944203180.2df0246306b6fab53c549ba2926c0eb4.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1675944203204"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675944203204"}]},"ts":"1675944203204"} 2023-02-09 12:03:23,205 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-09 12:03:23,206 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 12:03:23,206 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675944203206"}]},"ts":"1675944203206"} 2023-02-09 12:03:23,207 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLING in hbase:meta 2023-02-09 12:03:23,211 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 12:03:23,212 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 12:03:23,212 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 12:03:23,212 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 12:03:23,212 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=2df0246306b6fab53c549ba2926c0eb4, ASSIGN}] 2023-02-09 12:03:23,214 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=2df0246306b6fab53c549ba2926c0eb4, ASSIGN 2023-02-09 12:03:23,215 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=2df0246306b6fab53c549ba2926c0eb4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40905,1675944202107; forceNewPlan=false, retain=false 2023-02-09 12:03:23,284 INFO [Listener at localhost/40331] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:23,284 INFO [Listener at localhost/40331] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:23,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46541] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 12:03:23,365 INFO [jenkins-hbase4:46541] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-09 12:03:23,365 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=2df0246306b6fab53c549ba2926c0eb4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40905,1675944202107 2023-02-09 12:03:23,366 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1675944203180.2df0246306b6fab53c549ba2926c0eb4.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1675944203365"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675944203365"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675944203365"}]},"ts":"1675944203365"} 2023-02-09 12:03:23,367 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 2df0246306b6fab53c549ba2926c0eb4, server=jenkins-hbase4.apache.org,40905,1675944202107}] 2023-02-09 12:03:23,437 INFO [RS:1;jenkins-hbase4:43751] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43751%2C1675944202138, suffix=, logDir=hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/WALs/jenkins-hbase4.apache.org,43751,1675944202138, archiveDir=hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/oldWALs, maxLogs=32 2023-02-09 12:03:23,450 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40655,DS-ece1c34a-bb73-4ff8-b512-48da2d6b27a9,DISK] 2023-02-09 12:03:23,450 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43801,DS-d948935b-ff1f-4a82-90e8-6a9acca8e64d,DISK] 2023-02-09 12:03:23,451 INFO [RS:1;jenkins-hbase4:43751] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/WALs/jenkins-hbase4.apache.org,43751,1675944202138/jenkins-hbase4.apache.org%2C43751%2C1675944202138.1675944203438 2023-02-09 12:03:23,451 DEBUG [RS:1;jenkins-hbase4:43751] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43801,DS-d948935b-ff1f-4a82-90e8-6a9acca8e64d,DISK], DatanodeInfoWithStorage[127.0.0.1:40655,DS-ece1c34a-bb73-4ff8-b512-48da2d6b27a9,DISK]] 2023-02-09 12:03:23,486 INFO [Listener at localhost/40331] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:23,486 INFO [Listener at localhost/40331] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:23,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46541] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 12:03:23,522 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceSingleRegion,,1675944203180.2df0246306b6fab53c549ba2926c0eb4. 2023-02-09 12:03:23,522 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 2df0246306b6fab53c549ba2926c0eb4, NAME => 'testWithMockedMapReduceSingleRegion,,1675944203180.2df0246306b6fab53c549ba2926c0eb4.', STARTKEY => '', ENDKEY => ''} 2023-02-09 12:03:23,522 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceSingleRegion 2df0246306b6fab53c549ba2926c0eb4 2023-02-09 12:03:23,522 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1675944203180.2df0246306b6fab53c549ba2926c0eb4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:23,522 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 2df0246306b6fab53c549ba2926c0eb4 2023-02-09 12:03:23,522 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 2df0246306b6fab53c549ba2926c0eb4 2023-02-09 12:03:23,523 INFO [StoreOpener-2df0246306b6fab53c549ba2926c0eb4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2df0246306b6fab53c549ba2926c0eb4 2023-02-09 12:03:23,524 DEBUG [StoreOpener-2df0246306b6fab53c549ba2926c0eb4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/data/default/testWithMockedMapReduceSingleRegion/2df0246306b6fab53c549ba2926c0eb4/f1 2023-02-09 12:03:23,524 DEBUG [StoreOpener-2df0246306b6fab53c549ba2926c0eb4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/data/default/testWithMockedMapReduceSingleRegion/2df0246306b6fab53c549ba2926c0eb4/f1 2023-02-09 12:03:23,524 INFO [StoreOpener-2df0246306b6fab53c549ba2926c0eb4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2df0246306b6fab53c549ba2926c0eb4 columnFamilyName f1 2023-02-09 12:03:23,525 INFO [StoreOpener-2df0246306b6fab53c549ba2926c0eb4-1] regionserver.HStore(310): Store=2df0246306b6fab53c549ba2926c0eb4/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:23,525 INFO [StoreOpener-2df0246306b6fab53c549ba2926c0eb4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2df0246306b6fab53c549ba2926c0eb4 2023-02-09 12:03:23,526 DEBUG [StoreOpener-2df0246306b6fab53c549ba2926c0eb4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/data/default/testWithMockedMapReduceSingleRegion/2df0246306b6fab53c549ba2926c0eb4/f2 2023-02-09 12:03:23,526 DEBUG [StoreOpener-2df0246306b6fab53c549ba2926c0eb4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/data/default/testWithMockedMapReduceSingleRegion/2df0246306b6fab53c549ba2926c0eb4/f2 2023-02-09 12:03:23,526 INFO [StoreOpener-2df0246306b6fab53c549ba2926c0eb4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2df0246306b6fab53c549ba2926c0eb4 columnFamilyName f2 2023-02-09 12:03:23,526 INFO [StoreOpener-2df0246306b6fab53c549ba2926c0eb4-1] regionserver.HStore(310): Store=2df0246306b6fab53c549ba2926c0eb4/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:23,527 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/data/default/testWithMockedMapReduceSingleRegion/2df0246306b6fab53c549ba2926c0eb4 2023-02-09 12:03:23,527 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/data/default/testWithMockedMapReduceSingleRegion/2df0246306b6fab53c549ba2926c0eb4 2023-02-09 12:03:23,528 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 12:03:23,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 2df0246306b6fab53c549ba2926c0eb4 2023-02-09 12:03:23,530 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/data/default/testWithMockedMapReduceSingleRegion/2df0246306b6fab53c549ba2926c0eb4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 12:03:23,531 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 2df0246306b6fab53c549ba2926c0eb4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72874421, jitterRate=0.08591349422931671}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 12:03:23,531 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 2df0246306b6fab53c549ba2926c0eb4: Running coprocessor pre-open hook at 1675944203522Writing region info on filesystem at 1675944203522Initializing all the Stores at 1675944203523 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944203523Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944203523Cleaning up temporary data from old regions at 1675944203528 (+5 ms)Cleaning up detritus from prior splits at 1675944203528Running coprocessor post-open hooks at 1675944203531 (+3 ms)Region opened successfully at 1675944203531 2023-02-09 12:03:23,531 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceSingleRegion,,1675944203180.2df0246306b6fab53c549ba2926c0eb4., pid=12, masterSystemTime=1675944203519 2023-02-09 12:03:23,533 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceSingleRegion,,1675944203180.2df0246306b6fab53c549ba2926c0eb4. 2023-02-09 12:03:23,533 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceSingleRegion,,1675944203180.2df0246306b6fab53c549ba2926c0eb4. 2023-02-09 12:03:23,533 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=2df0246306b6fab53c549ba2926c0eb4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40905,1675944202107 2023-02-09 12:03:23,533 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceSingleRegion,,1675944203180.2df0246306b6fab53c549ba2926c0eb4.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1675944203533"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675944203533"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675944203533"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675944203533"}]},"ts":"1675944203533"} 2023-02-09 12:03:23,535 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-09 12:03:23,535 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 2df0246306b6fab53c549ba2926c0eb4, server=jenkins-hbase4.apache.org,40905,1675944202107 in 167 msec 2023-02-09 12:03:23,537 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-09 12:03:23,537 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=2df0246306b6fab53c549ba2926c0eb4, ASSIGN in 323 msec 2023-02-09 12:03:23,537 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 12:03:23,537 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675944203537"}]},"ts":"1675944203537"} 2023-02-09 12:03:23,538 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLED in hbase:meta 2023-02-09 12:03:23,541 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 12:03:23,542 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceSingleRegion in 361 msec 2023-02-09 12:03:23,787 INFO [Listener at localhost/40331] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:23,787 INFO [Listener at localhost/40331] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:23,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46541] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 12:03:23,789 INFO [Listener at localhost/40331] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 10 completed 2023-02-09 12:03:23,789 DEBUG [Listener at localhost/40331] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceSingleRegion get assigned. Timeout = 60000ms 2023-02-09 12:03:23,789 INFO [Listener at localhost/40331] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-09 12:03:23,793 INFO [Listener at localhost/40331] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceSingleRegion assigned to meta. Checking AM states. 2023-02-09 12:03:23,793 INFO [Listener at localhost/40331] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-09 12:03:23,793 INFO [Listener at localhost/40331] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceSingleRegion assigned. 2023-02-09 12:03:23,793 INFO [Listener at localhost/40331] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-09 12:03:23,808 DEBUG [hconnection-0x45a0dc6c-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 12:03:23,820 INFO [RS-EventLoopGroup-16-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48550, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 12:03:23,831 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40905] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceSingleRegion,,1675944203180.2df0246306b6fab53c549ba2926c0eb4. 2023-02-09 12:03:23,920 INFO [Listener at localhost/40331] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-09 12:03:23,920 INFO [Listener at localhost/40331] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-09 12:03:23,920 INFO [Listener at localhost/40331] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:23,920 INFO [Listener at localhost/40331] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:23,921 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46541] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-09 12:03:23,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46541] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1675944203921 (current time:1675944203921). 2023-02-09 12:03:23,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46541] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-09 12:03:23,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46541] zookeeper.ReadOnlyZKClient(139): Connect 0x379eb8a1 to 127.0.0.1:59731 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 12:03:23,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46541] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@70e63400, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 12:03:23,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46541] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 12:03:23,926 INFO [RS-EventLoopGroup-17-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50386, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 12:03:23,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46541] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x379eb8a1 to 127.0.0.1:59731 2023-02-09 12:03:23,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46541] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 12:03:23,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46541] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-09 12:03:23,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46541] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-09 12:03:23,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46541] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-09 12:03:23,931 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-09 12:03:23,931 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE; timeout=600000, timestamp=1675944803931 2023-02-09 12:03:23,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46541] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-09 12:03:23,932 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion 2023-02-09 12:03:23,933 DEBUG [Listener at localhost/40331] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-09 12:03:23,933 DEBUG [Listener at localhost/40331] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-09 12:03:23,934 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-09 12:03:23,934 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-09 12:03:23,934 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE in 5 msec 2023-02-09 12:03:23,935 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-09 12:03:23,936 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED; timeout=600000, timestamp=1675944803936 2023-02-09 12:03:23,946 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-09 12:03:23,946 INFO [(jenkins-hbase4.apache.org,46541,1675944202060)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-09 12:03:23,946 DEBUG [(jenkins-hbase4.apache.org,46541,1675944202060)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 12:03:23,947 DEBUG [(jenkins-hbase4.apache.org,46541,1675944202060)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-09 12:03:23,947 DEBUG [(jenkins-hbase4.apache.org,46541,1675944202060)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-09 12:03:23,947 DEBUG [(jenkins-hbase4.apache.org,46541,1675944202060)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46541-0x10038f6f8fd0000, quorum=127.0.0.1:59731, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-09 12:03:23,947 DEBUG [(jenkins-hbase4.apache.org,46541,1675944202060)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-09 12:03:23,948 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): regionserver:43751-0x10038f6f8fd0002, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 12:03:23,948 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): regionserver:40905-0x10038f6f8fd0001, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 12:03:23,948 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 12:03:23,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 12:03:23,948 DEBUG [(jenkins-hbase4.apache.org,46541,1675944202060)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40905,1675944202107 2023-02-09 12:03:23,948 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 12:03:23,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 12:03:23,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-09 12:03:23,949 DEBUG [(jenkins-hbase4.apache.org,46541,1675944202060)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46541-0x10038f6f8fd0000, quorum=127.0.0.1:59731, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40905,1675944202107 2023-02-09 12:03:23,949 DEBUG [(jenkins-hbase4.apache.org,46541,1675944202060)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 12:03:23,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-09 12:03:23,949 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43751-0x10038f6f8fd0002, quorum=127.0.0.1:59731, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-09 12:03:23,949 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40905-0x10038f6f8fd0001, quorum=127.0.0.1:59731, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-09 12:03:23,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-09 12:03:23,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-09 12:03:23,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-09 12:03:23,950 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-09 12:03:23,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-09 12:03:23,950 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-09 12:03:23,950 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-09 12:03:23,952 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-09 12:03:23,952 DEBUG [member: 'jenkins-hbase4.apache.org,43751,1675944202138' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-09 12:03:23,952 DEBUG [member: 'jenkins-hbase4.apache.org,43751,1675944202138' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 12:03:23,952 DEBUG [member: 'jenkins-hbase4.apache.org,40905,1675944202107' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-09 12:03:23,953 DEBUG [member: 'jenkins-hbase4.apache.org,40905,1675944202107' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 12:03:23,953 DEBUG [member: 'jenkins-hbase4.apache.org,43751,1675944202138' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-09 12:03:23,953 DEBUG [member: 'jenkins-hbase4.apache.org,40905,1675944202107' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-09 12:03:23,953 DEBUG [member: 'jenkins-hbase4.apache.org,40905,1675944202107' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-09 12:03:23,953 DEBUG [member: 'jenkins-hbase4.apache.org,43751,1675944202138' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-09 12:03:23,953 DEBUG [member: 'jenkins-hbase4.apache.org,43751,1675944202138' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43751,1675944202138' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-09 12:03:23,953 DEBUG [member: 'jenkins-hbase4.apache.org,40905,1675944202107' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40905,1675944202107' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-09 12:03:23,955 DEBUG [member: 'jenkins-hbase4.apache.org,43751,1675944202138' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-09 12:03:23,956 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): master:46541-0x10038f6f8fd0000, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40905,1675944202107 2023-02-09 12:03:23,956 DEBUG [member: 'jenkins-hbase4.apache.org,43751,1675944202138' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43751-0x10038f6f8fd0002, quorum=127.0.0.1:59731, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-09 12:03:23,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40905,1675944202107 2023-02-09 12:03:23,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 12:03:23,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 12:03:23,956 DEBUG [member: 'jenkins-hbase4.apache.org,43751,1675944202138' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 12:03:23,956 DEBUG [member: 'jenkins-hbase4.apache.org,40905,1675944202107' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-09 12:03:23,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 12:03:23,956 DEBUG [member: 'jenkins-hbase4.apache.org,40905,1675944202107' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40905-0x10038f6f8fd0001, quorum=127.0.0.1:59731, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-09 12:03:23,956 DEBUG [member: 'jenkins-hbase4.apache.org,40905,1675944202107' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 12:03:23,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 12:03:23,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-09 12:03:23,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43751,1675944202138 2023-02-09 12:03:23,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40905,1675944202107 2023-02-09 12:03:23,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 12:03:23,957 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40905,1675944202107' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-09 12:03:23,957 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@683d7c90[Count = 0] remaining members to acquire global barrier 2023-02-09 12:03:23,957 DEBUG [(jenkins-hbase4.apache.org,46541,1675944202060)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-09 12:03:23,957 DEBUG [(jenkins-hbase4.apache.org,46541,1675944202060)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-09 12:03:23,959 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): regionserver:43751-0x10038f6f8fd0002, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-09 12:03:23,960 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): regionserver:40905-0x10038f6f8fd0001, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-09 12:03:23,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-09 12:03:23,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-09 12:03:23,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-09 12:03:23,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-09 12:03:23,960 DEBUG [member: 'jenkins-hbase4.apache.org,40905,1675944202107' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-09 12:03:23,960 DEBUG [member: 'jenkins-hbase4.apache.org,43751,1675944202138' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-09 12:03:23,960 DEBUG [member: 'jenkins-hbase4.apache.org,43751,1675944202138' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-09 12:03:23,960 DEBUG [member: 'jenkins-hbase4.apache.org,43751,1675944202138' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,43751,1675944202138' in zk 2023-02-09 12:03:23,960 DEBUG [member: 'jenkins-hbase4.apache.org,40905,1675944202107' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-09 12:03:23,960 DEBUG [(jenkins-hbase4.apache.org,46541,1675944202060)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46541-0x10038f6f8fd0000, quorum=127.0.0.1:59731, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40905,1675944202107 2023-02-09 12:03:23,960 DEBUG [(jenkins-hbase4.apache.org,46541,1675944202060)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 12:03:23,960 DEBUG [rs(jenkins-hbase4.apache.org,40905,1675944202107)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceSingleRegion,,1675944203180.2df0246306b6fab53c549ba2926c0eb4. 2023-02-09 12:03:23,960 DEBUG [member: 'jenkins-hbase4.apache.org,40905,1675944202107' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-09 12:03:23,960 DEBUG [rs(jenkins-hbase4.apache.org,40905,1675944202107)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1675944203180.2df0246306b6fab53c549ba2926c0eb4. started... 2023-02-09 12:03:23,960 INFO [rs(jenkins-hbase4.apache.org,40905,1675944202107)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 2df0246306b6fab53c549ba2926c0eb4 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-09 12:03:23,961 DEBUG [member: 'jenkins-hbase4.apache.org,43751,1675944202138' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-09 12:03:23,961 DEBUG [member: 'jenkins-hbase4.apache.org,43751,1675944202138' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 12:03:23,962 DEBUG [member: 'jenkins-hbase4.apache.org,43751,1675944202138' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-09 12:03:23,980 INFO [rs(jenkins-hbase4.apache.org,40905,1675944202107)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/data/default/testWithMockedMapReduceSingleRegion/2df0246306b6fab53c549ba2926c0eb4/.tmp/f1/f601f285b74b448881bcb4a5fcf6a6bb 2023-02-09 12:03:23,995 INFO [rs(jenkins-hbase4.apache.org,40905,1675944202107)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/data/default/testWithMockedMapReduceSingleRegion/2df0246306b6fab53c549ba2926c0eb4/.tmp/f2/4fca12ce936d4e52be1015e606f2c012 2023-02-09 12:03:23,998 DEBUG [rs(jenkins-hbase4.apache.org,40905,1675944202107)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/data/default/testWithMockedMapReduceSingleRegion/2df0246306b6fab53c549ba2926c0eb4/.tmp/f1/f601f285b74b448881bcb4a5fcf6a6bb as hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/data/default/testWithMockedMapReduceSingleRegion/2df0246306b6fab53c549ba2926c0eb4/f1/f601f285b74b448881bcb4a5fcf6a6bb 2023-02-09 12:03:24,002 INFO [rs(jenkins-hbase4.apache.org,40905,1675944202107)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/data/default/testWithMockedMapReduceSingleRegion/2df0246306b6fab53c549ba2926c0eb4/f1/f601f285b74b448881bcb4a5fcf6a6bb, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-09 12:03:24,003 DEBUG [rs(jenkins-hbase4.apache.org,40905,1675944202107)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/data/default/testWithMockedMapReduceSingleRegion/2df0246306b6fab53c549ba2926c0eb4/.tmp/f2/4fca12ce936d4e52be1015e606f2c012 as hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/data/default/testWithMockedMapReduceSingleRegion/2df0246306b6fab53c549ba2926c0eb4/f2/4fca12ce936d4e52be1015e606f2c012 2023-02-09 12:03:24,006 INFO [rs(jenkins-hbase4.apache.org,40905,1675944202107)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/data/default/testWithMockedMapReduceSingleRegion/2df0246306b6fab53c549ba2926c0eb4/f2/4fca12ce936d4e52be1015e606f2c012, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-09 12:03:24,007 INFO [rs(jenkins-hbase4.apache.org,40905,1675944202107)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 2df0246306b6fab53c549ba2926c0eb4 in 46ms, sequenceid=5, compaction requested=false 2023-02-09 12:03:24,007 DEBUG [rs(jenkins-hbase4.apache.org,40905,1675944202107)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceSingleRegion' 2023-02-09 12:03:24,007 DEBUG [rs(jenkins-hbase4.apache.org,40905,1675944202107)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 2df0246306b6fab53c549ba2926c0eb4: 2023-02-09 12:03:24,007 DEBUG [rs(jenkins-hbase4.apache.org,40905,1675944202107)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceSingleRegion,,1675944203180.2df0246306b6fab53c549ba2926c0eb4.' region-info for snapshot=testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,007 DEBUG [rs(jenkins-hbase4.apache.org,40905,1675944202107)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 12:03:24,007 DEBUG [rs(jenkins-hbase4.apache.org,40905,1675944202107)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/data/default/testWithMockedMapReduceSingleRegion/2df0246306b6fab53c549ba2926c0eb4/f1/f601f285b74b448881bcb4a5fcf6a6bb] hfiles 2023-02-09 12:03:24,007 DEBUG [rs(jenkins-hbase4.apache.org,40905,1675944202107)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/data/default/testWithMockedMapReduceSingleRegion/2df0246306b6fab53c549ba2926c0eb4/f1/f601f285b74b448881bcb4a5fcf6a6bb for snapshot=testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,007 DEBUG [rs(jenkins-hbase4.apache.org,40905,1675944202107)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/data/default/testWithMockedMapReduceSingleRegion/2df0246306b6fab53c549ba2926c0eb4/f2/4fca12ce936d4e52be1015e606f2c012] hfiles 2023-02-09 12:03:24,007 DEBUG [rs(jenkins-hbase4.apache.org,40905,1675944202107)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/data/default/testWithMockedMapReduceSingleRegion/2df0246306b6fab53c549ba2926c0eb4/f2/4fca12ce936d4e52be1015e606f2c012 for snapshot=testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,012 DEBUG [rs(jenkins-hbase4.apache.org,40905,1675944202107)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1675944203180.2df0246306b6fab53c549ba2926c0eb4. completed. 2023-02-09 12:03:24,012 DEBUG [rs(jenkins-hbase4.apache.org,40905,1675944202107)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceSingleRegion,,1675944203180.2df0246306b6fab53c549ba2926c0eb4. 2023-02-09 12:03:24,012 DEBUG [member: 'jenkins-hbase4.apache.org,40905,1675944202107' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-09 12:03:24,013 DEBUG [member: 'jenkins-hbase4.apache.org,40905,1675944202107' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-09 12:03:24,013 DEBUG [member: 'jenkins-hbase4.apache.org,40905,1675944202107' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40905,1675944202107 2023-02-09 12:03:24,013 DEBUG [member: 'jenkins-hbase4.apache.org,40905,1675944202107' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-09 12:03:24,013 DEBUG [member: 'jenkins-hbase4.apache.org,40905,1675944202107' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,40905,1675944202107' in zk 2023-02-09 12:03:24,014 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): master:46541-0x10038f6f8fd0000, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40905,1675944202107 2023-02-09 12:03:24,014 DEBUG [member: 'jenkins-hbase4.apache.org,40905,1675944202107' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-09 12:03:24,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40905,1675944202107 2023-02-09 12:03:24,014 DEBUG [member: 'jenkins-hbase4.apache.org,40905,1675944202107' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 12:03:24,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 12:03:24,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 12:03:24,014 DEBUG [member: 'jenkins-hbase4.apache.org,40905,1675944202107' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-09 12:03:24,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 12:03:24,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 12:03:24,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43751,1675944202138 2023-02-09 12:03:24,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40905,1675944202107 2023-02-09 12:03:24,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 12:03:24,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43751,1675944202138 2023-02-09 12:03:24,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40905,1675944202107 2023-02-09 12:03:24,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,40905,1675944202107': 2023-02-09 12:03:24,017 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40905,1675944202107' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-09 12:03:24,017 INFO [(jenkins-hbase4.apache.org,46541,1675944202060)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-09 12:03:24,017 DEBUG [(jenkins-hbase4.apache.org,46541,1675944202060)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 12:03:24,017 DEBUG [(jenkins-hbase4.apache.org,46541,1675944202060)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 12:03:24,017 DEBUG [(jenkins-hbase4.apache.org,46541,1675944202060)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,017 INFO [(jenkins-hbase4.apache.org,46541,1675944202060)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-09 12:03:24,019 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): master:46541-0x10038f6f8fd0000, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,019 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): regionserver:40905-0x10038f6f8fd0001, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,019 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): regionserver:43751-0x10038f6f8fd0002, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,019 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): regionserver:40905-0x10038f6f8fd0001, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 12:03:24,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 12:03:24,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 12:03:24,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,019 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): regionserver:43751-0x10038f6f8fd0002, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 12:03:24,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,019 DEBUG [(jenkins-hbase4.apache.org,46541,1675944202060)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46541-0x10038f6f8fd0000, quorum=127.0.0.1:59731, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,43751,1675944202138 2023-02-09 12:03:24,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 12:03:24,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 12:03:24,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 12:03:24,019 DEBUG [(jenkins-hbase4.apache.org,46541,1675944202060)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46541-0x10038f6f8fd0000, quorum=127.0.0.1:59731, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40905,1675944202107 2023-02-09 12:03:24,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 12:03:24,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 12:03:24,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 12:03:24,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43751,1675944202138 2023-02-09 12:03:24,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40905,1675944202107 2023-02-09 12:03:24,021 DEBUG [(jenkins-hbase4.apache.org,46541,1675944202060)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46541-0x10038f6f8fd0000, quorum=127.0.0.1:59731, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,43751,1675944202138 2023-02-09 12:03:24,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 12:03:24,021 DEBUG [(jenkins-hbase4.apache.org,46541,1675944202060)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46541-0x10038f6f8fd0000, quorum=127.0.0.1:59731, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40905,1675944202107 2023-02-09 12:03:24,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43751,1675944202138 2023-02-09 12:03:24,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40905,1675944202107 2023-02-09 12:03:24,026 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): regionserver:43751-0x10038f6f8fd0002, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 12:03:24,026 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): master:46541-0x10038f6f8fd0000, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40905,1675944202107 2023-02-09 12:03:24,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 12:03:24,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 12:03:24,026 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): regionserver:40905-0x10038f6f8fd0001, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 12:03:24,027 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,027 DEBUG [(jenkins-hbase4.apache.org,46541,1675944202060)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 12:03:24,027 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,027 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): master:46541-0x10038f6f8fd0000, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,027 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): regionserver:43751-0x10038f6f8fd0002, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 12:03:24,027 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): master:46541-0x10038f6f8fd0000, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,43751,1675944202138 2023-02-09 12:03:24,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 12:03:24,027 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): regionserver:40905-0x10038f6f8fd0001, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 12:03:24,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 12:03:24,027 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): master:46541-0x10038f6f8fd0000, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 12:03:24,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 12:03:24,027 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): master:46541-0x10038f6f8fd0000, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40905,1675944202107 2023-02-09 12:03:24,027 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): master:46541-0x10038f6f8fd0000, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,027 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 12:03:24,027 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): master:46541-0x10038f6f8fd0000, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,43751,1675944202138 2023-02-09 12:03:24,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 12:03:24,027 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): master:46541-0x10038f6f8fd0000, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,028 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): master:46541-0x10038f6f8fd0000, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,034 DEBUG [Listener at localhost/40331] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 12:03:24,034 INFO [Listener at localhost/40331] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:24,034 INFO [Listener at localhost/40331] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:24,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46541] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-09 12:03:24,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46541] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-09 12:03:24,035 DEBUG [Listener at localhost/40331] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-09 12:03:24,042 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion to hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/.hbase-snapshot/testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,055 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed 2023-02-09 12:03:24,055 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,055 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,055 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion at 1675944203932Consolidate snapshot: testWithMockedMapReduceSingleRegion at 1675944204027 (+95 ms)Loading Region manifests for testWithMockedMapReduceSingleRegion at 1675944204027Writing data manifest for testWithMockedMapReduceSingleRegion at 1675944204030 (+3 ms)Verifying snapshot: testWithMockedMapReduceSingleRegion at 1675944204037 (+7 ms)Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed at 1675944204055 (+18 ms) 2023-02-09 12:03:24,057 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-09 12:03:24,058 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED in 124 msec 2023-02-09 12:03:24,235 DEBUG [Listener at localhost/40331] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 12:03:24,236 INFO [Listener at localhost/40331] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:24,236 INFO [Listener at localhost/40331] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:24,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46541] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-09 12:03:24,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46541] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-09 12:03:24,237 INFO [Listener at localhost/40331] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-09 12:03:24,237 INFO [Listener at localhost/40331] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:24,237 INFO [Listener at localhost/40331] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:24,241 INFO [Listener at localhost/40331] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-09 12:03:24,245 INFO [Listener at localhost/40331] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-09 12:03:24,277 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40905] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceSingleRegion,,1675944203180.2df0246306b6fab53c549ba2926c0eb4. 2023-02-09 12:03:24,399 INFO [Listener at localhost/40331] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-09 12:03:24,402 INFO [Listener at localhost/40331] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:24,402 INFO [Listener at localhost/40331] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:24,404 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46541] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 12:03:24,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46541] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,406 INFO [(jenkins-hbase4.apache.org,46541,1675944202060)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-09 12:03:24,406 DEBUG [(jenkins-hbase4.apache.org,46541,1675944202060)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 12:03:24,406 DEBUG [(jenkins-hbase4.apache.org,46541,1675944202060)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-09 12:03:24,406 DEBUG [(jenkins-hbase4.apache.org,46541,1675944202060)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-09 12:03:24,407 DEBUG [(jenkins-hbase4.apache.org,46541,1675944202060)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46541-0x10038f6f8fd0000, quorum=127.0.0.1:59731, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,407 DEBUG [(jenkins-hbase4.apache.org,46541,1675944202060)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,408 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): regionserver:43751-0x10038f6f8fd0002, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 12:03:24,408 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): regionserver:40905-0x10038f6f8fd0001, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 12:03:24,408 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 12:03:24,408 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 12:03:24,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 12:03:24,408 DEBUG [(jenkins-hbase4.apache.org,46541,1675944202060)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40905,1675944202107 2023-02-09 12:03:24,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 12:03:24,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,409 DEBUG [(jenkins-hbase4.apache.org,46541,1675944202060)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46541-0x10038f6f8fd0000, quorum=127.0.0.1:59731, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40905,1675944202107 2023-02-09 12:03:24,409 DEBUG [(jenkins-hbase4.apache.org,46541,1675944202060)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 12:03:24,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,409 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40905-0x10038f6f8fd0001, quorum=127.0.0.1:59731, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,409 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43751-0x10038f6f8fd0002, quorum=127.0.0.1:59731, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 12:03:24,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,409 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 12:03:24,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,409 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,409 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,410 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,410 DEBUG [member: 'jenkins-hbase4.apache.org,40905,1675944202107' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-09 12:03:24,410 DEBUG [member: 'jenkins-hbase4.apache.org,40905,1675944202107' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 12:03:24,410 DEBUG [member: 'jenkins-hbase4.apache.org,43751,1675944202138' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-09 12:03:24,410 DEBUG [member: 'jenkins-hbase4.apache.org,43751,1675944202138' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 12:03:24,410 DEBUG [member: 'jenkins-hbase4.apache.org,40905,1675944202107' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-09 12:03:24,411 DEBUG [member: 'jenkins-hbase4.apache.org,43751,1675944202138' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-09 12:03:24,411 DEBUG [member: 'jenkins-hbase4.apache.org,43751,1675944202138' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-09 12:03:24,411 DEBUG [member: 'jenkins-hbase4.apache.org,43751,1675944202138' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43751,1675944202138' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-09 12:03:24,411 DEBUG [member: 'jenkins-hbase4.apache.org,40905,1675944202107' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 12:03:24,411 DEBUG [member: 'jenkins-hbase4.apache.org,40905,1675944202107' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 12:03:24,411 DEBUG [rs(jenkins-hbase4.apache.org,40905,1675944202107)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceSingleRegion,,1675944203180.2df0246306b6fab53c549ba2926c0eb4. 2023-02-09 12:03:24,411 DEBUG [rs(jenkins-hbase4.apache.org,40905,1675944202107)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceSingleRegion,,1675944203180.2df0246306b6fab53c549ba2926c0eb4. started... 2023-02-09 12:03:24,411 INFO [rs(jenkins-hbase4.apache.org,40905,1675944202107)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 2df0246306b6fab53c549ba2926c0eb4 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-09 12:03:24,413 DEBUG [member: 'jenkins-hbase4.apache.org,43751,1675944202138' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,413 DEBUG [member: 'jenkins-hbase4.apache.org,43751,1675944202138' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43751-0x10038f6f8fd0002, quorum=127.0.0.1:59731, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,413 DEBUG [member: 'jenkins-hbase4.apache.org,43751,1675944202138' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 12:03:24,425 INFO [rs(jenkins-hbase4.apache.org,40905,1675944202107)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/data/default/testWithMockedMapReduceSingleRegion/2df0246306b6fab53c549ba2926c0eb4/.tmp/f1/1c9eacee78964c69a111d659db5f2ffb 2023-02-09 12:03:24,442 INFO [rs(jenkins-hbase4.apache.org,40905,1675944202107)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/data/default/testWithMockedMapReduceSingleRegion/2df0246306b6fab53c549ba2926c0eb4/.tmp/f2/c3895a57927146869c63dcc63196f513 2023-02-09 12:03:24,445 DEBUG [rs(jenkins-hbase4.apache.org,40905,1675944202107)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/data/default/testWithMockedMapReduceSingleRegion/2df0246306b6fab53c549ba2926c0eb4/.tmp/f1/1c9eacee78964c69a111d659db5f2ffb as hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/data/default/testWithMockedMapReduceSingleRegion/2df0246306b6fab53c549ba2926c0eb4/f1/1c9eacee78964c69a111d659db5f2ffb 2023-02-09 12:03:24,449 INFO [rs(jenkins-hbase4.apache.org,40905,1675944202107)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/data/default/testWithMockedMapReduceSingleRegion/2df0246306b6fab53c549ba2926c0eb4/f1/1c9eacee78964c69a111d659db5f2ffb, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-09 12:03:24,450 DEBUG [rs(jenkins-hbase4.apache.org,40905,1675944202107)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/data/default/testWithMockedMapReduceSingleRegion/2df0246306b6fab53c549ba2926c0eb4/.tmp/f2/c3895a57927146869c63dcc63196f513 as hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/data/default/testWithMockedMapReduceSingleRegion/2df0246306b6fab53c549ba2926c0eb4/f2/c3895a57927146869c63dcc63196f513 2023-02-09 12:03:24,454 INFO [rs(jenkins-hbase4.apache.org,40905,1675944202107)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/data/default/testWithMockedMapReduceSingleRegion/2df0246306b6fab53c549ba2926c0eb4/f2/c3895a57927146869c63dcc63196f513, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-09 12:03:24,455 INFO [rs(jenkins-hbase4.apache.org,40905,1675944202107)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 2df0246306b6fab53c549ba2926c0eb4 in 44ms, sequenceid=9, compaction requested=false 2023-02-09 12:03:24,456 DEBUG [rs(jenkins-hbase4.apache.org,40905,1675944202107)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 2df0246306b6fab53c549ba2926c0eb4: 2023-02-09 12:03:24,456 DEBUG [rs(jenkins-hbase4.apache.org,40905,1675944202107)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceSingleRegion,,1675944203180.2df0246306b6fab53c549ba2926c0eb4. 2023-02-09 12:03:24,456 DEBUG [member: 'jenkins-hbase4.apache.org,40905,1675944202107' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 12:03:24,456 DEBUG [member: 'jenkins-hbase4.apache.org,40905,1675944202107' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 12:03:24,456 DEBUG [member: 'jenkins-hbase4.apache.org,40905,1675944202107' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40905,1675944202107 2023-02-09 12:03:24,456 DEBUG [member: 'jenkins-hbase4.apache.org,40905,1675944202107' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-09 12:03:24,456 DEBUG [member: 'jenkins-hbase4.apache.org,40905,1675944202107' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40905,1675944202107' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-09 12:03:24,459 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): master:46541-0x10038f6f8fd0000, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40905,1675944202107 2023-02-09 12:03:24,459 DEBUG [member: 'jenkins-hbase4.apache.org,40905,1675944202107' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40905,1675944202107 2023-02-09 12:03:24,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 12:03:24,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 12:03:24,460 DEBUG [member: 'jenkins-hbase4.apache.org,40905,1675944202107' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40905-0x10038f6f8fd0001, quorum=127.0.0.1:59731, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,460 DEBUG [member: 'jenkins-hbase4.apache.org,40905,1675944202107' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 12:03:24,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 12:03:24,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 12:03:24,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43751,1675944202138 2023-02-09 12:03:24,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40905,1675944202107 2023-02-09 12:03:24,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 12:03:24,462 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40905,1675944202107' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-09 12:03:24,462 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6c02f54f[Count = 0] remaining members to acquire global barrier 2023-02-09 12:03:24,462 DEBUG [(jenkins-hbase4.apache.org,46541,1675944202060)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-09 12:03:24,462 DEBUG [(jenkins-hbase4.apache.org,46541,1675944202060)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,463 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): regionserver:43751-0x10038f6f8fd0002, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,463 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): regionserver:40905-0x10038f6f8fd0001, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,463 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,463 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,463 DEBUG [member: 'jenkins-hbase4.apache.org,40905,1675944202107' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-09 12:03:24,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,463 DEBUG [member: 'jenkins-hbase4.apache.org,40905,1675944202107' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-09 12:03:24,464 DEBUG [member: 'jenkins-hbase4.apache.org,43751,1675944202138' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-09 12:03:24,464 DEBUG [member: 'jenkins-hbase4.apache.org,43751,1675944202138' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-09 12:03:24,464 DEBUG [member: 'jenkins-hbase4.apache.org,43751,1675944202138' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,43751,1675944202138' in zk 2023-02-09 12:03:24,464 DEBUG [member: 'jenkins-hbase4.apache.org,40905,1675944202107' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,40905,1675944202107' in zk 2023-02-09 12:03:24,464 DEBUG [(jenkins-hbase4.apache.org,46541,1675944202060)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46541-0x10038f6f8fd0000, quorum=127.0.0.1:59731, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40905,1675944202107 2023-02-09 12:03:24,464 DEBUG [(jenkins-hbase4.apache.org,46541,1675944202060)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 12:03:24,465 DEBUG [member: 'jenkins-hbase4.apache.org,43751,1675944202138' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-09 12:03:24,465 DEBUG [member: 'jenkins-hbase4.apache.org,43751,1675944202138' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 12:03:24,465 DEBUG [member: 'jenkins-hbase4.apache.org,43751,1675944202138' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-09 12:03:24,466 DEBUG [member: 'jenkins-hbase4.apache.org,40905,1675944202107' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-09 12:03:24,466 DEBUG [member: 'jenkins-hbase4.apache.org,40905,1675944202107' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 12:03:24,466 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): master:46541-0x10038f6f8fd0000, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40905,1675944202107 2023-02-09 12:03:24,466 DEBUG [member: 'jenkins-hbase4.apache.org,40905,1675944202107' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-09 12:03:24,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40905,1675944202107 2023-02-09 12:03:24,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 12:03:24,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 12:03:24,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 12:03:24,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 12:03:24,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43751,1675944202138 2023-02-09 12:03:24,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40905,1675944202107 2023-02-09 12:03:24,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 12:03:24,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43751,1675944202138 2023-02-09 12:03:24,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40905,1675944202107 2023-02-09 12:03:24,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,40905,1675944202107': 2023-02-09 12:03:24,469 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40905,1675944202107' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-09 12:03:24,469 INFO [(jenkins-hbase4.apache.org,46541,1675944202060)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-09 12:03:24,469 DEBUG [(jenkins-hbase4.apache.org,46541,1675944202060)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 12:03:24,469 DEBUG [(jenkins-hbase4.apache.org,46541,1675944202060)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 12:03:24,469 DEBUG [(jenkins-hbase4.apache.org,46541,1675944202060)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,469 INFO [(jenkins-hbase4.apache.org,46541,1675944202060)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 12:03:24,472 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): master:46541-0x10038f6f8fd0000, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,472 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): regionserver:43751-0x10038f6f8fd0002, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 12:03:24,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 12:03:24,472 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,472 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): regionserver:43751-0x10038f6f8fd0002, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 12:03:24,472 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): regionserver:40905-0x10038f6f8fd0001, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,473 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): regionserver:40905-0x10038f6f8fd0001, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 12:03:24,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 12:03:24,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 12:03:24,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 12:03:24,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 12:03:24,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,473 DEBUG [(jenkins-hbase4.apache.org,46541,1675944202060)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46541-0x10038f6f8fd0000, quorum=127.0.0.1:59731, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,43751,1675944202138 2023-02-09 12:03:24,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 12:03:24,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 12:03:24,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,474 DEBUG [(jenkins-hbase4.apache.org,46541,1675944202060)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46541-0x10038f6f8fd0000, quorum=127.0.0.1:59731, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40905,1675944202107 2023-02-09 12:03:24,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43751,1675944202138 2023-02-09 12:03:24,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40905,1675944202107 2023-02-09 12:03:24,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 12:03:24,475 DEBUG [(jenkins-hbase4.apache.org,46541,1675944202060)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46541-0x10038f6f8fd0000, quorum=127.0.0.1:59731, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,43751,1675944202138 2023-02-09 12:03:24,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,475 DEBUG [(jenkins-hbase4.apache.org,46541,1675944202060)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46541-0x10038f6f8fd0000, quorum=127.0.0.1:59731, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40905,1675944202107 2023-02-09 12:03:24,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43751,1675944202138 2023-02-09 12:03:24,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40905,1675944202107 2023-02-09 12:03:24,478 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): regionserver:43751-0x10038f6f8fd0002, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 12:03:24,478 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): regionserver:40905-0x10038f6f8fd0001, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 12:03:24,478 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 12:03:24,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 12:03:24,478 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): regionserver:43751-0x10038f6f8fd0002, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 12:03:24,478 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46541] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceSingleRegion' 2023-02-09 12:03:24,478 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46541] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 12:03:24,478 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): master:46541-0x10038f6f8fd0000, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40905,1675944202107 2023-02-09 12:03:24,478 DEBUG [(jenkins-hbase4.apache.org,46541,1675944202060)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 12:03:24,478 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 12:03:24,478 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): regionserver:40905-0x10038f6f8fd0001, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 12:03:24,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 12:03:24,478 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 12:03:24,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 12:03:24,478 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): master:46541-0x10038f6f8fd0000, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,478 DEBUG [Listener at localhost/40331] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceSingleRegion'' to complete. (max 20000 ms per retry) 2023-02-09 12:03:24,478 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): master:46541-0x10038f6f8fd0000, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,43751,1675944202138 2023-02-09 12:03:24,478 DEBUG [Listener at localhost/40331] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 12:03:24,478 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): master:46541-0x10038f6f8fd0000, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,478 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 12:03:24,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 12:03:24,479 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): master:46541-0x10038f6f8fd0000, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40905,1675944202107 2023-02-09 12:03:24,479 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): master:46541-0x10038f6f8fd0000, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,479 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): master:46541-0x10038f6f8fd0000, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,43751,1675944202138 2023-02-09 12:03:24,479 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): master:46541-0x10038f6f8fd0000, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,479 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): master:46541-0x10038f6f8fd0000, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,579 DEBUG [Listener at localhost/40331] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 12:03:24,579 INFO [Listener at localhost/40331] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:24,579 INFO [Listener at localhost/40331] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:24,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46541] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 12:03:24,584 INFO [Listener at localhost/40331] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1675944203921 type: FLUSH version: 2 ttl: 0 2023-02-09 12:03:24,584 DEBUG [Listener at localhost/40331] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:43685/user/jenkins/test-data/6d53958e-ca40-ca19-3e95-5b9bb5074cbd/testWithMockedMapReduceSingleRegion/48e09d55-d887-4ff5-b9f0-03990b7b7e14/data/default/testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,584 INFO [Listener at localhost/40331] snapshot.RestoreSnapshotHelper(239): region to add: 2df0246306b6fab53c549ba2926c0eb4 2023-02-09 12:03:24,585 INFO [Listener at localhost/40331] snapshot.RestoreSnapshotHelper(585): clone region=2df0246306b6fab53c549ba2926c0eb4 as 2df0246306b6fab53c549ba2926c0eb4 in snapshot testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,585 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 2df0246306b6fab53c549ba2926c0eb4, NAME => 'testWithMockedMapReduceSingleRegion,,1675944203180.2df0246306b6fab53c549ba2926c0eb4.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43685/user/jenkins/test-data/6d53958e-ca40-ca19-3e95-5b9bb5074cbd/testWithMockedMapReduceSingleRegion/48e09d55-d887-4ff5-b9f0-03990b7b7e14 2023-02-09 12:03:24,591 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1675944203180.2df0246306b6fab53c549ba2926c0eb4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:24,591 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f601f285b74b448881bcb4a5fcf6a6bb from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,593 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 4fca12ce936d4e52be1015e606f2c012 from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,594 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 2df0246306b6fab53c549ba2926c0eb4, disabling compactions & flushes 2023-02-09 12:03:24,594 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1675944203180.2df0246306b6fab53c549ba2926c0eb4. 2023-02-09 12:03:24,594 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1675944203180.2df0246306b6fab53c549ba2926c0eb4. 2023-02-09 12:03:24,594 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1675944203180.2df0246306b6fab53c549ba2926c0eb4. after waiting 0 ms 2023-02-09 12:03:24,594 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1675944203180.2df0246306b6fab53c549ba2926c0eb4. 2023-02-09 12:03:24,594 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1675944203180.2df0246306b6fab53c549ba2926c0eb4. 2023-02-09 12:03:24,594 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 2df0246306b6fab53c549ba2926c0eb4: Waiting for close lock at 1675944204594Disabling compacts and flushes for region at 1675944204594Disabling writes for close at 1675944204594Writing region close event to WAL at 1675944204594Closed at 1675944204594 2023-02-09 12:03:24,595 INFO [Listener at localhost/40331] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1675944203921 type: FLUSH version: 2 ttl: 0 2023-02-09 12:03:24,595 DEBUG [Listener at localhost/40331] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:43685/user/jenkins/test-data/6d53958e-ca40-ca19-3e95-5b9bb5074cbd/testWithMockedMapReduceSingleRegion/48e09d55-d887-4ff5-b9f0-03990b7b7e14 2023-02-09 12:03:24,595 DEBUG [Listener at localhost/40331] util.CommonFSUtils(682): File system contents for path hdfs://localhost:43685/user/jenkins/test-data/6d53958e-ca40-ca19-3e95-5b9bb5074cbd/testWithMockedMapReduceSingleRegion/48e09d55-d887-4ff5-b9f0-03990b7b7e14 2023-02-09 12:03:24,595 DEBUG [Listener at localhost/40331] util.CommonFSUtils(699): |-data/ 2023-02-09 12:03:24,596 DEBUG [Listener at localhost/40331] util.CommonFSUtils(699): |----default/ 2023-02-09 12:03:24,596 DEBUG [Listener at localhost/40331] util.CommonFSUtils(699): |-------testWithMockedMapReduceSingleRegion/ 2023-02-09 12:03:24,596 DEBUG [Listener at localhost/40331] util.CommonFSUtils(699): |----------2df0246306b6fab53c549ba2926c0eb4/ 2023-02-09 12:03:24,597 DEBUG [Listener at localhost/40331] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 12:03:24,597 DEBUG [Listener at localhost/40331] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 12:03:24,597 DEBUG [Listener at localhost/40331] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=2df0246306b6fab53c549ba2926c0eb4-f601f285b74b448881bcb4a5fcf6a6bb 2023-02-09 12:03:24,597 DEBUG [Listener at localhost/40331] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 12:03:24,597 DEBUG [Listener at localhost/40331] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=2df0246306b6fab53c549ba2926c0eb4-4fca12ce936d4e52be1015e606f2c012 2023-02-09 12:03:24,600 INFO [Listener at localhost/40331] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-09 12:03:24,603 DEBUG [Listener at localhost/40331] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1675944203180.2df0246306b6fab53c549ba2926c0eb4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:24,603 INFO [Listener at localhost/40331] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 12:03:24,603 DEBUG [Listener at localhost/40331] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 12:03:24,605 INFO [StoreOpener-2df0246306b6fab53c549ba2926c0eb4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2df0246306b6fab53c549ba2926c0eb4 2023-02-09 12:03:24,606 DEBUG [StoreOpener-2df0246306b6fab53c549ba2926c0eb4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43685/user/jenkins/test-data/6d53958e-ca40-ca19-3e95-5b9bb5074cbd/testWithMockedMapReduceSingleRegion/48e09d55-d887-4ff5-b9f0-03990b7b7e14/data/default/testWithMockedMapReduceSingleRegion/2df0246306b6fab53c549ba2926c0eb4/f1 2023-02-09 12:03:24,606 INFO [StoreOpener-2df0246306b6fab53c549ba2926c0eb4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2df0246306b6fab53c549ba2926c0eb4 columnFamilyName f1 2023-02-09 12:03:24,610 DEBUG [StoreOpener-2df0246306b6fab53c549ba2926c0eb4-1] regionserver.HStore(539): loaded hdfs://localhost:43685/user/jenkins/test-data/6d53958e-ca40-ca19-3e95-5b9bb5074cbd/testWithMockedMapReduceSingleRegion/48e09d55-d887-4ff5-b9f0-03990b7b7e14/data/default/testWithMockedMapReduceSingleRegion/2df0246306b6fab53c549ba2926c0eb4/f1/testWithMockedMapReduceSingleRegion=2df0246306b6fab53c549ba2926c0eb4-f601f285b74b448881bcb4a5fcf6a6bb 2023-02-09 12:03:24,610 INFO [StoreOpener-2df0246306b6fab53c549ba2926c0eb4-1] regionserver.HStore(310): Store=2df0246306b6fab53c549ba2926c0eb4/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:24,610 INFO [StoreOpener-2df0246306b6fab53c549ba2926c0eb4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2df0246306b6fab53c549ba2926c0eb4 2023-02-09 12:03:24,611 DEBUG [StoreOpener-2df0246306b6fab53c549ba2926c0eb4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43685/user/jenkins/test-data/6d53958e-ca40-ca19-3e95-5b9bb5074cbd/testWithMockedMapReduceSingleRegion/48e09d55-d887-4ff5-b9f0-03990b7b7e14/data/default/testWithMockedMapReduceSingleRegion/2df0246306b6fab53c549ba2926c0eb4/f2 2023-02-09 12:03:24,611 INFO [StoreOpener-2df0246306b6fab53c549ba2926c0eb4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2df0246306b6fab53c549ba2926c0eb4 columnFamilyName f2 2023-02-09 12:03:24,614 DEBUG [StoreOpener-2df0246306b6fab53c549ba2926c0eb4-1] regionserver.HStore(539): loaded hdfs://localhost:43685/user/jenkins/test-data/6d53958e-ca40-ca19-3e95-5b9bb5074cbd/testWithMockedMapReduceSingleRegion/48e09d55-d887-4ff5-b9f0-03990b7b7e14/data/default/testWithMockedMapReduceSingleRegion/2df0246306b6fab53c549ba2926c0eb4/f2/testWithMockedMapReduceSingleRegion=2df0246306b6fab53c549ba2926c0eb4-4fca12ce936d4e52be1015e606f2c012 2023-02-09 12:03:24,614 INFO [StoreOpener-2df0246306b6fab53c549ba2926c0eb4-1] regionserver.HStore(310): Store=2df0246306b6fab53c549ba2926c0eb4/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:24,614 DEBUG [Listener at localhost/40331] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 12:03:24,615 INFO [Listener at localhost/40331] regionserver.HRegion(1071): Opened 2df0246306b6fab53c549ba2926c0eb4; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62921590, jitterRate=-0.06239524483680725}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 12:03:24,615 DEBUG [Listener at localhost/40331] regionserver.HRegion(964): Region open journal for 2df0246306b6fab53c549ba2926c0eb4: Writing region info on filesystem at 1675944204603Initializing all the Stores at 1675944204604 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944204604Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944204604Region opened successfully at 1675944204615 (+11 ms) 2023-02-09 12:03:24,662 DEBUG [Listener at localhost/40331] regionserver.HRegion(1603): Closing 2df0246306b6fab53c549ba2926c0eb4, disabling compactions & flushes 2023-02-09 12:03:24,662 INFO [Listener at localhost/40331] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1675944203180.2df0246306b6fab53c549ba2926c0eb4. 2023-02-09 12:03:24,662 DEBUG [Listener at localhost/40331] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1675944203180.2df0246306b6fab53c549ba2926c0eb4. 2023-02-09 12:03:24,662 DEBUG [Listener at localhost/40331] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1675944203180.2df0246306b6fab53c549ba2926c0eb4. after waiting 0 ms 2023-02-09 12:03:24,662 DEBUG [Listener at localhost/40331] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1675944203180.2df0246306b6fab53c549ba2926c0eb4. 2023-02-09 12:03:24,663 INFO [Listener at localhost/40331] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1675944203180.2df0246306b6fab53c549ba2926c0eb4. 2023-02-09 12:03:24,663 DEBUG [Listener at localhost/40331] regionserver.HRegion(1557): Region close journal for 2df0246306b6fab53c549ba2926c0eb4: Waiting for close lock at 1675944204662Disabling compacts and flushes for region at 1675944204662Disabling writes for close at 1675944204662Writing region close event to WAL at 1675944204663 (+1 ms)Closed at 1675944204663 2023-02-09 12:03:24,667 INFO [Listener at localhost/40331] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:24,667 INFO [Listener at localhost/40331] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:24,668 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46541] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMockedMapReduceSingleRegion" 2023-02-09 12:03:24,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46541] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,670 INFO [Listener at localhost/40331] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:24,671 INFO [Listener at localhost/40331] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:24,671 INFO [Listener at localhost/40331] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,671 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46541] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46541] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,674 INFO [Listener at localhost/40331] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:24,674 INFO [Listener at localhost/40331] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:24,674 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675944204674"}]},"ts":"1675944204674"} 2023-02-09 12:03:24,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46541] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-09 12:03:24,676 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLING in hbase:meta 2023-02-09 12:03:24,677 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceSingleRegion to state=DISABLING 2023-02-09 12:03:24,677 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=2df0246306b6fab53c549ba2926c0eb4, UNASSIGN}] 2023-02-09 12:03:24,679 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=2df0246306b6fab53c549ba2926c0eb4, UNASSIGN 2023-02-09 12:03:24,679 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=2df0246306b6fab53c549ba2926c0eb4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40905,1675944202107 2023-02-09 12:03:24,679 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1675944203180.2df0246306b6fab53c549ba2926c0eb4.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1675944204679"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675944204679"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675944204679"}]},"ts":"1675944204679"} 2023-02-09 12:03:24,680 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 2df0246306b6fab53c549ba2926c0eb4, server=jenkins-hbase4.apache.org,40905,1675944202107}] 2023-02-09 12:03:24,775 INFO [Listener at localhost/40331] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:24,775 INFO [Listener at localhost/40331] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:24,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46541] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-09 12:03:24,833 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 2df0246306b6fab53c549ba2926c0eb4 2023-02-09 12:03:24,833 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 2df0246306b6fab53c549ba2926c0eb4, disabling compactions & flushes 2023-02-09 12:03:24,833 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1675944203180.2df0246306b6fab53c549ba2926c0eb4. 2023-02-09 12:03:24,833 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1675944203180.2df0246306b6fab53c549ba2926c0eb4. 2023-02-09 12:03:24,833 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1675944203180.2df0246306b6fab53c549ba2926c0eb4. after waiting 0 ms 2023-02-09 12:03:24,833 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1675944203180.2df0246306b6fab53c549ba2926c0eb4. 2023-02-09 12:03:24,837 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/data/default/testWithMockedMapReduceSingleRegion/2df0246306b6fab53c549ba2926c0eb4/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 12:03:24,837 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1675944203180.2df0246306b6fab53c549ba2926c0eb4. 2023-02-09 12:03:24,837 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 2df0246306b6fab53c549ba2926c0eb4: Waiting for close lock at 1675944204833Running coprocessor pre-close hooks at 1675944204833Disabling compacts and flushes for region at 1675944204833Disabling writes for close at 1675944204833Writing region close event to WAL at 1675944204834 (+1 ms)Running coprocessor post-close hooks at 1675944204837 (+3 ms)Closed at 1675944204837 2023-02-09 12:03:24,839 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 2df0246306b6fab53c549ba2926c0eb4 2023-02-09 12:03:24,839 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=2df0246306b6fab53c549ba2926c0eb4, regionState=CLOSED 2023-02-09 12:03:24,839 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1675944203180.2df0246306b6fab53c549ba2926c0eb4.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1675944204839"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675944204839"}]},"ts":"1675944204839"} 2023-02-09 12:03:24,842 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-09 12:03:24,842 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 2df0246306b6fab53c549ba2926c0eb4, server=jenkins-hbase4.apache.org,40905,1675944202107 in 160 msec 2023-02-09 12:03:24,843 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-09 12:03:24,843 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=2df0246306b6fab53c549ba2926c0eb4, UNASSIGN in 165 msec 2023-02-09 12:03:24,843 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675944204843"}]},"ts":"1675944204843"} 2023-02-09 12:03:24,844 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLED in hbase:meta 2023-02-09 12:03:24,846 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceSingleRegion to state=DISABLED 2023-02-09 12:03:24,847 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceSingleRegion in 175 msec 2023-02-09 12:03:24,977 INFO [Listener at localhost/40331] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:24,977 INFO [Listener at localhost/40331] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:24,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46541] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-09 12:03:24,978 INFO [Listener at localhost/40331] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 15 completed 2023-02-09 12:03:24,978 INFO [Listener at localhost/40331] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:24,978 INFO [Listener at localhost/40331] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:24,979 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46541] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46541] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,981 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,982 INFO [Listener at localhost/40331] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:24,982 INFO [Listener at localhost/40331] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:24,982 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-09 12:03:24,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46541] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-09 12:03:24,985 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/.tmp/data/default/testWithMockedMapReduceSingleRegion/2df0246306b6fab53c549ba2926c0eb4 2023-02-09 12:03:24,986 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/.tmp/data/default/testWithMockedMapReduceSingleRegion/2df0246306b6fab53c549ba2926c0eb4/f1, FileablePath, hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/.tmp/data/default/testWithMockedMapReduceSingleRegion/2df0246306b6fab53c549ba2926c0eb4/f2, FileablePath, hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/.tmp/data/default/testWithMockedMapReduceSingleRegion/2df0246306b6fab53c549ba2926c0eb4/recovered.edits] 2023-02-09 12:03:24,989 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/.tmp/data/default/testWithMockedMapReduceSingleRegion/2df0246306b6fab53c549ba2926c0eb4/f1/1c9eacee78964c69a111d659db5f2ffb to hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/archive/data/default/testWithMockedMapReduceSingleRegion/2df0246306b6fab53c549ba2926c0eb4/f1/1c9eacee78964c69a111d659db5f2ffb 2023-02-09 12:03:24,990 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/.tmp/data/default/testWithMockedMapReduceSingleRegion/2df0246306b6fab53c549ba2926c0eb4/f1/f601f285b74b448881bcb4a5fcf6a6bb to hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/archive/data/default/testWithMockedMapReduceSingleRegion/2df0246306b6fab53c549ba2926c0eb4/f1/f601f285b74b448881bcb4a5fcf6a6bb 2023-02-09 12:03:24,993 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/.tmp/data/default/testWithMockedMapReduceSingleRegion/2df0246306b6fab53c549ba2926c0eb4/f2/4fca12ce936d4e52be1015e606f2c012 to hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/archive/data/default/testWithMockedMapReduceSingleRegion/2df0246306b6fab53c549ba2926c0eb4/f2/4fca12ce936d4e52be1015e606f2c012 2023-02-09 12:03:24,994 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/.tmp/data/default/testWithMockedMapReduceSingleRegion/2df0246306b6fab53c549ba2926c0eb4/f2/c3895a57927146869c63dcc63196f513 to hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/archive/data/default/testWithMockedMapReduceSingleRegion/2df0246306b6fab53c549ba2926c0eb4/f2/c3895a57927146869c63dcc63196f513 2023-02-09 12:03:24,996 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/.tmp/data/default/testWithMockedMapReduceSingleRegion/2df0246306b6fab53c549ba2926c0eb4/recovered.edits/12.seqid to hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/archive/data/default/testWithMockedMapReduceSingleRegion/2df0246306b6fab53c549ba2926c0eb4/recovered.edits/12.seqid 2023-02-09 12:03:24,997 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/.tmp/data/default/testWithMockedMapReduceSingleRegion/2df0246306b6fab53c549ba2926c0eb4 2023-02-09 12:03:24,997 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-09 12:03:24,999 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-09 12:03:25,000 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMockedMapReduceSingleRegion from hbase:meta 2023-02-09 12:03:25,001 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceSingleRegion' descriptor. 2023-02-09 12:03:25,002 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-09 12:03:25,002 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceSingleRegion' from region states. 2023-02-09 12:03:25,002 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion,,1675944203180.2df0246306b6fab53c549ba2926c0eb4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675944205002"}]},"ts":"9223372036854775807"} 2023-02-09 12:03:25,003 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-09 12:03:25,003 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 2df0246306b6fab53c549ba2926c0eb4, NAME => 'testWithMockedMapReduceSingleRegion,,1675944203180.2df0246306b6fab53c549ba2926c0eb4.', STARTKEY => '', ENDKEY => ''}] 2023-02-09 12:03:25,003 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceSingleRegion' as deleted. 2023-02-09 12:03:25,004 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1675944205003"}]},"ts":"9223372036854775807"} 2023-02-09 12:03:25,005 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceSingleRegion state from META 2023-02-09 12:03:25,007 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-09 12:03:25,008 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion in 28 msec 2023-02-09 12:03:25,083 INFO [Listener at localhost/40331] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:25,083 INFO [Listener at localhost/40331] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:25,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46541] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-09 12:03:25,084 INFO [Listener at localhost/40331] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 18 completed 2023-02-09 12:03:25,084 INFO [Listener at localhost/40331] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-09 12:03:25,085 INFO [Listener at localhost/40331] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-09 12:03:25,085 DEBUG [Listener at localhost/40331] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0159d31e to 127.0.0.1:59731 2023-02-09 12:03:25,085 DEBUG [Listener at localhost/40331] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 12:03:25,085 DEBUG [Listener at localhost/40331] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-09 12:03:25,085 DEBUG [Listener at localhost/40331] util.JVMClusterUtil(257): Found active master hash=937782863, stopped=false 2023-02-09 12:03:25,085 INFO [Listener at localhost/40331] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,46541,1675944202060 2023-02-09 12:03:25,087 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): master:46541-0x10038f6f8fd0000, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 12:03:25,087 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): regionserver:40905-0x10038f6f8fd0001, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 12:03:25,087 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): master:46541-0x10038f6f8fd0000, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 12:03:25,087 INFO [Listener at localhost/40331] procedure2.ProcedureExecutor(629): Stopping 2023-02-09 12:03:25,087 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): regionserver:43751-0x10038f6f8fd0002, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 12:03:25,089 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:46541-0x10038f6f8fd0000, quorum=127.0.0.1:59731, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 12:03:25,089 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40905-0x10038f6f8fd0001, quorum=127.0.0.1:59731, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 12:03:25,089 DEBUG [Listener at localhost/40331] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2cfc6628 to 127.0.0.1:59731 2023-02-09 12:03:25,089 DEBUG [Listener at localhost/40331] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 12:03:25,090 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43751-0x10038f6f8fd0002, quorum=127.0.0.1:59731, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 12:03:25,090 INFO [Listener at localhost/40331] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,40905,1675944202107' ***** 2023-02-09 12:03:25,090 INFO [Listener at localhost/40331] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-09 12:03:25,090 INFO [Listener at localhost/40331] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,43751,1675944202138' ***** 2023-02-09 12:03:25,090 INFO [RS:0;jenkins-hbase4:40905] regionserver.HeapMemoryManager(220): Stopping 2023-02-09 12:03:25,090 INFO [RS:0;jenkins-hbase4:40905] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-09 12:03:25,090 INFO [Listener at localhost/40331] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-09 12:03:25,090 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-09 12:03:25,090 INFO [RS:0;jenkins-hbase4:40905] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-09 12:03:25,091 INFO [RS:0;jenkins-hbase4:40905] regionserver.HRegionServer(3304): Received CLOSE for 523d07483eb4d0a357d9012ee95a1288 2023-02-09 12:03:25,091 INFO [RS:0;jenkins-hbase4:40905] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,40905,1675944202107 2023-02-09 12:03:25,091 INFO [RS:1;jenkins-hbase4:43751] regionserver.HeapMemoryManager(220): Stopping 2023-02-09 12:03:25,091 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 523d07483eb4d0a357d9012ee95a1288, disabling compactions & flushes 2023-02-09 12:03:25,091 INFO [RS:1;jenkins-hbase4:43751] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-09 12:03:25,091 DEBUG [RS:0;jenkins-hbase4:40905] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x106d4e93 to 127.0.0.1:59731 2023-02-09 12:03:25,091 INFO [RS:1;jenkins-hbase4:43751] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-09 12:03:25,091 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675944202691.523d07483eb4d0a357d9012ee95a1288. 2023-02-09 12:03:25,091 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-09 12:03:25,091 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675944202691.523d07483eb4d0a357d9012ee95a1288. 2023-02-09 12:03:25,091 INFO [RS:1;jenkins-hbase4:43751] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,43751,1675944202138 2023-02-09 12:03:25,091 DEBUG [RS:0;jenkins-hbase4:40905] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 12:03:25,092 DEBUG [RS:1;jenkins-hbase4:43751] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x58ea0c82 to 127.0.0.1:59731 2023-02-09 12:03:25,092 INFO [RS:0;jenkins-hbase4:40905] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-09 12:03:25,092 DEBUG [RS:1;jenkins-hbase4:43751] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 12:03:25,092 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675944202691.523d07483eb4d0a357d9012ee95a1288. after waiting 0 ms 2023-02-09 12:03:25,093 INFO [RS:1;jenkins-hbase4:43751] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-09 12:03:25,093 DEBUG [RS:0;jenkins-hbase4:40905] regionserver.HRegionServer(1479): Online Regions={523d07483eb4d0a357d9012ee95a1288=hbase:namespace,,1675944202691.523d07483eb4d0a357d9012ee95a1288.} 2023-02-09 12:03:25,093 INFO [RS:1;jenkins-hbase4:43751] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-09 12:03:25,093 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675944202691.523d07483eb4d0a357d9012ee95a1288. 2023-02-09 12:03:25,093 DEBUG [RS:0;jenkins-hbase4:40905] regionserver.HRegionServer(1505): Waiting on 523d07483eb4d0a357d9012ee95a1288 2023-02-09 12:03:25,093 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 523d07483eb4d0a357d9012ee95a1288 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-09 12:03:25,093 INFO [RS:1;jenkins-hbase4:43751] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-09 12:03:25,093 INFO [RS:1;jenkins-hbase4:43751] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-09 12:03:25,093 INFO [RS:1;jenkins-hbase4:43751] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-09 12:03:25,093 DEBUG [RS:1;jenkins-hbase4:43751] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-09 12:03:25,093 DEBUG [RS:1;jenkins-hbase4:43751] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-09 12:03:25,093 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-09 12:03:25,093 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-09 12:03:25,093 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-09 12:03:25,093 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-09 12:03:25,093 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-09 12:03:25,093 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.21 KB heapSize=7.63 KB 2023-02-09 12:03:25,104 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.57 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/data/hbase/meta/1588230740/.tmp/info/9384d6ac070943f8a96e38910cbe9f64 2023-02-09 12:03:25,106 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/data/hbase/namespace/523d07483eb4d0a357d9012ee95a1288/.tmp/info/9dd56f5a8aaf45c6a49128f712125c55 2023-02-09 12:03:25,107 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9384d6ac070943f8a96e38910cbe9f64 2023-02-09 12:03:25,110 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/data/hbase/namespace/523d07483eb4d0a357d9012ee95a1288/.tmp/info/9dd56f5a8aaf45c6a49128f712125c55 as hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/data/hbase/namespace/523d07483eb4d0a357d9012ee95a1288/info/9dd56f5a8aaf45c6a49128f712125c55 2023-02-09 12:03:25,113 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-09 12:03:25,115 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/data/hbase/namespace/523d07483eb4d0a357d9012ee95a1288/info/9dd56f5a8aaf45c6a49128f712125c55, entries=2, sequenceid=6, filesize=4.8 K 2023-02-09 12:03:25,115 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 523d07483eb4d0a357d9012ee95a1288 in 22ms, sequenceid=6, compaction requested=false 2023-02-09 12:03:25,116 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-09 12:03:25,121 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=115 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/data/hbase/meta/1588230740/.tmp/rep_barrier/c9e5cf711fdb4457968f1cfa923e8df2 2023-02-09 12:03:25,122 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/data/hbase/namespace/523d07483eb4d0a357d9012ee95a1288/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-09 12:03:25,123 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675944202691.523d07483eb4d0a357d9012ee95a1288. 2023-02-09 12:03:25,123 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 523d07483eb4d0a357d9012ee95a1288: Waiting for close lock at 1675944205091Running coprocessor pre-close hooks at 1675944205091Disabling compacts and flushes for region at 1675944205091Disabling writes for close at 1675944205093 (+2 ms)Obtaining lock to block concurrent updates at 1675944205093Preparing flush snapshotting stores in 523d07483eb4d0a357d9012ee95a1288 at 1675944205093Finished memstore snapshotting hbase:namespace,,1675944202691.523d07483eb4d0a357d9012ee95a1288., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1675944205093Flushing stores of hbase:namespace,,1675944202691.523d07483eb4d0a357d9012ee95a1288. at 1675944205094 (+1 ms)Flushing 523d07483eb4d0a357d9012ee95a1288/info: creating writer at 1675944205094Flushing 523d07483eb4d0a357d9012ee95a1288/info: appending metadata at 1675944205096 (+2 ms)Flushing 523d07483eb4d0a357d9012ee95a1288/info: closing flushed file at 1675944205096Flushing 523d07483eb4d0a357d9012ee95a1288/info: reopening flushed file at 1675944205110 (+14 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 523d07483eb4d0a357d9012ee95a1288 in 22ms, sequenceid=6, compaction requested=false at 1675944205115 (+5 ms)Writing region close event to WAL at 1675944205120 (+5 ms)Running coprocessor post-close hooks at 1675944205123 (+3 ms)Closed at 1675944205123 2023-02-09 12:03:25,123 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1675944202691.523d07483eb4d0a357d9012ee95a1288. 2023-02-09 12:03:25,125 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c9e5cf711fdb4457968f1cfa923e8df2 2023-02-09 12:03:25,131 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=536 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/data/hbase/meta/1588230740/.tmp/table/c9f3654e41ba4e8ea572a19aafab6470 2023-02-09 12:03:25,133 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c9f3654e41ba4e8ea572a19aafab6470 2023-02-09 12:03:25,134 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/data/hbase/meta/1588230740/.tmp/info/9384d6ac070943f8a96e38910cbe9f64 as hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/data/hbase/meta/1588230740/info/9384d6ac070943f8a96e38910cbe9f64 2023-02-09 12:03:25,138 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9384d6ac070943f8a96e38910cbe9f64 2023-02-09 12:03:25,138 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/data/hbase/meta/1588230740/info/9384d6ac070943f8a96e38910cbe9f64, entries=12, sequenceid=21, filesize=6.3 K 2023-02-09 12:03:25,138 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/data/hbase/meta/1588230740/.tmp/rep_barrier/c9e5cf711fdb4457968f1cfa923e8df2 as hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/data/hbase/meta/1588230740/rep_barrier/c9e5cf711fdb4457968f1cfa923e8df2 2023-02-09 12:03:25,142 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c9e5cf711fdb4457968f1cfa923e8df2 2023-02-09 12:03:25,142 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/data/hbase/meta/1588230740/rep_barrier/c9e5cf711fdb4457968f1cfa923e8df2, entries=1, sequenceid=21, filesize=5.0 K 2023-02-09 12:03:25,143 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/data/hbase/meta/1588230740/.tmp/table/c9f3654e41ba4e8ea572a19aafab6470 as hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/data/hbase/meta/1588230740/table/c9f3654e41ba4e8ea572a19aafab6470 2023-02-09 12:03:25,146 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c9f3654e41ba4e8ea572a19aafab6470 2023-02-09 12:03:25,146 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/data/hbase/meta/1588230740/table/c9f3654e41ba4e8ea572a19aafab6470, entries=4, sequenceid=21, filesize=5.1 K 2023-02-09 12:03:25,149 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.21 KB/4311, heapSize ~7.58 KB/7760, currentSize=0 B/0 for 1588230740 in 56ms, sequenceid=21, compaction requested=false 2023-02-09 12:03:25,152 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-09 12:03:25,152 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-09 12:03:25,153 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-09 12:03:25,153 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675944205093Running coprocessor pre-close hooks at 1675944205093Disabling compacts and flushes for region at 1675944205093Disabling writes for close at 1675944205093Obtaining lock to block concurrent updates at 1675944205093Preparing flush snapshotting stores in 1588230740 at 1675944205093Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=4311, getHeapSize=7760, getOffHeapSize=0, getCellsCount=36 at 1675944205094 (+1 ms)Flushing stores of hbase:meta,,1.1588230740 at 1675944205094Flushing 1588230740/info: creating writer at 1675944205094Flushing 1588230740/info: appending metadata at 1675944205096 (+2 ms)Flushing 1588230740/info: closing flushed file at 1675944205096Flushing 1588230740/rep_barrier: creating writer at 1675944205108 (+12 ms)Flushing 1588230740/rep_barrier: appending metadata at 1675944205109 (+1 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1675944205109Flushing 1588230740/table: creating writer at 1675944205125 (+16 ms)Flushing 1588230740/table: appending metadata at 1675944205126 (+1 ms)Flushing 1588230740/table: closing flushed file at 1675944205126Flushing 1588230740/info: reopening flushed file at 1675944205134 (+8 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1675944205139 (+5 ms)Flushing 1588230740/table: reopening flushed file at 1675944205143 (+4 ms)Finished flush of dataSize ~4.21 KB/4311, heapSize ~7.58 KB/7760, currentSize=0 B/0 for 1588230740 in 56ms, sequenceid=21, compaction requested=false at 1675944205149 (+6 ms)Writing region close event to WAL at 1675944205150 (+1 ms)Running coprocessor post-close hooks at 1675944205152 (+2 ms)Closed at 1675944205153 (+1 ms) 2023-02-09 12:03:25,153 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-09 12:03:25,293 INFO [RS:0;jenkins-hbase4:40905] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,40905,1675944202107; all regions closed. 2023-02-09 12:03:25,293 INFO [RS:1;jenkins-hbase4:43751] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,43751,1675944202138; all regions closed. 2023-02-09 12:03:25,296 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/WALs/jenkins-hbase4.apache.org,43751,1675944202138/jenkins-hbase4.apache.org%2C43751%2C1675944202138.meta.1675944202641.meta not finished, retry = 0 2023-02-09 12:03:25,297 DEBUG [RS:0;jenkins-hbase4:40905] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/oldWALs 2023-02-09 12:03:25,297 INFO [RS:0;jenkins-hbase4:40905] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40905%2C1675944202107:(num 1675944203038) 2023-02-09 12:03:25,297 DEBUG [RS:0;jenkins-hbase4:40905] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 12:03:25,297 INFO [RS:0;jenkins-hbase4:40905] regionserver.LeaseManager(133): Closed leases 2023-02-09 12:03:25,298 INFO [RS:0;jenkins-hbase4:40905] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-09 12:03:25,298 INFO [RS:0;jenkins-hbase4:40905] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-09 12:03:25,298 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 12:03:25,298 INFO [RS:0;jenkins-hbase4:40905] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-09 12:03:25,298 INFO [RS:0;jenkins-hbase4:40905] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-09 12:03:25,299 INFO [RS:0;jenkins-hbase4:40905] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40905 2023-02-09 12:03:25,301 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): regionserver:40905-0x10038f6f8fd0001, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40905,1675944202107 2023-02-09 12:03:25,301 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): master:46541-0x10038f6f8fd0000, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 12:03:25,301 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): regionserver:43751-0x10038f6f8fd0002, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40905,1675944202107 2023-02-09 12:03:25,301 ERROR [Listener at localhost/40331-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@49ffc1f5 rejected from java.util.concurrent.ThreadPoolExecutor@4dc05c12[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1374) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 12:03:25,301 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): regionserver:43751-0x10038f6f8fd0002, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 12:03:25,301 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): regionserver:40905-0x10038f6f8fd0001, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 12:03:25,301 ERROR [Listener at localhost/40331-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@ec77e93 rejected from java.util.concurrent.ThreadPoolExecutor@4dc05c12[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 12:03:25,301 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40905,1675944202107] 2023-02-09 12:03:25,301 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40905,1675944202107; numProcessing=1 2023-02-09 12:03:25,303 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40905,1675944202107 already deleted, retry=false 2023-02-09 12:03:25,303 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,40905,1675944202107 expired; onlineServers=1 2023-02-09 12:03:25,398 DEBUG [RS:1;jenkins-hbase4:43751] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/oldWALs 2023-02-09 12:03:25,398 INFO [RS:1;jenkins-hbase4:43751] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43751%2C1675944202138.meta:.meta(num 1675944202641) 2023-02-09 12:03:25,402 DEBUG [RS:1;jenkins-hbase4:43751] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/oldWALs 2023-02-09 12:03:25,402 INFO [RS:1;jenkins-hbase4:43751] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43751%2C1675944202138:(num 1675944203438) 2023-02-09 12:03:25,402 DEBUG [RS:1;jenkins-hbase4:43751] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 12:03:25,402 INFO [RS:1;jenkins-hbase4:43751] regionserver.LeaseManager(133): Closed leases 2023-02-09 12:03:25,402 INFO [RS:1;jenkins-hbase4:43751] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-09 12:03:25,402 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 12:03:25,405 INFO [RS:1;jenkins-hbase4:43751] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43751 2023-02-09 12:03:25,406 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): regionserver:43751-0x10038f6f8fd0002, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43751,1675944202138 2023-02-09 12:03:25,406 ERROR [Listener at localhost/40331-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@50e6d4a8 rejected from java.util.concurrent.ThreadPoolExecutor@54d95a6c[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 12:03:25,407 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): master:46541-0x10038f6f8fd0000, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 12:03:25,407 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,43751,1675944202138] 2023-02-09 12:03:25,407 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,43751,1675944202138; numProcessing=2 2023-02-09 12:03:25,409 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,43751,1675944202138 already deleted, retry=false 2023-02-09 12:03:25,409 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,43751,1675944202138 expired; onlineServers=0 2023-02-09 12:03:25,409 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,46541,1675944202060' ***** 2023-02-09 12:03:25,409 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-09 12:03:25,409 DEBUG [M:0;jenkins-hbase4:46541] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@33dafc6b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 12:03:25,410 INFO [M:0;jenkins-hbase4:46541] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,46541,1675944202060 2023-02-09 12:03:25,410 INFO [M:0;jenkins-hbase4:46541] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,46541,1675944202060; all regions closed. 2023-02-09 12:03:25,410 DEBUG [M:0;jenkins-hbase4:46541] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 12:03:25,410 DEBUG [M:0;jenkins-hbase4:46541] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-09 12:03:25,410 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-09 12:03:25,410 DEBUG [M:0;jenkins-hbase4:46541] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-09 12:03:25,410 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675944202287] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675944202287,5,FailOnTimeoutGroup] 2023-02-09 12:03:25,410 INFO [M:0;jenkins-hbase4:46541] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-09 12:03:25,410 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675944202287] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675944202287,5,FailOnTimeoutGroup] 2023-02-09 12:03:25,411 INFO [M:0;jenkins-hbase4:46541] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-09 12:03:25,411 INFO [M:0;jenkins-hbase4:46541] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-09 12:03:25,411 DEBUG [M:0;jenkins-hbase4:46541] master.HMaster(1502): Stopping service threads 2023-02-09 12:03:25,411 INFO [M:0;jenkins-hbase4:46541] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-09 12:03:25,412 ERROR [M:0;jenkins-hbase4:46541] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-09 12:03:25,412 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): master:46541-0x10038f6f8fd0000, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-09 12:03:25,412 INFO [M:0;jenkins-hbase4:46541] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-09 12:03:25,412 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): master:46541-0x10038f6f8fd0000, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 12:03:25,412 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-09 12:03:25,412 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:46541-0x10038f6f8fd0000, quorum=127.0.0.1:59731, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 12:03:25,413 DEBUG [M:0;jenkins-hbase4:46541] zookeeper.ZKUtil(398): master:46541-0x10038f6f8fd0000, quorum=127.0.0.1:59731, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-09 12:03:25,413 WARN [M:0;jenkins-hbase4:46541] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-09 12:03:25,413 INFO [M:0;jenkins-hbase4:46541] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-09 12:03:25,413 INFO [M:0;jenkins-hbase4:46541] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-09 12:03:25,413 DEBUG [M:0;jenkins-hbase4:46541] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-09 12:03:25,413 INFO [M:0;jenkins-hbase4:46541] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 12:03:25,413 DEBUG [M:0;jenkins-hbase4:46541] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 12:03:25,413 DEBUG [M:0;jenkins-hbase4:46541] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-09 12:03:25,413 DEBUG [M:0;jenkins-hbase4:46541] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 12:03:25,414 INFO [M:0;jenkins-hbase4:46541] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.12 KB heapSize=67.06 KB 2023-02-09 12:03:25,422 INFO [M:0;jenkins-hbase4:46541] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.12 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/7345e6456cfc47afadada06ff5aaff07 2023-02-09 12:03:25,426 DEBUG [M:0;jenkins-hbase4:46541] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/7345e6456cfc47afadada06ff5aaff07 as hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/7345e6456cfc47afadada06ff5aaff07 2023-02-09 12:03:25,429 INFO [M:0;jenkins-hbase4:46541] regionserver.HStore(1080): Added hdfs://localhost:43685/user/jenkins/test-data/26d1227c-d791-251b-2970-1db51a1f9025/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/7345e6456cfc47afadada06ff5aaff07, entries=17, sequenceid=132, filesize=8.7 K 2023-02-09 12:03:25,430 INFO [M:0;jenkins-hbase4:46541] regionserver.HRegion(2947): Finished flush of dataSize ~56.12 KB/57463, heapSize ~67.05 KB/68656, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 16ms, sequenceid=132, compaction requested=false 2023-02-09 12:03:25,430 INFO [M:0;jenkins-hbase4:46541] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 12:03:25,430 DEBUG [M:0;jenkins-hbase4:46541] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675944205413Disabling compacts and flushes for region at 1675944205413Disabling writes for close at 1675944205413Obtaining lock to block concurrent updates at 1675944205414 (+1 ms)Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1675944205414Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=57463, getHeapSize=68656, getOffHeapSize=0, getCellsCount=145 at 1675944205414Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1675944205415 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1675944205415Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1675944205417 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1675944205417Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1675944205426 (+9 ms)Finished flush of dataSize ~56.12 KB/57463, heapSize ~67.05 KB/68656, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 16ms, sequenceid=132, compaction requested=false at 1675944205430 (+4 ms)Writing region close event to WAL at 1675944205430Closed at 1675944205430 2023-02-09 12:03:25,433 INFO [M:0;jenkins-hbase4:46541] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-09 12:03:25,433 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 12:03:25,433 INFO [M:0;jenkins-hbase4:46541] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46541 2023-02-09 12:03:25,436 DEBUG [M:0;jenkins-hbase4:46541] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,46541,1675944202060 already deleted, retry=false 2023-02-09 12:03:25,548 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-09 12:03:25,587 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): master:46541-0x10038f6f8fd0000, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 12:03:25,587 INFO [M:0;jenkins-hbase4:46541] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,46541,1675944202060; zookeeper connection closed. 2023-02-09 12:03:25,587 ERROR [Listener at localhost/40331-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@658ac3e6 rejected from java.util.concurrent.ThreadPoolExecutor@61b55b8f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 12:03:25,588 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): master:46541-0x10038f6f8fd0000, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 12:03:25,588 ERROR [Listener at localhost/40331-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@267fdf7c rejected from java.util.concurrent.ThreadPoolExecutor@61b55b8f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 12:03:25,687 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): regionserver:43751-0x10038f6f8fd0002, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 12:03:25,687 INFO [RS:1;jenkins-hbase4:43751] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,43751,1675944202138; zookeeper connection closed. 2023-02-09 12:03:25,688 ERROR [Listener at localhost/40331-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@46a5a465 rejected from java.util.concurrent.ThreadPoolExecutor@54d95a6c[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 12:03:25,688 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): regionserver:43751-0x10038f6f8fd0002, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 12:03:25,688 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@51764468] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@51764468 2023-02-09 12:03:25,688 ERROR [Listener at localhost/40331-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3e144fcb rejected from java.util.concurrent.ThreadPoolExecutor@54d95a6c[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 12:03:25,788 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): regionserver:40905-0x10038f6f8fd0001, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 12:03:25,788 INFO [RS:0;jenkins-hbase4:40905] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,40905,1675944202107; zookeeper connection closed. 2023-02-09 12:03:25,788 ERROR [Listener at localhost/40331-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@76ef0d29 rejected from java.util.concurrent.ThreadPoolExecutor@4dc05c12[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 12:03:25,790 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@384cc477] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@384cc477 2023-02-09 12:03:25,790 DEBUG [Listener at localhost/40331-EventThread] zookeeper.ZKWatcher(600): regionserver:40905-0x10038f6f8fd0001, quorum=127.0.0.1:59731, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 12:03:25,790 ERROR [Listener at localhost/40331-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5debece9 rejected from java.util.concurrent.ThreadPoolExecutor@4dc05c12[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 12:03:25,790 INFO [Listener at localhost/40331] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-09 12:03:25,791 WARN [Listener at localhost/40331] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-09 12:03:25,794 INFO [Listener at localhost/40331] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 12:03:25,901 WARN [BP-1009637176-172.31.14.131-1675944201459 heartbeating to localhost/127.0.0.1:43685] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-09 12:03:25,901 WARN [BP-1009637176-172.31.14.131-1675944201459 heartbeating to localhost/127.0.0.1:43685] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1009637176-172.31.14.131-1675944201459 (Datanode Uuid 48110d20-766f-422a-b35a-5d2929df0d79) service to localhost/127.0.0.1:43685 2023-02-09 12:03:25,901 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef2a5dd0-b40b-91f8-1c82-262fc51be60e/cluster_17860aa0-bd4a-34ed-6f2a-39980d330674/dfs/data/data3/current/BP-1009637176-172.31.14.131-1675944201459] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 12:03:25,902 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef2a5dd0-b40b-91f8-1c82-262fc51be60e/cluster_17860aa0-bd4a-34ed-6f2a-39980d330674/dfs/data/data4/current/BP-1009637176-172.31.14.131-1675944201459] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 12:03:25,903 WARN [Listener at localhost/40331] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-09 12:03:25,906 INFO [Listener at localhost/40331] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 12:03:25,985 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-09 12:03:26,010 WARN [BP-1009637176-172.31.14.131-1675944201459 heartbeating to localhost/127.0.0.1:43685] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-09 12:03:26,010 WARN [BP-1009637176-172.31.14.131-1675944201459 heartbeating to localhost/127.0.0.1:43685] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1009637176-172.31.14.131-1675944201459 (Datanode Uuid 9cdb62c8-1cca-47ef-9856-12ec6ea5ea9b) service to localhost/127.0.0.1:43685 2023-02-09 12:03:26,011 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef2a5dd0-b40b-91f8-1c82-262fc51be60e/cluster_17860aa0-bd4a-34ed-6f2a-39980d330674/dfs/data/data1/current/BP-1009637176-172.31.14.131-1675944201459] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 12:03:26,011 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef2a5dd0-b40b-91f8-1c82-262fc51be60e/cluster_17860aa0-bd4a-34ed-6f2a-39980d330674/dfs/data/data2/current/BP-1009637176-172.31.14.131-1675944201459] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 12:03:26,023 INFO [Listener at localhost/40331] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 12:03:26,137 INFO [Listener at localhost/40331] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-09 12:03:26,155 INFO [Listener at localhost/40331] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-09 12:03:26,168 INFO [Listener at localhost/40331] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=255 (was 231) Potentially hanging thread: RS-EventLoopGroup-16-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/40331.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/40331 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:43685 from jenkins.hfs.8 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:43685 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-17-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:43685 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: (jenkins-hbase4.apache.org,46541,1675944202060)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.8@localhost:43685 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-15 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.9@localhost:43685 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:43685 from jenkins.hfs.9 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-19-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:43685 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-13 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-14 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=664 (was 637) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=331 (was 316) - SystemLoadAverage LEAK? -, ProcessCount=166 (was 166), AvailableMemoryMB=3225 (was 3260) 2023-02-09 12:03:26,178 INFO [Listener at localhost/40331] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=255, OpenFileDescriptor=664, MaxFileDescriptor=60000, SystemLoadAverage=331, ProcessCount=166, AvailableMemoryMB=3224 2023-02-09 12:03:26,189 INFO [Listener at localhost/40331] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef2a5dd0-b40b-91f8-1c82-262fc51be60e/hadoop.log.dir so I do NOT create it in target/test-data/e8501bb2-6b19-0548-742d-40ff45bd6565 2023-02-09 12:03:26,189 WARN [Listener at localhost/40331] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef2a5dd0-b40b-91f8-1c82-262fc51be60e/hadoop.log.dir Erasing configuration value by system value. 2023-02-09 12:03:26,189 INFO [Listener at localhost/40331] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef2a5dd0-b40b-91f8-1c82-262fc51be60e/hadoop.tmp.dir so I do NOT create it in target/test-data/e8501bb2-6b19-0548-742d-40ff45bd6565 2023-02-09 12:03:26,189 WARN [Listener at localhost/40331] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef2a5dd0-b40b-91f8-1c82-262fc51be60e/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-09 12:03:26,189 DEBUG [Listener at localhost/40331] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e8501bb2-6b19-0548-742d-40ff45bd6565 2023-02-09 12:03:26,189 INFO [Listener at localhost/40331] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-09 12:03:26,189 INFO [Listener at localhost/40331] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e8501bb2-6b19-0548-742d-40ff45bd6565/cluster_1b9eeb62-70a0-0dff-041f-8e422d850948, deleteOnExit=true 2023-02-09 12:03:26,189 INFO [Listener at localhost/40331] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-09 12:03:26,189 INFO [Listener at localhost/40331] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e8501bb2-6b19-0548-742d-40ff45bd6565/test.cache.data in system properties and HBase conf 2023-02-09 12:03:26,189 INFO [Listener at localhost/40331] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e8501bb2-6b19-0548-742d-40ff45bd6565/hadoop.tmp.dir in system properties and HBase conf 2023-02-09 12:03:26,189 INFO [Listener at localhost/40331] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e8501bb2-6b19-0548-742d-40ff45bd6565/hadoop.log.dir in system properties and HBase conf 2023-02-09 12:03:26,190 INFO [Listener at localhost/40331] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e8501bb2-6b19-0548-742d-40ff45bd6565/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-09 12:03:26,190 INFO [Listener at localhost/40331] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e8501bb2-6b19-0548-742d-40ff45bd6565/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-09 12:03:26,190 INFO [Listener at localhost/40331] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-09 12:03:26,190 DEBUG [Listener at localhost/40331] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-09 12:03:26,190 INFO [Listener at localhost/40331] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e8501bb2-6b19-0548-742d-40ff45bd6565/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-09 12:03:26,190 INFO [Listener at localhost/40331] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e8501bb2-6b19-0548-742d-40ff45bd6565/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-09 12:03:26,190 INFO [Listener at localhost/40331] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e8501bb2-6b19-0548-742d-40ff45bd6565/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-09 12:03:26,190 INFO [Listener at localhost/40331] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e8501bb2-6b19-0548-742d-40ff45bd6565/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-09 12:03:26,191 INFO [Listener at localhost/40331] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e8501bb2-6b19-0548-742d-40ff45bd6565/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-09 12:03:26,191 INFO [Listener at localhost/40331] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e8501bb2-6b19-0548-742d-40ff45bd6565/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-09 12:03:26,191 INFO [Listener at localhost/40331] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e8501bb2-6b19-0548-742d-40ff45bd6565/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-09 12:03:26,191 INFO [Listener at localhost/40331] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e8501bb2-6b19-0548-742d-40ff45bd6565/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-09 12:03:26,191 INFO [Listener at localhost/40331] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e8501bb2-6b19-0548-742d-40ff45bd6565/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-09 12:03:26,191 INFO [Listener at localhost/40331] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e8501bb2-6b19-0548-742d-40ff45bd6565/nfs.dump.dir in system properties and HBase conf 2023-02-09 12:03:26,191 INFO [Listener at localhost/40331] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e8501bb2-6b19-0548-742d-40ff45bd6565/java.io.tmpdir in system properties and HBase conf 2023-02-09 12:03:26,191 INFO [Listener at localhost/40331] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e8501bb2-6b19-0548-742d-40ff45bd6565/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-09 12:03:26,191 INFO [Listener at localhost/40331] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e8501bb2-6b19-0548-742d-40ff45bd6565/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-09 12:03:26,191 INFO [Listener at localhost/40331] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e8501bb2-6b19-0548-742d-40ff45bd6565/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-09 12:03:26,196 WARN [Listener at localhost/40331] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-09 12:03:26,196 WARN [Listener at localhost/40331] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-09 12:03:26,237 WARN [Listener at localhost/40331] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 12:03:26,239 INFO [Listener at localhost/40331] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 12:03:26,244 INFO [Listener at localhost/40331] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e8501bb2-6b19-0548-742d-40ff45bd6565/java.io.tmpdir/Jetty_localhost_36409_hdfs____tgvov8/webapp 2023-02-09 12:03:26,336 INFO [Listener at localhost/40331] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36409 2023-02-09 12:03:26,341 WARN [Listener at localhost/40331] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-09 12:03:26,341 WARN [Listener at localhost/40331] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-09 12:03:26,385 WARN [Listener at localhost/46449] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 12:03:26,397 WARN [Listener at localhost/46449] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-09 12:03:26,398 WARN [Listener at localhost/46449] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 12:03:26,399 INFO [Listener at localhost/46449] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 12:03:26,403 INFO [Listener at localhost/46449] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e8501bb2-6b19-0548-742d-40ff45bd6565/java.io.tmpdir/Jetty_localhost_44475_datanode____.3oz7gn/webapp 2023-02-09 12:03:26,494 INFO [Listener at localhost/46449] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44475 2023-02-09 12:03:26,501 WARN [Listener at localhost/33965] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 12:03:26,517 WARN [Listener at localhost/33965] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-09 12:03:26,519 WARN [Listener at localhost/33965] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 12:03:26,520 INFO [Listener at localhost/33965] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 12:03:26,525 INFO [Listener at localhost/33965] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e8501bb2-6b19-0548-742d-40ff45bd6565/java.io.tmpdir/Jetty_localhost_40885_datanode____.km4uhs/webapp 2023-02-09 12:03:26,593 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf3707b88d5bc358e: Processing first storage report for DS-00fb2fb7-4cac-4eca-aece-a4bebe015fcf from datanode cbad1f9c-d739-4d57-92e7-67f8a8b0b87c 2023-02-09 12:03:26,593 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf3707b88d5bc358e: from storage DS-00fb2fb7-4cac-4eca-aece-a4bebe015fcf node DatanodeRegistration(127.0.0.1:42857, datanodeUuid=cbad1f9c-d739-4d57-92e7-67f8a8b0b87c, infoPort=45725, infoSecurePort=0, ipcPort=33965, storageInfo=lv=-57;cid=testClusterID;nsid=1234085713;c=1675944206198), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 12:03:26,593 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf3707b88d5bc358e: Processing first storage report for DS-8e0e98c9-cddc-4223-bb00-045b906ba3d5 from datanode cbad1f9c-d739-4d57-92e7-67f8a8b0b87c 2023-02-09 12:03:26,593 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf3707b88d5bc358e: from storage DS-8e0e98c9-cddc-4223-bb00-045b906ba3d5 node DatanodeRegistration(127.0.0.1:42857, datanodeUuid=cbad1f9c-d739-4d57-92e7-67f8a8b0b87c, infoPort=45725, infoSecurePort=0, ipcPort=33965, storageInfo=lv=-57;cid=testClusterID;nsid=1234085713;c=1675944206198), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 12:03:26,623 INFO [Listener at localhost/33965] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40885 2023-02-09 12:03:26,629 WARN [Listener at localhost/46711] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 12:03:26,717 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4f7c602460a505a4: Processing first storage report for DS-522f5051-0dc1-4537-b64b-b0a5fcb5ccee from datanode 6657d425-3038-4dc7-9ed9-71075f995e06 2023-02-09 12:03:26,718 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4f7c602460a505a4: from storage DS-522f5051-0dc1-4537-b64b-b0a5fcb5ccee node DatanodeRegistration(127.0.0.1:41207, datanodeUuid=6657d425-3038-4dc7-9ed9-71075f995e06, infoPort=34165, infoSecurePort=0, ipcPort=46711, storageInfo=lv=-57;cid=testClusterID;nsid=1234085713;c=1675944206198), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-09 12:03:26,718 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4f7c602460a505a4: Processing first storage report for DS-dd40c43a-b08c-43ef-b4c1-9f7b1d68771b from datanode 6657d425-3038-4dc7-9ed9-71075f995e06 2023-02-09 12:03:26,718 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4f7c602460a505a4: from storage DS-dd40c43a-b08c-43ef-b4c1-9f7b1d68771b node DatanodeRegistration(127.0.0.1:41207, datanodeUuid=6657d425-3038-4dc7-9ed9-71075f995e06, infoPort=34165, infoSecurePort=0, ipcPort=46711, storageInfo=lv=-57;cid=testClusterID;nsid=1234085713;c=1675944206198), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 12:03:26,736 DEBUG [Listener at localhost/46711] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e8501bb2-6b19-0548-742d-40ff45bd6565 2023-02-09 12:03:26,738 INFO [Listener at localhost/46711] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e8501bb2-6b19-0548-742d-40ff45bd6565/cluster_1b9eeb62-70a0-0dff-041f-8e422d850948/zookeeper_0, clientPort=56361, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e8501bb2-6b19-0548-742d-40ff45bd6565/cluster_1b9eeb62-70a0-0dff-041f-8e422d850948/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e8501bb2-6b19-0548-742d-40ff45bd6565/cluster_1b9eeb62-70a0-0dff-041f-8e422d850948/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-09 12:03:26,739 INFO [Listener at localhost/46711] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=56361 2023-02-09 12:03:26,739 INFO [Listener at localhost/46711] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 12:03:26,740 INFO [Listener at localhost/46711] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 12:03:26,755 INFO [Listener at localhost/46711] util.FSUtils(479): Created version file at hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2 with version=8 2023-02-09 12:03:26,756 INFO [Listener at localhost/46711] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 12:03:26,756 INFO [Listener at localhost/46711] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 12:03:26,757 INFO [Listener at localhost/46711] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:46449/user/jenkins/test-data/9280551e-bc5a-0255-4864-4ac8ecb20e21/hbase-staging 2023-02-09 12:03:26,759 INFO [Listener at localhost/46711] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 12:03:26,759 INFO [Listener at localhost/46711] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 12:03:26,759 INFO [Listener at localhost/46711] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 12:03:26,759 INFO [Listener at localhost/46711] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 12:03:26,759 INFO [Listener at localhost/46711] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 12:03:26,759 INFO [Listener at localhost/46711] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 12:03:26,759 INFO [Listener at localhost/46711] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 12:03:26,760 INFO [Listener at localhost/46711] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33037 2023-02-09 12:03:26,761 INFO [Listener at localhost/46711] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 12:03:26,761 INFO [Listener at localhost/46711] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 12:03:26,762 INFO [Listener at localhost/46711] zookeeper.RecoverableZooKeeper(93): Process identifier=master:33037 connecting to ZooKeeper ensemble=127.0.0.1:56361 2023-02-09 12:03:26,768 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): master:330370x0, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 12:03:26,769 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:33037-0x10038f70b570000 connected 2023-02-09 12:03:26,791 DEBUG [Listener at localhost/46711] zookeeper.ZKUtil(164): master:33037-0x10038f70b570000, quorum=127.0.0.1:56361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 12:03:26,791 DEBUG [Listener at localhost/46711] zookeeper.ZKUtil(164): master:33037-0x10038f70b570000, quorum=127.0.0.1:56361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 12:03:26,792 DEBUG [Listener at localhost/46711] zookeeper.ZKUtil(164): master:33037-0x10038f70b570000, quorum=127.0.0.1:56361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 12:03:26,797 DEBUG [Listener at localhost/46711] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33037 2023-02-09 12:03:26,797 DEBUG [Listener at localhost/46711] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33037 2023-02-09 12:03:26,797 DEBUG [Listener at localhost/46711] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33037 2023-02-09 12:03:26,800 DEBUG [Listener at localhost/46711] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33037 2023-02-09 12:03:26,800 DEBUG [Listener at localhost/46711] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33037 2023-02-09 12:03:26,800 INFO [Listener at localhost/46711] master.HMaster(439): hbase.rootdir=hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2, hbase.cluster.distributed=false 2023-02-09 12:03:26,814 INFO [Listener at localhost/46711] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 12:03:26,814 INFO [Listener at localhost/46711] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 12:03:26,814 INFO [Listener at localhost/46711] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 12:03:26,814 INFO [Listener at localhost/46711] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 12:03:26,814 INFO [Listener at localhost/46711] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 12:03:26,814 INFO [Listener at localhost/46711] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 12:03:26,815 INFO [Listener at localhost/46711] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 12:03:26,815 INFO [Listener at localhost/46711] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39395 2023-02-09 12:03:26,816 INFO [Listener at localhost/46711] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-09 12:03:26,816 DEBUG [Listener at localhost/46711] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 12:03:26,816 INFO [Listener at localhost/46711] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 12:03:26,817 INFO [Listener at localhost/46711] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 12:03:26,818 INFO [Listener at localhost/46711] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39395 connecting to ZooKeeper ensemble=127.0.0.1:56361 2023-02-09 12:03:26,821 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): regionserver:393950x0, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 12:03:26,822 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:39395-0x10038f70b570001 connected 2023-02-09 12:03:26,822 DEBUG [Listener at localhost/46711] zookeeper.ZKUtil(164): regionserver:39395-0x10038f70b570001, quorum=127.0.0.1:56361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 12:03:26,822 DEBUG [Listener at localhost/46711] zookeeper.ZKUtil(164): regionserver:39395-0x10038f70b570001, quorum=127.0.0.1:56361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 12:03:26,823 DEBUG [Listener at localhost/46711] zookeeper.ZKUtil(164): regionserver:39395-0x10038f70b570001, quorum=127.0.0.1:56361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 12:03:26,823 DEBUG [Listener at localhost/46711] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39395 2023-02-09 12:03:26,823 DEBUG [Listener at localhost/46711] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39395 2023-02-09 12:03:26,823 DEBUG [Listener at localhost/46711] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39395 2023-02-09 12:03:26,824 DEBUG [Listener at localhost/46711] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39395 2023-02-09 12:03:26,827 DEBUG [Listener at localhost/46711] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39395 2023-02-09 12:03:26,838 INFO [Listener at localhost/46711] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 12:03:26,838 INFO [Listener at localhost/46711] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 12:03:26,838 INFO [Listener at localhost/46711] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 12:03:26,838 INFO [Listener at localhost/46711] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 12:03:26,838 INFO [Listener at localhost/46711] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 12:03:26,838 INFO [Listener at localhost/46711] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 12:03:26,838 INFO [Listener at localhost/46711] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 12:03:26,839 INFO [Listener at localhost/46711] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44829 2023-02-09 12:03:26,839 INFO [Listener at localhost/46711] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-09 12:03:26,840 DEBUG [Listener at localhost/46711] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 12:03:26,840 INFO [Listener at localhost/46711] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 12:03:26,841 INFO [Listener at localhost/46711] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 12:03:26,842 INFO [Listener at localhost/46711] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44829 connecting to ZooKeeper ensemble=127.0.0.1:56361 2023-02-09 12:03:26,844 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): regionserver:448290x0, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 12:03:26,845 DEBUG [Listener at localhost/46711] zookeeper.ZKUtil(164): regionserver:448290x0, quorum=127.0.0.1:56361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 12:03:26,846 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:44829-0x10038f70b570002 connected 2023-02-09 12:03:26,846 DEBUG [Listener at localhost/46711] zookeeper.ZKUtil(164): regionserver:44829-0x10038f70b570002, quorum=127.0.0.1:56361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 12:03:26,846 DEBUG [Listener at localhost/46711] zookeeper.ZKUtil(164): regionserver:44829-0x10038f70b570002, quorum=127.0.0.1:56361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 12:03:26,847 DEBUG [Listener at localhost/46711] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44829 2023-02-09 12:03:26,847 DEBUG [Listener at localhost/46711] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44829 2023-02-09 12:03:26,847 DEBUG [Listener at localhost/46711] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44829 2023-02-09 12:03:26,852 DEBUG [Listener at localhost/46711] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44829 2023-02-09 12:03:26,852 DEBUG [Listener at localhost/46711] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44829 2023-02-09 12:03:26,854 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,33037,1675944206758 2023-02-09 12:03:26,856 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): master:33037-0x10038f70b570000, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-09 12:03:26,856 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33037-0x10038f70b570000, quorum=127.0.0.1:56361, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,33037,1675944206758 2023-02-09 12:03:26,858 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): regionserver:39395-0x10038f70b570001, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 12:03:26,858 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): master:33037-0x10038f70b570000, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 12:03:26,858 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): regionserver:44829-0x10038f70b570002, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 12:03:26,858 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): master:33037-0x10038f70b570000, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 12:03:26,860 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33037-0x10038f70b570000, quorum=127.0.0.1:56361, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-09 12:03:26,862 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,33037,1675944206758 from backup master directory 2023-02-09 12:03:26,862 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:33037-0x10038f70b570000, quorum=127.0.0.1:56361, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-09 12:03:26,863 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): master:33037-0x10038f70b570000, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,33037,1675944206758 2023-02-09 12:03:26,863 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): master:33037-0x10038f70b570000, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-09 12:03:26,863 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 12:03:26,863 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,33037,1675944206758 2023-02-09 12:03:26,875 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/hbase.id with ID: 8446b26f-4243-4d97-87b5-02350276765d 2023-02-09 12:03:26,883 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 12:03:26,885 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): master:33037-0x10038f70b570000, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 12:03:26,894 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x52ff1052 to 127.0.0.1:56361 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 12:03:26,898 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3edac45d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 12:03:26,898 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-09 12:03:26,898 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-09 12:03:26,898 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 12:03:26,900 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/MasterData/data/master/store-tmp 2023-02-09 12:03:26,906 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:26,906 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-09 12:03:26,906 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 12:03:26,906 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 12:03:26,906 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-09 12:03:26,906 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 12:03:26,906 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 12:03:26,906 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675944206906Disabling compacts and flushes for region at 1675944206906Disabling writes for close at 1675944206906Writing region close event to WAL at 1675944206906Closed at 1675944206906 2023-02-09 12:03:26,907 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/MasterData/WALs/jenkins-hbase4.apache.org,33037,1675944206758 2023-02-09 12:03:26,909 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33037%2C1675944206758, suffix=, logDir=hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/MasterData/WALs/jenkins-hbase4.apache.org,33037,1675944206758, archiveDir=hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/MasterData/oldWALs, maxLogs=10 2023-02-09 12:03:26,926 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41207,DS-522f5051-0dc1-4537-b64b-b0a5fcb5ccee,DISK] 2023-02-09 12:03:26,927 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42857,DS-00fb2fb7-4cac-4eca-aece-a4bebe015fcf,DISK] 2023-02-09 12:03:26,932 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/MasterData/WALs/jenkins-hbase4.apache.org,33037,1675944206758/jenkins-hbase4.apache.org%2C33037%2C1675944206758.1675944206909 2023-02-09 12:03:26,932 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41207,DS-522f5051-0dc1-4537-b64b-b0a5fcb5ccee,DISK], DatanodeInfoWithStorage[127.0.0.1:42857,DS-00fb2fb7-4cac-4eca-aece-a4bebe015fcf,DISK]] 2023-02-09 12:03:26,932 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-09 12:03:26,933 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:26,933 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 12:03:26,933 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 12:03:26,934 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-09 12:03:26,935 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-09 12:03:26,935 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-09 12:03:26,936 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:26,936 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-09 12:03:26,937 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-09 12:03:26,938 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 12:03:26,940 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 12:03:26,940 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70514882, jitterRate=0.050753623247146606}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 12:03:26,940 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1675944206933Initializing all the Stores at 1675944206933Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944206933Cleaning up temporary data from old regions at 1675944206937 (+4 ms)Cleaning up detritus from prior splits at 1675944206937Region opened successfully at 1675944206940 (+3 ms) 2023-02-09 12:03:26,940 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-09 12:03:26,941 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-09 12:03:26,941 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-09 12:03:26,941 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-09 12:03:26,942 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-09 12:03:26,942 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-09 12:03:26,942 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-09 12:03:26,943 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-09 12:03:26,943 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-09 12:03:26,953 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-09 12:03:26,953 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-09 12:03:26,953 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33037-0x10038f70b570000, quorum=127.0.0.1:56361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-09 12:03:26,953 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-09 12:03:26,954 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33037-0x10038f70b570000, quorum=127.0.0.1:56361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-09 12:03:26,955 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): master:33037-0x10038f70b570000, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 12:03:26,956 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33037-0x10038f70b570000, quorum=127.0.0.1:56361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-09 12:03:26,956 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33037-0x10038f70b570000, quorum=127.0.0.1:56361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-09 12:03:26,957 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33037-0x10038f70b570000, quorum=127.0.0.1:56361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-09 12:03:26,958 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): regionserver:39395-0x10038f70b570001, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 12:03:26,958 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): master:33037-0x10038f70b570000, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 12:03:26,958 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): regionserver:44829-0x10038f70b570002, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 12:03:26,958 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): master:33037-0x10038f70b570000, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 12:03:26,958 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,33037,1675944206758, sessionid=0x10038f70b570000, setting cluster-up flag (Was=false) 2023-02-09 12:03:26,965 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): master:33037-0x10038f70b570000, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 12:03:26,969 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-09 12:03:26,969 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,33037,1675944206758 2023-02-09 12:03:26,972 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): master:33037-0x10038f70b570000, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 12:03:26,977 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-09 12:03:26,977 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,33037,1675944206758 2023-02-09 12:03:26,978 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/.hbase-snapshot/.tmp 2023-02-09 12:03:26,979 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-09 12:03:26,979 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 12:03:26,979 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 12:03:26,979 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 12:03:26,979 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 12:03:26,979 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-09 12:03:26,979 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:26,979 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 12:03:26,979 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:26,984 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1675944236984 2023-02-09 12:03:26,984 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-09 12:03:26,984 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-09 12:03:26,984 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-09 12:03:26,984 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-09 12:03:26,984 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-09 12:03:26,984 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-09 12:03:26,984 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:26,984 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-09 12:03:26,984 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-09 12:03:26,985 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-09 12:03:26,985 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-09 12:03:26,985 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-09 12:03:26,986 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-09 12:03:26,987 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-09 12:03:26,987 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-09 12:03:26,987 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675944206987,5,FailOnTimeoutGroup] 2023-02-09 12:03:26,987 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675944206987,5,FailOnTimeoutGroup] 2023-02-09 12:03:26,987 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:26,987 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-09 12:03:26,987 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:26,987 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:26,994 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-09 12:03:26,995 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-09 12:03:26,995 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2 2023-02-09 12:03:27,004 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:27,006 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-09 12:03:27,007 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/data/hbase/meta/1588230740/info 2023-02-09 12:03:27,008 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-09 12:03:27,008 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:27,008 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-09 12:03:27,009 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/data/hbase/meta/1588230740/rep_barrier 2023-02-09 12:03:27,009 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-09 12:03:27,010 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:27,010 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-09 12:03:27,011 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/data/hbase/meta/1588230740/table 2023-02-09 12:03:27,011 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-09 12:03:27,011 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:27,012 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/data/hbase/meta/1588230740 2023-02-09 12:03:27,012 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/data/hbase/meta/1588230740 2023-02-09 12:03:27,013 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-09 12:03:27,014 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-09 12:03:27,015 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 12:03:27,016 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70998030, jitterRate=0.057953089475631714}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-09 12:03:27,016 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1675944207005Initializing all the Stores at 1675944207005Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675944207005Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944207006 (+1 ms)Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675944207006Cleaning up temporary data from old regions at 1675944207013 (+7 ms)Cleaning up detritus from prior splits at 1675944207013Region opened successfully at 1675944207016 (+3 ms) 2023-02-09 12:03:27,016 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-09 12:03:27,016 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-09 12:03:27,016 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-09 12:03:27,016 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-09 12:03:27,016 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-09 12:03:27,016 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-09 12:03:27,016 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675944207016Disabling compacts and flushes for region at 1675944207016Disabling writes for close at 1675944207016Writing region close event to WAL at 1675944207016Closed at 1675944207016 2023-02-09 12:03:27,017 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-09 12:03:27,017 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-09 12:03:27,017 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-09 12:03:27,019 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-09 12:03:27,020 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-09 12:03:27,054 INFO [RS:0;jenkins-hbase4:39395] regionserver.HRegionServer(952): ClusterId : 8446b26f-4243-4d97-87b5-02350276765d 2023-02-09 12:03:27,054 INFO [RS:1;jenkins-hbase4:44829] regionserver.HRegionServer(952): ClusterId : 8446b26f-4243-4d97-87b5-02350276765d 2023-02-09 12:03:27,054 DEBUG [RS:0;jenkins-hbase4:39395] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-09 12:03:27,054 DEBUG [RS:1;jenkins-hbase4:44829] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-09 12:03:27,056 DEBUG [RS:1;jenkins-hbase4:44829] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-09 12:03:27,056 DEBUG [RS:1;jenkins-hbase4:44829] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-09 12:03:27,056 DEBUG [RS:0;jenkins-hbase4:39395] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-09 12:03:27,056 DEBUG [RS:0;jenkins-hbase4:39395] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-09 12:03:27,059 DEBUG [RS:1;jenkins-hbase4:44829] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-09 12:03:27,060 DEBUG [RS:1;jenkins-hbase4:44829] zookeeper.ReadOnlyZKClient(139): Connect 0x7cc4e8fe to 127.0.0.1:56361 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 12:03:27,060 DEBUG [RS:0;jenkins-hbase4:39395] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-09 12:03:27,061 DEBUG [RS:0;jenkins-hbase4:39395] zookeeper.ReadOnlyZKClient(139): Connect 0x2ab2a1c0 to 127.0.0.1:56361 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 12:03:27,064 DEBUG [RS:1;jenkins-hbase4:44829] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@72031916, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 12:03:27,064 DEBUG [RS:1;jenkins-hbase4:44829] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@763c838e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 12:03:27,068 DEBUG [RS:0;jenkins-hbase4:39395] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@24755ae6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 12:03:27,068 DEBUG [RS:0;jenkins-hbase4:39395] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@204acab0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 12:03:27,073 DEBUG [RS:1;jenkins-hbase4:44829] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:44829 2023-02-09 12:03:27,073 INFO [RS:1;jenkins-hbase4:44829] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-09 12:03:27,073 INFO [RS:1;jenkins-hbase4:44829] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-09 12:03:27,073 DEBUG [RS:1;jenkins-hbase4:44829] regionserver.HRegionServer(1023): About to register with Master. 2023-02-09 12:03:27,073 INFO [RS:1;jenkins-hbase4:44829] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,33037,1675944206758 with isa=jenkins-hbase4.apache.org/172.31.14.131:44829, startcode=1675944206837 2023-02-09 12:03:27,073 DEBUG [RS:1;jenkins-hbase4:44829] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-09 12:03:27,075 INFO [RS-EventLoopGroup-18-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48967, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.11 (auth:SIMPLE), service=RegionServerStatusService 2023-02-09 12:03:27,077 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33037] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,44829,1675944206837 2023-02-09 12:03:27,077 DEBUG [RS:1;jenkins-hbase4:44829] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2 2023-02-09 12:03:27,077 DEBUG [RS:0;jenkins-hbase4:39395] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:39395 2023-02-09 12:03:27,077 DEBUG [RS:1;jenkins-hbase4:44829] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:46449 2023-02-09 12:03:27,077 INFO [RS:0;jenkins-hbase4:39395] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-09 12:03:27,077 INFO [RS:0;jenkins-hbase4:39395] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-09 12:03:27,077 DEBUG [RS:1;jenkins-hbase4:44829] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-09 12:03:27,077 DEBUG [RS:0;jenkins-hbase4:39395] regionserver.HRegionServer(1023): About to register with Master. 2023-02-09 12:03:27,079 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): master:33037-0x10038f70b570000, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 12:03:27,079 INFO [RS:0;jenkins-hbase4:39395] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,33037,1675944206758 with isa=jenkins-hbase4.apache.org/172.31.14.131:39395, startcode=1675944206814 2023-02-09 12:03:27,079 DEBUG [RS:0;jenkins-hbase4:39395] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-09 12:03:27,079 DEBUG [RS:1;jenkins-hbase4:44829] zookeeper.ZKUtil(162): regionserver:44829-0x10038f70b570002, quorum=127.0.0.1:56361, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44829,1675944206837 2023-02-09 12:03:27,079 WARN [RS:1;jenkins-hbase4:44829] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 12:03:27,080 INFO [RS:1;jenkins-hbase4:44829] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 12:03:27,080 DEBUG [RS:1;jenkins-hbase4:44829] regionserver.HRegionServer(1947): logDir=hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/WALs/jenkins-hbase4.apache.org,44829,1675944206837 2023-02-09 12:03:27,080 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,44829,1675944206837] 2023-02-09 12:03:27,082 INFO [RS-EventLoopGroup-18-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44537, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.10 (auth:SIMPLE), service=RegionServerStatusService 2023-02-09 12:03:27,082 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33037] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,39395,1675944206814 2023-02-09 12:03:27,083 DEBUG [RS:0;jenkins-hbase4:39395] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2 2023-02-09 12:03:27,083 DEBUG [RS:0;jenkins-hbase4:39395] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:46449 2023-02-09 12:03:27,083 DEBUG [RS:0;jenkins-hbase4:39395] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-09 12:03:27,083 DEBUG [RS:1;jenkins-hbase4:44829] zookeeper.ZKUtil(162): regionserver:44829-0x10038f70b570002, quorum=127.0.0.1:56361, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44829,1675944206837 2023-02-09 12:03:27,093 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): regionserver:44829-0x10038f70b570002, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 12:03:27,093 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): master:33037-0x10038f70b570000, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 12:03:27,093 DEBUG [RS:0;jenkins-hbase4:39395] zookeeper.ZKUtil(162): regionserver:39395-0x10038f70b570001, quorum=127.0.0.1:56361, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39395,1675944206814 2023-02-09 12:03:27,093 WARN [RS:0;jenkins-hbase4:39395] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 12:03:27,093 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,39395,1675944206814] 2023-02-09 12:03:27,093 DEBUG [RS:1;jenkins-hbase4:44829] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-09 12:03:27,093 INFO [RS:0;jenkins-hbase4:39395] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 12:03:27,093 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:44829-0x10038f70b570002, quorum=127.0.0.1:56361, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44829,1675944206837 2023-02-09 12:03:27,093 INFO [RS:1;jenkins-hbase4:44829] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-09 12:03:27,093 DEBUG [RS:0;jenkins-hbase4:39395] regionserver.HRegionServer(1947): logDir=hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/WALs/jenkins-hbase4.apache.org,39395,1675944206814 2023-02-09 12:03:27,094 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:44829-0x10038f70b570002, quorum=127.0.0.1:56361, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39395,1675944206814 2023-02-09 12:03:27,096 INFO [RS:1;jenkins-hbase4:44829] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-09 12:03:27,096 INFO [RS:1;jenkins-hbase4:44829] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 12:03:27,096 INFO [RS:1;jenkins-hbase4:44829] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:27,097 DEBUG [RS:0;jenkins-hbase4:39395] zookeeper.ZKUtil(162): regionserver:39395-0x10038f70b570001, quorum=127.0.0.1:56361, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44829,1675944206837 2023-02-09 12:03:27,097 INFO [RS:1;jenkins-hbase4:44829] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-09 12:03:27,097 DEBUG [RS:0;jenkins-hbase4:39395] zookeeper.ZKUtil(162): regionserver:39395-0x10038f70b570001, quorum=127.0.0.1:56361, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39395,1675944206814 2023-02-09 12:03:27,098 INFO [RS:1;jenkins-hbase4:44829] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:27,098 DEBUG [RS:1;jenkins-hbase4:44829] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:27,098 DEBUG [RS:1;jenkins-hbase4:44829] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:27,098 DEBUG [RS:1;jenkins-hbase4:44829] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:27,098 DEBUG [RS:1;jenkins-hbase4:44829] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:27,098 DEBUG [RS:1;jenkins-hbase4:44829] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:27,098 DEBUG [RS:1;jenkins-hbase4:44829] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 12:03:27,098 DEBUG [RS:1;jenkins-hbase4:44829] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:27,098 DEBUG [RS:0;jenkins-hbase4:39395] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-09 12:03:27,098 DEBUG [RS:1;jenkins-hbase4:44829] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:27,098 DEBUG [RS:1;jenkins-hbase4:44829] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:27,098 DEBUG [RS:1;jenkins-hbase4:44829] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:27,098 INFO [RS:0;jenkins-hbase4:39395] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-09 12:03:27,104 INFO [RS:0;jenkins-hbase4:39395] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-09 12:03:27,104 INFO [RS:1;jenkins-hbase4:44829] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:27,104 INFO [RS:1;jenkins-hbase4:44829] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:27,104 INFO [RS:0;jenkins-hbase4:39395] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 12:03:27,104 INFO [RS:1;jenkins-hbase4:44829] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:27,105 INFO [RS:0;jenkins-hbase4:39395] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:27,105 INFO [RS:0;jenkins-hbase4:39395] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-09 12:03:27,106 INFO [RS:0;jenkins-hbase4:39395] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:27,107 DEBUG [RS:0;jenkins-hbase4:39395] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:27,107 DEBUG [RS:0;jenkins-hbase4:39395] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:27,107 DEBUG [RS:0;jenkins-hbase4:39395] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:27,107 DEBUG [RS:0;jenkins-hbase4:39395] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:27,107 DEBUG [RS:0;jenkins-hbase4:39395] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:27,107 DEBUG [RS:0;jenkins-hbase4:39395] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 12:03:27,107 DEBUG [RS:0;jenkins-hbase4:39395] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:27,107 DEBUG [RS:0;jenkins-hbase4:39395] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:27,107 DEBUG [RS:0;jenkins-hbase4:39395] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:27,107 DEBUG [RS:0;jenkins-hbase4:39395] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:27,112 INFO [RS:0;jenkins-hbase4:39395] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:27,112 INFO [RS:0;jenkins-hbase4:39395] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:27,112 INFO [RS:0;jenkins-hbase4:39395] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:27,119 INFO [RS:1;jenkins-hbase4:44829] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-09 12:03:27,119 INFO [RS:1;jenkins-hbase4:44829] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44829,1675944206837-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:27,122 INFO [RS:0;jenkins-hbase4:39395] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-09 12:03:27,122 INFO [RS:0;jenkins-hbase4:39395] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39395,1675944206814-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:27,130 INFO [RS:1;jenkins-hbase4:44829] regionserver.Replication(203): jenkins-hbase4.apache.org,44829,1675944206837 started 2023-02-09 12:03:27,130 INFO [RS:1;jenkins-hbase4:44829] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,44829,1675944206837, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:44829, sessionid=0x10038f70b570002 2023-02-09 12:03:27,130 DEBUG [RS:1;jenkins-hbase4:44829] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-09 12:03:27,130 DEBUG [RS:1;jenkins-hbase4:44829] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,44829,1675944206837 2023-02-09 12:03:27,130 DEBUG [RS:1;jenkins-hbase4:44829] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44829,1675944206837' 2023-02-09 12:03:27,130 DEBUG [RS:1;jenkins-hbase4:44829] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 12:03:27,131 DEBUG [RS:1;jenkins-hbase4:44829] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 12:03:27,131 DEBUG [RS:1;jenkins-hbase4:44829] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-09 12:03:27,131 DEBUG [RS:1;jenkins-hbase4:44829] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-09 12:03:27,131 DEBUG [RS:1;jenkins-hbase4:44829] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,44829,1675944206837 2023-02-09 12:03:27,131 DEBUG [RS:1;jenkins-hbase4:44829] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44829,1675944206837' 2023-02-09 12:03:27,131 DEBUG [RS:1;jenkins-hbase4:44829] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 12:03:27,131 DEBUG [RS:1;jenkins-hbase4:44829] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 12:03:27,132 DEBUG [RS:1;jenkins-hbase4:44829] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-09 12:03:27,132 INFO [RS:1;jenkins-hbase4:44829] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-09 12:03:27,132 INFO [RS:1;jenkins-hbase4:44829] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-09 12:03:27,136 INFO [RS:0;jenkins-hbase4:39395] regionserver.Replication(203): jenkins-hbase4.apache.org,39395,1675944206814 started 2023-02-09 12:03:27,136 INFO [RS:0;jenkins-hbase4:39395] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,39395,1675944206814, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:39395, sessionid=0x10038f70b570001 2023-02-09 12:03:27,136 DEBUG [RS:0;jenkins-hbase4:39395] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-09 12:03:27,136 DEBUG [RS:0;jenkins-hbase4:39395] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,39395,1675944206814 2023-02-09 12:03:27,136 DEBUG [RS:0;jenkins-hbase4:39395] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39395,1675944206814' 2023-02-09 12:03:27,136 DEBUG [RS:0;jenkins-hbase4:39395] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 12:03:27,136 DEBUG [RS:0;jenkins-hbase4:39395] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 12:03:27,137 DEBUG [RS:0;jenkins-hbase4:39395] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-09 12:03:27,137 DEBUG [RS:0;jenkins-hbase4:39395] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-09 12:03:27,137 DEBUG [RS:0;jenkins-hbase4:39395] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,39395,1675944206814 2023-02-09 12:03:27,137 DEBUG [RS:0;jenkins-hbase4:39395] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39395,1675944206814' 2023-02-09 12:03:27,137 DEBUG [RS:0;jenkins-hbase4:39395] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 12:03:27,137 DEBUG [RS:0;jenkins-hbase4:39395] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 12:03:27,137 DEBUG [RS:0;jenkins-hbase4:39395] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-09 12:03:27,137 INFO [RS:0;jenkins-hbase4:39395] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-09 12:03:27,137 INFO [RS:0;jenkins-hbase4:39395] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-09 12:03:27,170 DEBUG [jenkins-hbase4:33037] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-09 12:03:27,170 DEBUG [jenkins-hbase4:33037] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 12:03:27,172 DEBUG [jenkins-hbase4:33037] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 12:03:27,172 DEBUG [jenkins-hbase4:33037] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 12:03:27,172 DEBUG [jenkins-hbase4:33037] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 12:03:27,172 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,39395,1675944206814, state=OPENING 2023-02-09 12:03:27,173 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-09 12:03:27,175 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): master:33037-0x10038f70b570000, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 12:03:27,175 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,39395,1675944206814}] 2023-02-09 12:03:27,175 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-09 12:03:27,330 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,39395,1675944206814 2023-02-09 12:03:27,330 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-09 12:03:27,332 INFO [RS-EventLoopGroup-19-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59970, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-09 12:03:27,335 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-09 12:03:27,336 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 12:03:27,337 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39395%2C1675944206814.meta, suffix=.meta, logDir=hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/WALs/jenkins-hbase4.apache.org,39395,1675944206814, archiveDir=hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/oldWALs, maxLogs=32 2023-02-09 12:03:27,350 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42857,DS-00fb2fb7-4cac-4eca-aece-a4bebe015fcf,DISK] 2023-02-09 12:03:27,350 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41207,DS-522f5051-0dc1-4537-b64b-b0a5fcb5ccee,DISK] 2023-02-09 12:03:27,351 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/WALs/jenkins-hbase4.apache.org,39395,1675944206814/jenkins-hbase4.apache.org%2C39395%2C1675944206814.meta.1675944207337.meta 2023-02-09 12:03:27,352 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42857,DS-00fb2fb7-4cac-4eca-aece-a4bebe015fcf,DISK], DatanodeInfoWithStorage[127.0.0.1:41207,DS-522f5051-0dc1-4537-b64b-b0a5fcb5ccee,DISK]] 2023-02-09 12:03:27,352 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-09 12:03:27,352 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-09 12:03:27,352 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-09 12:03:27,352 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-09 12:03:27,352 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-09 12:03:27,352 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:27,352 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-09 12:03:27,352 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-09 12:03:27,353 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-09 12:03:27,354 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/data/hbase/meta/1588230740/info 2023-02-09 12:03:27,354 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/data/hbase/meta/1588230740/info 2023-02-09 12:03:27,354 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-09 12:03:27,355 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:27,355 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-09 12:03:27,355 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/data/hbase/meta/1588230740/rep_barrier 2023-02-09 12:03:27,355 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/data/hbase/meta/1588230740/rep_barrier 2023-02-09 12:03:27,356 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-09 12:03:27,356 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:27,356 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-09 12:03:27,357 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/data/hbase/meta/1588230740/table 2023-02-09 12:03:27,357 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/data/hbase/meta/1588230740/table 2023-02-09 12:03:27,357 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-09 12:03:27,357 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:27,358 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/data/hbase/meta/1588230740 2023-02-09 12:03:27,358 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/data/hbase/meta/1588230740 2023-02-09 12:03:27,360 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-09 12:03:27,361 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-09 12:03:27,361 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60779751, jitterRate=-0.09431113302707672}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-09 12:03:27,361 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1675944207352Writing region info on filesystem at 1675944207352Initializing all the Stores at 1675944207353 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675944207353Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944207353Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675944207353Cleaning up temporary data from old regions at 1675944207359 (+6 ms)Cleaning up detritus from prior splits at 1675944207359Running coprocessor post-open hooks at 1675944207361 (+2 ms)Region opened successfully at 1675944207361 2023-02-09 12:03:27,362 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1675944207330 2023-02-09 12:03:27,365 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-09 12:03:27,366 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-09 12:03:27,366 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,39395,1675944206814, state=OPEN 2023-02-09 12:03:27,369 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): master:33037-0x10038f70b570000, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-09 12:03:27,369 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-09 12:03:27,370 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-09 12:03:27,370 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,39395,1675944206814 in 194 msec 2023-02-09 12:03:27,371 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-09 12:03:27,371 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 353 msec 2023-02-09 12:03:27,372 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 394 msec 2023-02-09 12:03:27,373 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1675944206856, completionTime=-1 2023-02-09 12:03:27,373 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-09 12:03:27,373 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-09 12:03:27,375 DEBUG [hconnection-0x565041d7-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 12:03:27,377 INFO [RS-EventLoopGroup-19-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59976, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 12:03:27,378 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-09 12:03:27,378 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1675944267378 2023-02-09 12:03:27,378 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1675944327378 2023-02-09 12:03:27,378 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 5 msec 2023-02-09 12:03:27,387 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33037,1675944206758-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:27,387 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33037,1675944206758-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:27,387 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33037,1675944206758-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:27,387 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:33037, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:27,387 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:27,387 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-09 12:03:27,387 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-09 12:03:27,388 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-09 12:03:27,389 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-09 12:03:27,389 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 12:03:27,390 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 12:03:27,391 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/.tmp/data/hbase/namespace/758e194e6115e81cc0b4c28becca5aed 2023-02-09 12:03:27,392 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/.tmp/data/hbase/namespace/758e194e6115e81cc0b4c28becca5aed empty. 2023-02-09 12:03:27,392 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/.tmp/data/hbase/namespace/758e194e6115e81cc0b4c28becca5aed 2023-02-09 12:03:27,392 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-09 12:03:27,402 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-09 12:03:27,403 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 758e194e6115e81cc0b4c28becca5aed, NAME => 'hbase:namespace,,1675944207387.758e194e6115e81cc0b4c28becca5aed.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/.tmp 2023-02-09 12:03:27,409 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675944207387.758e194e6115e81cc0b4c28becca5aed.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:27,409 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 758e194e6115e81cc0b4c28becca5aed, disabling compactions & flushes 2023-02-09 12:03:27,409 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675944207387.758e194e6115e81cc0b4c28becca5aed. 2023-02-09 12:03:27,409 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675944207387.758e194e6115e81cc0b4c28becca5aed. 2023-02-09 12:03:27,409 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675944207387.758e194e6115e81cc0b4c28becca5aed. after waiting 0 ms 2023-02-09 12:03:27,409 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675944207387.758e194e6115e81cc0b4c28becca5aed. 2023-02-09 12:03:27,409 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675944207387.758e194e6115e81cc0b4c28becca5aed. 2023-02-09 12:03:27,409 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 758e194e6115e81cc0b4c28becca5aed: Waiting for close lock at 1675944207409Disabling compacts and flushes for region at 1675944207409Disabling writes for close at 1675944207409Writing region close event to WAL at 1675944207409Closed at 1675944207409 2023-02-09 12:03:27,411 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 12:03:27,412 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1675944207387.758e194e6115e81cc0b4c28becca5aed.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675944207412"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675944207412"}]},"ts":"1675944207412"} 2023-02-09 12:03:27,413 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-09 12:03:27,414 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 12:03:27,414 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675944207414"}]},"ts":"1675944207414"} 2023-02-09 12:03:27,415 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-09 12:03:27,423 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 12:03:27,424 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 12:03:27,424 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 12:03:27,424 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 12:03:27,424 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=758e194e6115e81cc0b4c28becca5aed, ASSIGN}] 2023-02-09 12:03:27,427 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=758e194e6115e81cc0b4c28becca5aed, ASSIGN 2023-02-09 12:03:27,427 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=758e194e6115e81cc0b4c28becca5aed, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39395,1675944206814; forceNewPlan=false, retain=false 2023-02-09 12:03:27,578 INFO [jenkins-hbase4:33037] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-09 12:03:27,578 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=758e194e6115e81cc0b4c28becca5aed, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39395,1675944206814 2023-02-09 12:03:27,578 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1675944207387.758e194e6115e81cc0b4c28becca5aed.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675944207578"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675944207578"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675944207578"}]},"ts":"1675944207578"} 2023-02-09 12:03:27,580 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 758e194e6115e81cc0b4c28becca5aed, server=jenkins-hbase4.apache.org,39395,1675944206814}] 2023-02-09 12:03:27,734 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1675944207387.758e194e6115e81cc0b4c28becca5aed. 2023-02-09 12:03:27,736 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39395%2C1675944206814, suffix=, logDir=hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/WALs/jenkins-hbase4.apache.org,39395,1675944206814, archiveDir=hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/oldWALs, maxLogs=32 2023-02-09 12:03:27,748 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42857,DS-00fb2fb7-4cac-4eca-aece-a4bebe015fcf,DISK] 2023-02-09 12:03:27,748 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41207,DS-522f5051-0dc1-4537-b64b-b0a5fcb5ccee,DISK] 2023-02-09 12:03:27,750 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/WALs/jenkins-hbase4.apache.org,39395,1675944206814/jenkins-hbase4.apache.org%2C39395%2C1675944206814.1675944207736 2023-02-09 12:03:27,750 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42857,DS-00fb2fb7-4cac-4eca-aece-a4bebe015fcf,DISK], DatanodeInfoWithStorage[127.0.0.1:41207,DS-522f5051-0dc1-4537-b64b-b0a5fcb5ccee,DISK]] 2023-02-09 12:03:27,750 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 758e194e6115e81cc0b4c28becca5aed, NAME => 'hbase:namespace,,1675944207387.758e194e6115e81cc0b4c28becca5aed.', STARTKEY => '', ENDKEY => ''} 2023-02-09 12:03:27,750 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 758e194e6115e81cc0b4c28becca5aed 2023-02-09 12:03:27,750 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675944207387.758e194e6115e81cc0b4c28becca5aed.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:27,750 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 758e194e6115e81cc0b4c28becca5aed 2023-02-09 12:03:27,750 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 758e194e6115e81cc0b4c28becca5aed 2023-02-09 12:03:27,751 INFO [StoreOpener-758e194e6115e81cc0b4c28becca5aed-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 758e194e6115e81cc0b4c28becca5aed 2023-02-09 12:03:27,753 DEBUG [StoreOpener-758e194e6115e81cc0b4c28becca5aed-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/data/hbase/namespace/758e194e6115e81cc0b4c28becca5aed/info 2023-02-09 12:03:27,753 DEBUG [StoreOpener-758e194e6115e81cc0b4c28becca5aed-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/data/hbase/namespace/758e194e6115e81cc0b4c28becca5aed/info 2023-02-09 12:03:27,753 INFO [StoreOpener-758e194e6115e81cc0b4c28becca5aed-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 758e194e6115e81cc0b4c28becca5aed columnFamilyName info 2023-02-09 12:03:27,753 INFO [StoreOpener-758e194e6115e81cc0b4c28becca5aed-1] regionserver.HStore(310): Store=758e194e6115e81cc0b4c28becca5aed/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:27,754 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/data/hbase/namespace/758e194e6115e81cc0b4c28becca5aed 2023-02-09 12:03:27,754 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/data/hbase/namespace/758e194e6115e81cc0b4c28becca5aed 2023-02-09 12:03:27,756 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 758e194e6115e81cc0b4c28becca5aed 2023-02-09 12:03:27,758 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/data/hbase/namespace/758e194e6115e81cc0b4c28becca5aed/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 12:03:27,758 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 758e194e6115e81cc0b4c28becca5aed; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72949300, jitterRate=0.08702927827835083}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 12:03:27,758 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 758e194e6115e81cc0b4c28becca5aed: Running coprocessor pre-open hook at 1675944207751Writing region info on filesystem at 1675944207751Initializing all the Stores at 1675944207751Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675944207751Cleaning up temporary data from old regions at 1675944207755 (+4 ms)Cleaning up detritus from prior splits at 1675944207755Running coprocessor post-open hooks at 1675944207758 (+3 ms)Region opened successfully at 1675944207758 2023-02-09 12:03:27,759 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1675944207387.758e194e6115e81cc0b4c28becca5aed., pid=6, masterSystemTime=1675944207732 2023-02-09 12:03:27,760 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1675944207387.758e194e6115e81cc0b4c28becca5aed. 2023-02-09 12:03:27,760 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1675944207387.758e194e6115e81cc0b4c28becca5aed. 2023-02-09 12:03:27,761 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=758e194e6115e81cc0b4c28becca5aed, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39395,1675944206814 2023-02-09 12:03:27,761 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1675944207387.758e194e6115e81cc0b4c28becca5aed.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675944207761"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675944207761"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675944207761"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675944207761"}]},"ts":"1675944207761"} 2023-02-09 12:03:27,763 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-09 12:03:27,763 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 758e194e6115e81cc0b4c28becca5aed, server=jenkins-hbase4.apache.org,39395,1675944206814 in 182 msec 2023-02-09 12:03:27,764 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-09 12:03:27,765 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=758e194e6115e81cc0b4c28becca5aed, ASSIGN in 339 msec 2023-02-09 12:03:27,765 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 12:03:27,765 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675944207765"}]},"ts":"1675944207765"} 2023-02-09 12:03:27,766 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-09 12:03:27,768 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 12:03:27,769 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 381 msec 2023-02-09 12:03:27,789 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33037-0x10038f70b570000, quorum=127.0.0.1:56361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-09 12:03:27,794 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): master:33037-0x10038f70b570000, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-09 12:03:27,794 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): master:33037-0x10038f70b570000, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 12:03:27,797 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-09 12:03:27,803 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): master:33037-0x10038f70b570000, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-09 12:03:27,806 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 9 msec 2023-02-09 12:03:27,809 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-09 12:03:27,814 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): master:33037-0x10038f70b570000, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-09 12:03:27,816 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 7 msec 2023-02-09 12:03:27,823 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): master:33037-0x10038f70b570000, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-09 12:03:27,825 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): master:33037-0x10038f70b570000, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-09 12:03:27,825 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 0.962sec 2023-02-09 12:03:27,825 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-09 12:03:27,825 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-09 12:03:27,825 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-09 12:03:27,825 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33037,1675944206758-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-09 12:03:27,825 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33037,1675944206758-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-09 12:03:27,826 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-09 12:03:27,854 DEBUG [Listener at localhost/46711] zookeeper.ReadOnlyZKClient(139): Connect 0x770d4e0d to 127.0.0.1:56361 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 12:03:27,857 DEBUG [Listener at localhost/46711] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@69bdee28, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 12:03:27,858 DEBUG [hconnection-0x373a1951-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 12:03:27,860 INFO [RS-EventLoopGroup-19-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59978, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 12:03:27,861 INFO [Listener at localhost/46711] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,33037,1675944206758 2023-02-09 12:03:27,861 DEBUG [Listener at localhost/46711] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-09 12:03:27,861 INFO [Listener at localhost/46711] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:27,861 INFO [Listener at localhost/46711] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:27,864 DEBUG [Listener at localhost/46711] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-09 12:03:27,865 INFO [RS-EventLoopGroup-18-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48432, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-09 12:03:27,865 INFO [Listener at localhost/46711] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 12:03:27,866 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33037] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 12:03:27,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33037] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-09 12:03:27,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33037] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 104 connection: 172.31.14.131:48432 deadline: 1675944267866, exception=org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 12:03:27,866 INFO [Listener at localhost/46711] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-09 12:03:27,867 INFO [Listener at localhost/46711] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:27,867 INFO [Listener at localhost/46711] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:27,868 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33037] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-09 12:03:27,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33037] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 12:03:27,870 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 12:03:27,870 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33037] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testRestoreSnapshotDoesNotCreateBackRefLinks" procId is: 10 2023-02-09 12:03:27,871 INFO [Listener at localhost/46711] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:27,871 INFO [Listener at localhost/46711] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:27,871 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 12:03:27,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33037] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 12:03:27,872 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/8f1ede7e9faee7a21bd06845200e098d 2023-02-09 12:03:27,872 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/8f1ede7e9faee7a21bd06845200e098d empty. 2023-02-09 12:03:27,873 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/8f1ede7e9faee7a21bd06845200e098d 2023-02-09 12:03:27,873 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-09 12:03:27,882 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/.tabledesc/.tableinfo.0000000001 2023-02-09 12:03:27,883 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(7671): creating {ENCODED => 8f1ede7e9faee7a21bd06845200e098d, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1675944207868.8f1ede7e9faee7a21bd06845200e098d.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/.tmp 2023-02-09 12:03:27,889 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1675944207868.8f1ede7e9faee7a21bd06845200e098d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:27,889 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1603): Closing 8f1ede7e9faee7a21bd06845200e098d, disabling compactions & flushes 2023-02-09 12:03:27,889 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1675944207868.8f1ede7e9faee7a21bd06845200e098d. 2023-02-09 12:03:27,889 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675944207868.8f1ede7e9faee7a21bd06845200e098d. 2023-02-09 12:03:27,889 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675944207868.8f1ede7e9faee7a21bd06845200e098d. after waiting 0 ms 2023-02-09 12:03:27,889 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1675944207868.8f1ede7e9faee7a21bd06845200e098d. 2023-02-09 12:03:27,889 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1675944207868.8f1ede7e9faee7a21bd06845200e098d. 2023-02-09 12:03:27,889 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1557): Region close journal for 8f1ede7e9faee7a21bd06845200e098d: Waiting for close lock at 1675944207889Disabling compacts and flushes for region at 1675944207889Disabling writes for close at 1675944207889Writing region close event to WAL at 1675944207889Closed at 1675944207889 2023-02-09 12:03:27,890 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 12:03:27,891 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1675944207868.8f1ede7e9faee7a21bd06845200e098d.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1675944207891"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675944207891"}]},"ts":"1675944207891"} 2023-02-09 12:03:27,892 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-09 12:03:27,893 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 12:03:27,893 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675944207893"}]},"ts":"1675944207893"} 2023-02-09 12:03:27,894 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLING in hbase:meta 2023-02-09 12:03:27,898 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 12:03:27,898 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 12:03:27,898 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 12:03:27,898 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 12:03:27,899 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=8f1ede7e9faee7a21bd06845200e098d, ASSIGN}] 2023-02-09 12:03:27,900 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=8f1ede7e9faee7a21bd06845200e098d, ASSIGN 2023-02-09 12:03:27,901 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=8f1ede7e9faee7a21bd06845200e098d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44829,1675944206837; forceNewPlan=false, retain=false 2023-02-09 12:03:27,972 INFO [Listener at localhost/46711] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:27,972 INFO [Listener at localhost/46711] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:27,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33037] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 12:03:28,051 INFO [jenkins-hbase4:33037] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-09 12:03:28,051 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=8f1ede7e9faee7a21bd06845200e098d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44829,1675944206837 2023-02-09 12:03:28,051 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1675944207868.8f1ede7e9faee7a21bd06845200e098d.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1675944208051"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675944208051"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675944208051"}]},"ts":"1675944208051"} 2023-02-09 12:03:28,053 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 8f1ede7e9faee7a21bd06845200e098d, server=jenkins-hbase4.apache.org,44829,1675944206837}] 2023-02-09 12:03:28,133 INFO [RS:1;jenkins-hbase4:44829] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44829%2C1675944206837, suffix=, logDir=hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/WALs/jenkins-hbase4.apache.org,44829,1675944206837, archiveDir=hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/oldWALs, maxLogs=32 2023-02-09 12:03:28,148 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42857,DS-00fb2fb7-4cac-4eca-aece-a4bebe015fcf,DISK] 2023-02-09 12:03:28,148 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41207,DS-522f5051-0dc1-4537-b64b-b0a5fcb5ccee,DISK] 2023-02-09 12:03:28,150 INFO [RS:1;jenkins-hbase4:44829] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/WALs/jenkins-hbase4.apache.org,44829,1675944206837/jenkins-hbase4.apache.org%2C44829%2C1675944206837.1675944208133 2023-02-09 12:03:28,150 DEBUG [RS:1;jenkins-hbase4:44829] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42857,DS-00fb2fb7-4cac-4eca-aece-a4bebe015fcf,DISK], DatanodeInfoWithStorage[127.0.0.1:41207,DS-522f5051-0dc1-4537-b64b-b0a5fcb5ccee,DISK]] 2023-02-09 12:03:28,173 INFO [Listener at localhost/46711] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:28,173 INFO [Listener at localhost/46711] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:28,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33037] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 12:03:28,205 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,44829,1675944206837 2023-02-09 12:03:28,206 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-09 12:03:28,207 INFO [RS-EventLoopGroup-20-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35926, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-09 12:03:28,209 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testRestoreSnapshotDoesNotCreateBackRefLinks,,1675944207868.8f1ede7e9faee7a21bd06845200e098d. 2023-02-09 12:03:28,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 8f1ede7e9faee7a21bd06845200e098d, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1675944207868.8f1ede7e9faee7a21bd06845200e098d.', STARTKEY => '', ENDKEY => ''} 2023-02-09 12:03:28,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRestoreSnapshotDoesNotCreateBackRefLinks 8f1ede7e9faee7a21bd06845200e098d 2023-02-09 12:03:28,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1675944207868.8f1ede7e9faee7a21bd06845200e098d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:28,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 8f1ede7e9faee7a21bd06845200e098d 2023-02-09 12:03:28,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 8f1ede7e9faee7a21bd06845200e098d 2023-02-09 12:03:28,211 INFO [StoreOpener-8f1ede7e9faee7a21bd06845200e098d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 8f1ede7e9faee7a21bd06845200e098d 2023-02-09 12:03:28,212 DEBUG [StoreOpener-8f1ede7e9faee7a21bd06845200e098d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/8f1ede7e9faee7a21bd06845200e098d/f1 2023-02-09 12:03:28,212 DEBUG [StoreOpener-8f1ede7e9faee7a21bd06845200e098d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/8f1ede7e9faee7a21bd06845200e098d/f1 2023-02-09 12:03:28,212 INFO [StoreOpener-8f1ede7e9faee7a21bd06845200e098d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8f1ede7e9faee7a21bd06845200e098d columnFamilyName f1 2023-02-09 12:03:28,213 INFO [StoreOpener-8f1ede7e9faee7a21bd06845200e098d-1] regionserver.HStore(310): Store=8f1ede7e9faee7a21bd06845200e098d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:28,213 INFO [StoreOpener-8f1ede7e9faee7a21bd06845200e098d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 8f1ede7e9faee7a21bd06845200e098d 2023-02-09 12:03:28,214 DEBUG [StoreOpener-8f1ede7e9faee7a21bd06845200e098d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/8f1ede7e9faee7a21bd06845200e098d/f2 2023-02-09 12:03:28,214 DEBUG [StoreOpener-8f1ede7e9faee7a21bd06845200e098d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/8f1ede7e9faee7a21bd06845200e098d/f2 2023-02-09 12:03:28,214 INFO [StoreOpener-8f1ede7e9faee7a21bd06845200e098d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8f1ede7e9faee7a21bd06845200e098d columnFamilyName f2 2023-02-09 12:03:28,214 INFO [StoreOpener-8f1ede7e9faee7a21bd06845200e098d-1] regionserver.HStore(310): Store=8f1ede7e9faee7a21bd06845200e098d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:28,215 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/8f1ede7e9faee7a21bd06845200e098d 2023-02-09 12:03:28,215 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/8f1ede7e9faee7a21bd06845200e098d 2023-02-09 12:03:28,217 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRestoreSnapshotDoesNotCreateBackRefLinks descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 12:03:28,218 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 8f1ede7e9faee7a21bd06845200e098d 2023-02-09 12:03:28,220 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/8f1ede7e9faee7a21bd06845200e098d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 12:03:28,220 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 8f1ede7e9faee7a21bd06845200e098d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73585578, jitterRate=0.09651055932044983}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 12:03:28,220 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 8f1ede7e9faee7a21bd06845200e098d: Running coprocessor pre-open hook at 1675944208210Writing region info on filesystem at 1675944208210Initializing all the Stores at 1675944208211 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944208211Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944208211Cleaning up temporary data from old regions at 1675944208216 (+5 ms)Cleaning up detritus from prior splits at 1675944208217 (+1 ms)Running coprocessor post-open hooks at 1675944208220 (+3 ms)Region opened successfully at 1675944208220 2023-02-09 12:03:28,221 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testRestoreSnapshotDoesNotCreateBackRefLinks,,1675944207868.8f1ede7e9faee7a21bd06845200e098d., pid=12, masterSystemTime=1675944208205 2023-02-09 12:03:28,223 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testRestoreSnapshotDoesNotCreateBackRefLinks,,1675944207868.8f1ede7e9faee7a21bd06845200e098d. 2023-02-09 12:03:28,224 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testRestoreSnapshotDoesNotCreateBackRefLinks,,1675944207868.8f1ede7e9faee7a21bd06845200e098d. 2023-02-09 12:03:28,224 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=8f1ede7e9faee7a21bd06845200e098d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44829,1675944206837 2023-02-09 12:03:28,224 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1675944207868.8f1ede7e9faee7a21bd06845200e098d.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1675944208224"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675944208224"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675944208224"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675944208224"}]},"ts":"1675944208224"} 2023-02-09 12:03:28,227 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-09 12:03:28,227 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 8f1ede7e9faee7a21bd06845200e098d, server=jenkins-hbase4.apache.org,44829,1675944206837 in 172 msec 2023-02-09 12:03:28,228 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-09 12:03:28,228 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=8f1ede7e9faee7a21bd06845200e098d, ASSIGN in 328 msec 2023-02-09 12:03:28,228 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 12:03:28,228 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675944208228"}]},"ts":"1675944208228"} 2023-02-09 12:03:28,229 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLED in hbase:meta 2023-02-09 12:03:28,231 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 12:03:28,232 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 363 msec 2023-02-09 12:03:28,474 INFO [Listener at localhost/46711] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:28,475 INFO [Listener at localhost/46711] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:28,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33037] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 12:03:28,476 INFO [Listener at localhost/46711] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 10 completed 2023-02-09 12:03:28,476 DEBUG [Listener at localhost/46711] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testRestoreSnapshotDoesNotCreateBackRefLinks get assigned. Timeout = 60000ms 2023-02-09 12:03:28,476 INFO [Listener at localhost/46711] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-09 12:03:28,478 INFO [Listener at localhost/46711] hbase.HBaseTestingUtility(3484): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned to meta. Checking AM states. 2023-02-09 12:03:28,478 INFO [Listener at localhost/46711] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-09 12:03:28,479 INFO [Listener at localhost/46711] hbase.HBaseTestingUtility(3504): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned. 2023-02-09 12:03:28,479 INFO [Listener at localhost/46711] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-09 12:03:28,493 DEBUG [hconnection-0x373a1951-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 12:03:28,504 INFO [RS-EventLoopGroup-20-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35942, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 12:03:28,515 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44829] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1675944207868.8f1ede7e9faee7a21bd06845200e098d. 2023-02-09 12:03:28,597 INFO [Listener at localhost/46711] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-09 12:03:28,597 INFO [Listener at localhost/46711] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-09 12:03:28,597 INFO [Listener at localhost/46711] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:28,597 INFO [Listener at localhost/46711] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:28,598 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33037] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-09 12:03:28,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33037] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1675944208598 (current time:1675944208598). 2023-02-09 12:03:28,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33037] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-09 12:03:28,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33037] zookeeper.ReadOnlyZKClient(139): Connect 0x0c56b51d to 127.0.0.1:56361 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 12:03:28,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33037] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6e6b14ec, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 12:03:28,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33037] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 12:03:28,604 INFO [RS-EventLoopGroup-19-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59984, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 12:03:28,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33037] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0c56b51d to 127.0.0.1:56361 2023-02-09 12:03:28,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33037] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 12:03:28,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33037] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-09 12:03:28,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33037] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-09 12:03:28,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33037] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-09 12:03:28,609 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-09 12:03:28,610 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE; timeout=600000, timestamp=1675944808610 2023-02-09 12:03:28,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33037] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-09 12:03:28,610 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 12:03:28,611 DEBUG [Listener at localhost/46711] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-09 12:03:28,612 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-09 12:03:28,612 DEBUG [Listener at localhost/46711] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-09 12:03:28,613 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-09 12:03:28,614 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE in 5 msec 2023-02-09 12:03:28,614 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-09 12:03:28,615 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED; timeout=600000, timestamp=1675944808615 2023-02-09 12:03:28,635 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-09 12:03:28,635 INFO [(jenkins-hbase4.apache.org,33037,1675944206758)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-09 12:03:28,635 DEBUG [(jenkins-hbase4.apache.org,33037,1675944206758)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 12:03:28,636 DEBUG [(jenkins-hbase4.apache.org,33037,1675944206758)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-09 12:03:28,636 DEBUG [(jenkins-hbase4.apache.org,33037,1675944206758)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-09 12:03:28,637 DEBUG [(jenkins-hbase4.apache.org,33037,1675944206758)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33037-0x10038f70b570000, quorum=127.0.0.1:56361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-09 12:03:28,637 DEBUG [(jenkins-hbase4.apache.org,33037,1675944206758)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-09 12:03:28,638 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): regionserver:44829-0x10038f70b570002, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 12:03:28,638 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): regionserver:39395-0x10038f70b570001, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 12:03:28,638 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 12:03:28,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 12:03:28,638 DEBUG [(jenkins-hbase4.apache.org,33037,1675944206758)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,44829,1675944206837 2023-02-09 12:03:28,639 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 12:03:28,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 12:03:28,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-09 12:03:28,639 DEBUG [(jenkins-hbase4.apache.org,33037,1675944206758)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33037-0x10038f70b570000, quorum=127.0.0.1:56361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,44829,1675944206837 2023-02-09 12:03:28,639 DEBUG [(jenkins-hbase4.apache.org,33037,1675944206758)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 12:03:28,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-09 12:03:28,639 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44829-0x10038f70b570002, quorum=127.0.0.1:56361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-09 12:03:28,639 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39395-0x10038f70b570001, quorum=127.0.0.1:56361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-09 12:03:28,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-09 12:03:28,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-09 12:03:28,640 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-09 12:03:28,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-09 12:03:28,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-09 12:03:28,640 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-09 12:03:28,640 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-09 12:03:28,644 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-09 12:03:28,644 DEBUG [member: 'jenkins-hbase4.apache.org,44829,1675944206837' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-09 12:03:28,644 DEBUG [member: 'jenkins-hbase4.apache.org,44829,1675944206837' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 12:03:28,645 DEBUG [member: 'jenkins-hbase4.apache.org,44829,1675944206837' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-09 12:03:28,645 DEBUG [member: 'jenkins-hbase4.apache.org,44829,1675944206837' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-09 12:03:28,645 DEBUG [member: 'jenkins-hbase4.apache.org,39395,1675944206814' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-09 12:03:28,645 DEBUG [member: 'jenkins-hbase4.apache.org,39395,1675944206814' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 12:03:28,645 DEBUG [member: 'jenkins-hbase4.apache.org,44829,1675944206837' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44829,1675944206837' joining acquired barrier for procedure (foo) in zk 2023-02-09 12:03:28,646 DEBUG [member: 'jenkins-hbase4.apache.org,39395,1675944206814' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-09 12:03:28,646 DEBUG [member: 'jenkins-hbase4.apache.org,39395,1675944206814' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-09 12:03:28,646 DEBUG [member: 'jenkins-hbase4.apache.org,39395,1675944206814' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39395,1675944206814' joining acquired barrier for procedure (foo) in zk 2023-02-09 12:03:28,648 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): master:33037-0x10038f70b570000, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,44829,1675944206837 2023-02-09 12:03:28,648 DEBUG [member: 'jenkins-hbase4.apache.org,44829,1675944206837' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-09 12:03:28,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,44829,1675944206837 2023-02-09 12:03:28,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 12:03:28,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 12:03:28,648 DEBUG [member: 'jenkins-hbase4.apache.org,39395,1675944206814' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-09 12:03:28,648 DEBUG [member: 'jenkins-hbase4.apache.org,44829,1675944206837' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44829-0x10038f70b570002, quorum=127.0.0.1:56361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-09 12:03:28,648 DEBUG [member: 'jenkins-hbase4.apache.org,44829,1675944206837' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 12:03:28,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 12:03:28,648 DEBUG [member: 'jenkins-hbase4.apache.org,39395,1675944206814' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39395-0x10038f70b570001, quorum=127.0.0.1:56361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-09 12:03:28,648 DEBUG [member: 'jenkins-hbase4.apache.org,39395,1675944206814' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 12:03:28,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 12:03:28,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-09 12:03:28,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44829,1675944206837 2023-02-09 12:03:28,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39395,1675944206814 2023-02-09 12:03:28,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 12:03:28,650 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44829,1675944206837' joining acquired barrier for procedure 'foo' on coordinator 2023-02-09 12:03:28,650 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@42c5e876[Count = 0] remaining members to acquire global barrier 2023-02-09 12:03:28,650 DEBUG [(jenkins-hbase4.apache.org,33037,1675944206758)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-09 12:03:28,650 DEBUG [(jenkins-hbase4.apache.org,33037,1675944206758)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-09 12:03:28,651 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): regionserver:44829-0x10038f70b570002, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-09 12:03:28,651 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): regionserver:39395-0x10038f70b570001, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-09 12:03:28,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-09 12:03:28,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-09 12:03:28,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-09 12:03:28,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-09 12:03:28,651 DEBUG [member: 'jenkins-hbase4.apache.org,44829,1675944206837' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-09 12:03:28,651 DEBUG [member: 'jenkins-hbase4.apache.org,39395,1675944206814' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-09 12:03:28,651 DEBUG [member: 'jenkins-hbase4.apache.org,39395,1675944206814' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-09 12:03:28,651 DEBUG [(jenkins-hbase4.apache.org,33037,1675944206758)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33037-0x10038f70b570000, quorum=127.0.0.1:56361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,44829,1675944206837 2023-02-09 12:03:28,651 DEBUG [member: 'jenkins-hbase4.apache.org,44829,1675944206837' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-09 12:03:28,651 DEBUG [member: 'jenkins-hbase4.apache.org,44829,1675944206837' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-09 12:03:28,651 DEBUG [(jenkins-hbase4.apache.org,33037,1675944206758)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 12:03:28,651 DEBUG [rs(jenkins-hbase4.apache.org,44829,1675944206837)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675944207868.8f1ede7e9faee7a21bd06845200e098d. 2023-02-09 12:03:28,651 DEBUG [member: 'jenkins-hbase4.apache.org,39395,1675944206814' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,39395,1675944206814' in zk 2023-02-09 12:03:28,652 DEBUG [rs(jenkins-hbase4.apache.org,44829,1675944206837)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1675944207868.8f1ede7e9faee7a21bd06845200e098d. started... 2023-02-09 12:03:28,652 INFO [rs(jenkins-hbase4.apache.org,44829,1675944206837)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 8f1ede7e9faee7a21bd06845200e098d 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-09 12:03:28,654 DEBUG [member: 'jenkins-hbase4.apache.org,39395,1675944206814' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-09 12:03:28,654 DEBUG [member: 'jenkins-hbase4.apache.org,39395,1675944206814' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 12:03:28,654 DEBUG [member: 'jenkins-hbase4.apache.org,39395,1675944206814' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-09 12:03:28,673 INFO [rs(jenkins-hbase4.apache.org,44829,1675944206837)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/8f1ede7e9faee7a21bd06845200e098d/.tmp/f1/d698dd61555e45698e9aa958cac37a52 2023-02-09 12:03:28,690 INFO [rs(jenkins-hbase4.apache.org,44829,1675944206837)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/8f1ede7e9faee7a21bd06845200e098d/.tmp/f2/feec6872c97f4a14b3313d0055f97be4 2023-02-09 12:03:28,694 DEBUG [rs(jenkins-hbase4.apache.org,44829,1675944206837)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/8f1ede7e9faee7a21bd06845200e098d/.tmp/f1/d698dd61555e45698e9aa958cac37a52 as hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/8f1ede7e9faee7a21bd06845200e098d/f1/d698dd61555e45698e9aa958cac37a52 2023-02-09 12:03:28,698 INFO [rs(jenkins-hbase4.apache.org,44829,1675944206837)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/8f1ede7e9faee7a21bd06845200e098d/f1/d698dd61555e45698e9aa958cac37a52, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-09 12:03:28,698 DEBUG [rs(jenkins-hbase4.apache.org,44829,1675944206837)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/8f1ede7e9faee7a21bd06845200e098d/.tmp/f2/feec6872c97f4a14b3313d0055f97be4 as hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/8f1ede7e9faee7a21bd06845200e098d/f2/feec6872c97f4a14b3313d0055f97be4 2023-02-09 12:03:28,702 INFO [rs(jenkins-hbase4.apache.org,44829,1675944206837)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/8f1ede7e9faee7a21bd06845200e098d/f2/feec6872c97f4a14b3313d0055f97be4, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-09 12:03:28,703 INFO [rs(jenkins-hbase4.apache.org,44829,1675944206837)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 8f1ede7e9faee7a21bd06845200e098d in 51ms, sequenceid=5, compaction requested=false 2023-02-09 12:03:28,703 DEBUG [rs(jenkins-hbase4.apache.org,44829,1675944206837)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-09 12:03:28,703 DEBUG [rs(jenkins-hbase4.apache.org,44829,1675944206837)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 8f1ede7e9faee7a21bd06845200e098d: 2023-02-09 12:03:28,704 DEBUG [rs(jenkins-hbase4.apache.org,44829,1675944206837)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1675944207868.8f1ede7e9faee7a21bd06845200e098d.' region-info for snapshot=foo 2023-02-09 12:03:28,704 DEBUG [rs(jenkins-hbase4.apache.org,44829,1675944206837)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 12:03:28,704 DEBUG [rs(jenkins-hbase4.apache.org,44829,1675944206837)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/8f1ede7e9faee7a21bd06845200e098d/f1/d698dd61555e45698e9aa958cac37a52] hfiles 2023-02-09 12:03:28,704 DEBUG [rs(jenkins-hbase4.apache.org,44829,1675944206837)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/8f1ede7e9faee7a21bd06845200e098d/f1/d698dd61555e45698e9aa958cac37a52 for snapshot=foo 2023-02-09 12:03:28,704 DEBUG [rs(jenkins-hbase4.apache.org,44829,1675944206837)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/8f1ede7e9faee7a21bd06845200e098d/f2/feec6872c97f4a14b3313d0055f97be4] hfiles 2023-02-09 12:03:28,704 DEBUG [rs(jenkins-hbase4.apache.org,44829,1675944206837)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/8f1ede7e9faee7a21bd06845200e098d/f2/feec6872c97f4a14b3313d0055f97be4 for snapshot=foo 2023-02-09 12:03:28,713 DEBUG [Listener at localhost/46711] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 12:03:28,713 INFO [Listener at localhost/46711] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:28,713 INFO [Listener at localhost/46711] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:28,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33037] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-09 12:03:28,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33037] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' is still in progress! 2023-02-09 12:03:28,715 DEBUG [rs(jenkins-hbase4.apache.org,44829,1675944206837)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1675944207868.8f1ede7e9faee7a21bd06845200e098d. completed. 2023-02-09 12:03:28,715 DEBUG [rs(jenkins-hbase4.apache.org,44829,1675944206837)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675944207868.8f1ede7e9faee7a21bd06845200e098d. 2023-02-09 12:03:28,715 DEBUG [Listener at localhost/46711] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-09 12:03:28,715 DEBUG [member: 'jenkins-hbase4.apache.org,44829,1675944206837' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-09 12:03:28,716 DEBUG [member: 'jenkins-hbase4.apache.org,44829,1675944206837' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-09 12:03:28,716 DEBUG [member: 'jenkins-hbase4.apache.org,44829,1675944206837' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44829,1675944206837 2023-02-09 12:03:28,716 DEBUG [member: 'jenkins-hbase4.apache.org,44829,1675944206837' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-09 12:03:28,716 DEBUG [member: 'jenkins-hbase4.apache.org,44829,1675944206837' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,44829,1675944206837' in zk 2023-02-09 12:03:28,717 DEBUG [member: 'jenkins-hbase4.apache.org,44829,1675944206837' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-09 12:03:28,717 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): master:33037-0x10038f70b570000, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,44829,1675944206837 2023-02-09 12:03:28,718 DEBUG [member: 'jenkins-hbase4.apache.org,44829,1675944206837' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 12:03:28,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,44829,1675944206837 2023-02-09 12:03:28,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 12:03:28,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 12:03:28,718 DEBUG [member: 'jenkins-hbase4.apache.org,44829,1675944206837' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-09 12:03:28,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 12:03:28,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 12:03:28,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-09 12:03:28,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44829,1675944206837 2023-02-09 12:03:28,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39395,1675944206814 2023-02-09 12:03:28,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 12:03:28,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-09 12:03:28,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44829,1675944206837 2023-02-09 12:03:28,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39395,1675944206814 2023-02-09 12:03:28,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase4.apache.org,44829,1675944206837': 2023-02-09 12:03:28,721 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44829,1675944206837' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-09 12:03:28,721 INFO [(jenkins-hbase4.apache.org,33037,1675944206758)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-09 12:03:28,721 DEBUG [(jenkins-hbase4.apache.org,33037,1675944206758)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 12:03:28,721 DEBUG [(jenkins-hbase4.apache.org,33037,1675944206758)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 12:03:28,721 DEBUG [(jenkins-hbase4.apache.org,33037,1675944206758)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-09 12:03:28,721 INFO [(jenkins-hbase4.apache.org,33037,1675944206758)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-09 12:03:28,723 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): regionserver:44829-0x10038f70b570002, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-09 12:03:28,723 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): master:33037-0x10038f70b570000, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-09 12:03:28,723 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-09 12:03:28,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-09 12:03:28,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 12:03:28,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 12:03:28,723 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): regionserver:44829-0x10038f70b570002, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 12:03:28,723 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): regionserver:39395-0x10038f70b570001, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-09 12:03:28,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-09 12:03:28,723 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-09 12:03:28,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-09 12:03:28,723 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): regionserver:39395-0x10038f70b570001, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 12:03:28,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 12:03:28,723 DEBUG [(jenkins-hbase4.apache.org,33037,1675944206758)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33037-0x10038f70b570000, quorum=127.0.0.1:56361, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,44829,1675944206837 2023-02-09 12:03:28,723 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 12:03:28,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 12:03:28,724 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 12:03:28,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 12:03:28,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-09 12:03:28,724 DEBUG [(jenkins-hbase4.apache.org,33037,1675944206758)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33037-0x10038f70b570000, quorum=127.0.0.1:56361, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,39395,1675944206814 2023-02-09 12:03:28,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-09 12:03:28,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-09 12:03:28,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 12:03:28,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-09 12:03:28,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44829,1675944206837 2023-02-09 12:03:28,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39395,1675944206814 2023-02-09 12:03:28,726 DEBUG [(jenkins-hbase4.apache.org,33037,1675944206758)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33037-0x10038f70b570000, quorum=127.0.0.1:56361, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,44829,1675944206837 2023-02-09 12:03:28,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 12:03:28,726 DEBUG [(jenkins-hbase4.apache.org,33037,1675944206758)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33037-0x10038f70b570000, quorum=127.0.0.1:56361, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,39395,1675944206814 2023-02-09 12:03:28,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-09 12:03:28,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44829,1675944206837 2023-02-09 12:03:28,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39395,1675944206814 2023-02-09 12:03:28,732 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): master:33037-0x10038f70b570000, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,39395,1675944206814 2023-02-09 12:03:28,732 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): regionserver:39395-0x10038f70b570001, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 12:03:28,732 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): regionserver:44829-0x10038f70b570002, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 12:03:28,732 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): master:33037-0x10038f70b570000, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-09 12:03:28,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 12:03:28,732 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): regionserver:39395-0x10038f70b570001, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 12:03:28,732 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): master:33037-0x10038f70b570000, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,44829,1675944206837 2023-02-09 12:03:28,733 DEBUG [(jenkins-hbase4.apache.org,33037,1675944206758)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 12:03:28,732 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): regionserver:44829-0x10038f70b570002, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 12:03:28,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 12:03:28,733 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): master:33037-0x10038f70b570000, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-09 12:03:28,733 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-09 12:03:28,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 12:03:28,733 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-09 12:03:28,733 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): master:33037-0x10038f70b570000, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,39395,1675944206814 2023-02-09 12:03:28,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 12:03:28,733 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): master:33037-0x10038f70b570000, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-09 12:03:28,733 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): master:33037-0x10038f70b570000, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,44829,1675944206837 2023-02-09 12:03:28,733 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): master:33037-0x10038f70b570000, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-09 12:03:28,733 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): master:33037-0x10038f70b570000, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-09 12:03:28,733 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 12:03:28,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 12:03:28,733 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 12:03:28,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 12:03:28,733 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/.hbase-snapshot/.tmp/foo 2023-02-09 12:03:28,758 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/.hbase-snapshot/.tmp/foo to hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/.hbase-snapshot/foo 2023-02-09 12:03:28,775 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed 2023-02-09 12:03:28,775 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/.hbase-snapshot/.tmp/foo 2023-02-09 12:03:28,776 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/.hbase-snapshot/.tmp/foo 2023-02-09 12:03:28,776 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks at 1675944208610Consolidate snapshot: foo at 1675944208733 (+123 ms)Loading Region manifests for foo at 1675944208733Writing data manifest for foo at 1675944208740 (+7 ms)Verifying snapshot: foo at 1675944208752 (+12 ms)Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed at 1675944208775 (+23 ms) 2023-02-09 12:03:28,777 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-09 12:03:28,779 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED in 166 msec 2023-02-09 12:03:28,916 DEBUG [Listener at localhost/46711] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 12:03:28,916 INFO [Listener at localhost/46711] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:28,916 INFO [Listener at localhost/46711] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:28,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33037] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-09 12:03:28,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33037] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-09 12:03:28,917 INFO [Listener at localhost/46711] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-09 12:03:28,917 INFO [Listener at localhost/46711] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:28,917 INFO [Listener at localhost/46711] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:28,921 INFO [Listener at localhost/46711] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-09 12:03:28,925 INFO [Listener at localhost/46711] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-09 12:03:28,952 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44829] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1675944207868.8f1ede7e9faee7a21bd06845200e098d. 2023-02-09 12:03:29,034 INFO [Listener at localhost/46711] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-09 12:03:29,037 INFO [Listener at localhost/46711] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:29,037 INFO [Listener at localhost/46711] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:29,039 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33037] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 12:03:29,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33037] procedure.ProcedureCoordinator(165): Submitting procedure testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 12:03:29,042 INFO [(jenkins-hbase4.apache.org,33037,1675944206758)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-09 12:03:29,042 DEBUG [(jenkins-hbase4.apache.org,33037,1675944206758)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 12:03:29,043 DEBUG [(jenkins-hbase4.apache.org,33037,1675944206758)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' 2023-02-09 12:03:29,043 DEBUG [(jenkins-hbase4.apache.org,33037,1675944206758)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks', kicking off acquire phase on members. 2023-02-09 12:03:29,043 DEBUG [(jenkins-hbase4.apache.org,33037,1675944206758)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33037-0x10038f70b570000, quorum=127.0.0.1:56361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 12:03:29,043 DEBUG [(jenkins-hbase4.apache.org,33037,1675944206758)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 12:03:29,044 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): regionserver:44829-0x10038f70b570002, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 12:03:29,044 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): regionserver:39395-0x10038f70b570001, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 12:03:29,044 DEBUG [(jenkins-hbase4.apache.org,33037,1675944206758)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,44829,1675944206837 2023-02-09 12:03:29,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 12:03:29,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 12:03:29,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 12:03:29,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 12:03:29,045 DEBUG [(jenkins-hbase4.apache.org,33037,1675944206758)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33037-0x10038f70b570000, quorum=127.0.0.1:56361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,44829,1675944206837 2023-02-09 12:03:29,045 DEBUG [(jenkins-hbase4.apache.org,33037,1675944206758)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 12:03:29,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 12:03:29,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 12:03:29,045 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44829-0x10038f70b570002, quorum=127.0.0.1:56361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 12:03:29,045 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39395-0x10038f70b570001, quorum=127.0.0.1:56361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 12:03:29,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 12:03:29,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 12:03:29,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 12:03:29,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 12:03:29,046 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 12:03:29,046 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 12:03:29,046 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 12:03:29,046 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 12:03:29,046 DEBUG [member: 'jenkins-hbase4.apache.org,39395,1675944206814' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-09 12:03:29,046 DEBUG [member: 'jenkins-hbase4.apache.org,39395,1675944206814' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 12:03:29,046 DEBUG [member: 'jenkins-hbase4.apache.org,44829,1675944206837' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-09 12:03:29,047 DEBUG [member: 'jenkins-hbase4.apache.org,39395,1675944206814' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-09 12:03:29,047 DEBUG [member: 'jenkins-hbase4.apache.org,39395,1675944206814' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-09 12:03:29,047 DEBUG [member: 'jenkins-hbase4.apache.org,44829,1675944206837' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 12:03:29,047 DEBUG [member: 'jenkins-hbase4.apache.org,39395,1675944206814' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39395,1675944206814' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-09 12:03:29,048 DEBUG [member: 'jenkins-hbase4.apache.org,44829,1675944206837' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-09 12:03:29,048 DEBUG [member: 'jenkins-hbase4.apache.org,44829,1675944206837' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 12:03:29,048 DEBUG [member: 'jenkins-hbase4.apache.org,44829,1675944206837' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 12:03:29,048 DEBUG [rs(jenkins-hbase4.apache.org,44829,1675944206837)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675944207868.8f1ede7e9faee7a21bd06845200e098d. 2023-02-09 12:03:29,048 DEBUG [rs(jenkins-hbase4.apache.org,44829,1675944206837)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testRestoreSnapshotDoesNotCreateBackRefLinks,,1675944207868.8f1ede7e9faee7a21bd06845200e098d. started... 2023-02-09 12:03:29,048 INFO [rs(jenkins-hbase4.apache.org,44829,1675944206837)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 8f1ede7e9faee7a21bd06845200e098d 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-09 12:03:29,049 DEBUG [member: 'jenkins-hbase4.apache.org,39395,1675944206814' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 12:03:29,049 DEBUG [member: 'jenkins-hbase4.apache.org,39395,1675944206814' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39395-0x10038f70b570001, quorum=127.0.0.1:56361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 12:03:29,050 DEBUG [member: 'jenkins-hbase4.apache.org,39395,1675944206814' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 12:03:29,065 INFO [rs(jenkins-hbase4.apache.org,44829,1675944206837)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/8f1ede7e9faee7a21bd06845200e098d/.tmp/f1/08b205970afc44f8aee2421ef977378e 2023-02-09 12:03:29,083 INFO [rs(jenkins-hbase4.apache.org,44829,1675944206837)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/8f1ede7e9faee7a21bd06845200e098d/.tmp/f2/3d453d4572154e109254beb86aa2e499 2023-02-09 12:03:29,087 DEBUG [rs(jenkins-hbase4.apache.org,44829,1675944206837)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/8f1ede7e9faee7a21bd06845200e098d/.tmp/f1/08b205970afc44f8aee2421ef977378e as hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/8f1ede7e9faee7a21bd06845200e098d/f1/08b205970afc44f8aee2421ef977378e 2023-02-09 12:03:29,090 INFO [rs(jenkins-hbase4.apache.org,44829,1675944206837)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/8f1ede7e9faee7a21bd06845200e098d/f1/08b205970afc44f8aee2421ef977378e, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-09 12:03:29,091 DEBUG [rs(jenkins-hbase4.apache.org,44829,1675944206837)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/8f1ede7e9faee7a21bd06845200e098d/.tmp/f2/3d453d4572154e109254beb86aa2e499 as hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/8f1ede7e9faee7a21bd06845200e098d/f2/3d453d4572154e109254beb86aa2e499 2023-02-09 12:03:29,094 INFO [rs(jenkins-hbase4.apache.org,44829,1675944206837)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/8f1ede7e9faee7a21bd06845200e098d/f2/3d453d4572154e109254beb86aa2e499, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-09 12:03:29,095 INFO [rs(jenkins-hbase4.apache.org,44829,1675944206837)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 8f1ede7e9faee7a21bd06845200e098d in 47ms, sequenceid=9, compaction requested=false 2023-02-09 12:03:29,096 DEBUG [rs(jenkins-hbase4.apache.org,44829,1675944206837)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 8f1ede7e9faee7a21bd06845200e098d: 2023-02-09 12:03:29,096 DEBUG [rs(jenkins-hbase4.apache.org,44829,1675944206837)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675944207868.8f1ede7e9faee7a21bd06845200e098d. 2023-02-09 12:03:29,096 DEBUG [member: 'jenkins-hbase4.apache.org,44829,1675944206837' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 12:03:29,096 DEBUG [member: 'jenkins-hbase4.apache.org,44829,1675944206837' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 12:03:29,096 DEBUG [member: 'jenkins-hbase4.apache.org,44829,1675944206837' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44829,1675944206837 2023-02-09 12:03:29,096 DEBUG [member: 'jenkins-hbase4.apache.org,44829,1675944206837' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-09 12:03:29,097 DEBUG [member: 'jenkins-hbase4.apache.org,44829,1675944206837' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44829,1675944206837' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-09 12:03:29,099 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): master:33037-0x10038f70b570000, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,44829,1675944206837 2023-02-09 12:03:29,099 DEBUG [member: 'jenkins-hbase4.apache.org,44829,1675944206837' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 12:03:29,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,44829,1675944206837 2023-02-09 12:03:29,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 12:03:29,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 12:03:29,099 DEBUG [member: 'jenkins-hbase4.apache.org,44829,1675944206837' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44829-0x10038f70b570002, quorum=127.0.0.1:56361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 12:03:29,099 DEBUG [member: 'jenkins-hbase4.apache.org,44829,1675944206837' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 12:03:29,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 12:03:29,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 12:03:29,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 12:03:29,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44829,1675944206837 2023-02-09 12:03:29,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39395,1675944206814 2023-02-09 12:03:29,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 12:03:29,101 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44829,1675944206837' joining acquired barrier for procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' on coordinator 2023-02-09 12:03:29,101 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@46fa64f6[Count = 0] remaining members to acquire global barrier 2023-02-09 12:03:29,101 DEBUG [(jenkins-hbase4.apache.org,33037,1675944206758)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'in-barrier' execution. 2023-02-09 12:03:29,101 DEBUG [(jenkins-hbase4.apache.org,33037,1675944206758)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 12:03:29,102 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): regionserver:39395-0x10038f70b570001, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 12:03:29,102 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): regionserver:44829-0x10038f70b570002, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 12:03:29,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 12:03:29,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 12:03:29,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 12:03:29,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 12:03:29,103 DEBUG [member: 'jenkins-hbase4.apache.org,44829,1675944206837' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-09 12:03:29,103 DEBUG [member: 'jenkins-hbase4.apache.org,44829,1675944206837' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-09 12:03:29,103 DEBUG [member: 'jenkins-hbase4.apache.org,39395,1675944206814' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-09 12:03:29,103 DEBUG [member: 'jenkins-hbase4.apache.org,39395,1675944206814' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-09 12:03:29,103 DEBUG [(jenkins-hbase4.apache.org,33037,1675944206758)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33037-0x10038f70b570000, quorum=127.0.0.1:56361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,44829,1675944206837 2023-02-09 12:03:29,103 DEBUG [(jenkins-hbase4.apache.org,33037,1675944206758)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 12:03:29,103 DEBUG [member: 'jenkins-hbase4.apache.org,44829,1675944206837' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase4.apache.org,44829,1675944206837' in zk 2023-02-09 12:03:29,103 DEBUG [member: 'jenkins-hbase4.apache.org,39395,1675944206814' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase4.apache.org,39395,1675944206814' in zk 2023-02-09 12:03:29,104 DEBUG [member: 'jenkins-hbase4.apache.org,39395,1675944206814' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-09 12:03:29,104 DEBUG [member: 'jenkins-hbase4.apache.org,44829,1675944206837' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-09 12:03:29,104 DEBUG [member: 'jenkins-hbase4.apache.org,44829,1675944206837' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 12:03:29,104 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): master:33037-0x10038f70b570000, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,44829,1675944206837 2023-02-09 12:03:29,104 DEBUG [member: 'jenkins-hbase4.apache.org,44829,1675944206837' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-09 12:03:29,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,44829,1675944206837 2023-02-09 12:03:29,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 12:03:29,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 12:03:29,104 DEBUG [member: 'jenkins-hbase4.apache.org,39395,1675944206814' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 12:03:29,105 DEBUG [member: 'jenkins-hbase4.apache.org,39395,1675944206814' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-09 12:03:29,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 12:03:29,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 12:03:29,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 12:03:29,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44829,1675944206837 2023-02-09 12:03:29,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39395,1675944206814 2023-02-09 12:03:29,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 12:03:29,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 12:03:29,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44829,1675944206837 2023-02-09 12:03:29,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39395,1675944206814 2023-02-09 12:03:29,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' member 'jenkins-hbase4.apache.org,44829,1675944206837': 2023-02-09 12:03:29,107 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44829,1675944206837' released barrier for procedure'testRestoreSnapshotDoesNotCreateBackRefLinks', counting down latch. Waiting for 0 more 2023-02-09 12:03:29,107 INFO [(jenkins-hbase4.apache.org,33037,1675944206758)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' execution completed 2023-02-09 12:03:29,107 DEBUG [(jenkins-hbase4.apache.org,33037,1675944206758)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 12:03:29,107 DEBUG [(jenkins-hbase4.apache.org,33037,1675944206758)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 12:03:29,107 DEBUG [(jenkins-hbase4.apache.org,33037,1675944206758)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 12:03:29,107 INFO [(jenkins-hbase4.apache.org,33037,1675944206758)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testRestoreSnapshotDoesNotCreateBackRefLinksincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 12:03:29,109 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): regionserver:44829-0x10038f70b570002, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 12:03:29,109 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): master:33037-0x10038f70b570000, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 12:03:29,109 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 12:03:29,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 12:03:29,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 12:03:29,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 12:03:29,109 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): regionserver:44829-0x10038f70b570002, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 12:03:29,109 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): regionserver:39395-0x10038f70b570001, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 12:03:29,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 12:03:29,109 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 12:03:29,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 12:03:29,109 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): regionserver:39395-0x10038f70b570001, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 12:03:29,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 12:03:29,109 DEBUG [(jenkins-hbase4.apache.org,33037,1675944206758)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33037-0x10038f70b570000, quorum=127.0.0.1:56361, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,44829,1675944206837 2023-02-09 12:03:29,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 12:03:29,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 12:03:29,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 12:03:29,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 12:03:29,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 12:03:29,110 DEBUG [(jenkins-hbase4.apache.org,33037,1675944206758)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33037-0x10038f70b570000, quorum=127.0.0.1:56361, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,39395,1675944206814 2023-02-09 12:03:29,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 12:03:29,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 12:03:29,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 12:03:29,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 12:03:29,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44829,1675944206837 2023-02-09 12:03:29,111 DEBUG [(jenkins-hbase4.apache.org,33037,1675944206758)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33037-0x10038f70b570000, quorum=127.0.0.1:56361, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,44829,1675944206837 2023-02-09 12:03:29,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39395,1675944206814 2023-02-09 12:03:29,111 DEBUG [(jenkins-hbase4.apache.org,33037,1675944206758)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33037-0x10038f70b570000, quorum=127.0.0.1:56361, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,39395,1675944206814 2023-02-09 12:03:29,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 12:03:29,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 12:03:29,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44829,1675944206837 2023-02-09 12:03:29,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39395,1675944206814 2023-02-09 12:03:29,115 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): master:33037-0x10038f70b570000, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,39395,1675944206814 2023-02-09 12:03:29,115 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): master:33037-0x10038f70b570000, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 12:03:29,115 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): regionserver:44829-0x10038f70b570002, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 12:03:29,115 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): regionserver:39395-0x10038f70b570001, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 12:03:29,115 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33037] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-09 12:03:29,115 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33037] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 12:03:29,115 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): master:33037-0x10038f70b570000, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,44829,1675944206837 2023-02-09 12:03:29,115 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): regionserver:39395-0x10038f70b570001, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 12:03:29,115 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 12:03:29,115 DEBUG [(jenkins-hbase4.apache.org,33037,1675944206758)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 12:03:29,115 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 12:03:29,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 12:03:29,115 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): regionserver:44829-0x10038f70b570002, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 12:03:29,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 12:03:29,115 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): master:33037-0x10038f70b570000, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 12:03:29,116 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): master:33037-0x10038f70b570000, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,39395,1675944206814 2023-02-09 12:03:29,115 DEBUG [Listener at localhost/46711] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testRestoreSnapshotDoesNotCreateBackRefLinks'' to complete. (max 20000 ms per retry) 2023-02-09 12:03:29,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 12:03:29,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 12:03:29,116 DEBUG [Listener at localhost/46711] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 12:03:29,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 12:03:29,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 12:03:29,116 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): master:33037-0x10038f70b570000, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 12:03:29,116 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): master:33037-0x10038f70b570000, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,44829,1675944206837 2023-02-09 12:03:29,116 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): master:33037-0x10038f70b570000, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 12:03:29,116 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): master:33037-0x10038f70b570000, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 12:03:29,216 DEBUG [Listener at localhost/46711] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 12:03:29,216 INFO [Listener at localhost/46711] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:29,216 INFO [Listener at localhost/46711] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:29,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33037] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 12:03:29,221 INFO [Listener at localhost/46711] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1675944208598 type: FLUSH version: 2 ttl: 0 2023-02-09 12:03:29,221 DEBUG [Listener at localhost/46711] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:46449/user/jenkins/test-data/9280551e-bc5a-0255-4864-4ac8ecb20e21/foo/68522d12-bb2a-4a58-84ab-9de9de7ea54c/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 12:03:29,221 INFO [Listener at localhost/46711] snapshot.RestoreSnapshotHelper(239): region to add: 8f1ede7e9faee7a21bd06845200e098d 2023-02-09 12:03:29,222 INFO [Listener at localhost/46711] snapshot.RestoreSnapshotHelper(585): clone region=8f1ede7e9faee7a21bd06845200e098d as 8f1ede7e9faee7a21bd06845200e098d in snapshot foo 2023-02-09 12:03:29,222 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 8f1ede7e9faee7a21bd06845200e098d, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1675944207868.8f1ede7e9faee7a21bd06845200e098d.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46449/user/jenkins/test-data/9280551e-bc5a-0255-4864-4ac8ecb20e21/foo/68522d12-bb2a-4a58-84ab-9de9de7ea54c 2023-02-09 12:03:29,231 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1675944207868.8f1ede7e9faee7a21bd06845200e098d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:29,231 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d698dd61555e45698e9aa958cac37a52 from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 12:03:29,233 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink feec6872c97f4a14b3313d0055f97be4 from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 12:03:29,234 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 8f1ede7e9faee7a21bd06845200e098d, disabling compactions & flushes 2023-02-09 12:03:29,235 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1675944207868.8f1ede7e9faee7a21bd06845200e098d. 2023-02-09 12:03:29,235 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675944207868.8f1ede7e9faee7a21bd06845200e098d. 2023-02-09 12:03:29,235 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675944207868.8f1ede7e9faee7a21bd06845200e098d. after waiting 0 ms 2023-02-09 12:03:29,235 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1675944207868.8f1ede7e9faee7a21bd06845200e098d. 2023-02-09 12:03:29,235 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1675944207868.8f1ede7e9faee7a21bd06845200e098d. 2023-02-09 12:03:29,235 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 8f1ede7e9faee7a21bd06845200e098d: Waiting for close lock at 1675944209234Disabling compacts and flushes for region at 1675944209234Disabling writes for close at 1675944209235 (+1 ms)Writing region close event to WAL at 1675944209235Closed at 1675944209235 2023-02-09 12:03:29,236 INFO [Listener at localhost/46711] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1675944208598 type: FLUSH version: 2 ttl: 0 2023-02-09 12:03:29,236 DEBUG [Listener at localhost/46711] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:46449/user/jenkins/test-data/9280551e-bc5a-0255-4864-4ac8ecb20e21/foo/68522d12-bb2a-4a58-84ab-9de9de7ea54c 2023-02-09 12:03:29,236 DEBUG [Listener at localhost/46711] util.CommonFSUtils(682): File system contents for path hdfs://localhost:46449/user/jenkins/test-data/9280551e-bc5a-0255-4864-4ac8ecb20e21/foo/68522d12-bb2a-4a58-84ab-9de9de7ea54c 2023-02-09 12:03:29,237 DEBUG [Listener at localhost/46711] util.CommonFSUtils(699): |-data/ 2023-02-09 12:03:29,237 DEBUG [Listener at localhost/46711] util.CommonFSUtils(699): |----default/ 2023-02-09 12:03:29,238 DEBUG [Listener at localhost/46711] util.CommonFSUtils(699): |-------testRestoreSnapshotDoesNotCreateBackRefLinks/ 2023-02-09 12:03:29,238 DEBUG [Listener at localhost/46711] util.CommonFSUtils(699): |----------8f1ede7e9faee7a21bd06845200e098d/ 2023-02-09 12:03:29,238 DEBUG [Listener at localhost/46711] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 12:03:29,238 DEBUG [Listener at localhost/46711] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 12:03:29,239 DEBUG [Listener at localhost/46711] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=8f1ede7e9faee7a21bd06845200e098d-d698dd61555e45698e9aa958cac37a52 2023-02-09 12:03:29,239 DEBUG [Listener at localhost/46711] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 12:03:29,239 DEBUG [Listener at localhost/46711] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=8f1ede7e9faee7a21bd06845200e098d-feec6872c97f4a14b3313d0055f97be4 hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/8f1ede7e9faee7a21bd06845200e098d/f1/08b205970afc44f8aee2421ef977378e hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/8f1ede7e9faee7a21bd06845200e098d/f1/d698dd61555e45698e9aa958cac37a52 hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/8f1ede7e9faee7a21bd06845200e098d/f2/3d453d4572154e109254beb86aa2e499 hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/8f1ede7e9faee7a21bd06845200e098d/f2/feec6872c97f4a14b3313d0055f97be4 2023-02-09 12:03:29,244 INFO [Listener at localhost/46711] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:29,244 INFO [Listener at localhost/46711] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:29,245 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33037] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "foo" 2023-02-09 12:03:29,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33037] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-09 12:03:29,248 INFO [Listener at localhost/46711] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:29,248 INFO [Listener at localhost/46711] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:29,248 INFO [Listener at localhost/46711] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 12:03:29,249 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33037] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 12:03:29,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33037] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 12:03:29,252 INFO [Listener at localhost/46711] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:29,252 INFO [Listener at localhost/46711] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:29,252 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675944209252"}]},"ts":"1675944209252"} 2023-02-09 12:03:29,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33037] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-09 12:03:29,254 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLING in hbase:meta 2023-02-09 12:03:29,255 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLING 2023-02-09 12:03:29,256 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=8f1ede7e9faee7a21bd06845200e098d, UNASSIGN}] 2023-02-09 12:03:29,258 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=8f1ede7e9faee7a21bd06845200e098d, UNASSIGN 2023-02-09 12:03:29,258 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=8f1ede7e9faee7a21bd06845200e098d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44829,1675944206837 2023-02-09 12:03:29,258 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1675944207868.8f1ede7e9faee7a21bd06845200e098d.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1675944209258"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675944209258"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675944209258"}]},"ts":"1675944209258"} 2023-02-09 12:03:29,260 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 8f1ede7e9faee7a21bd06845200e098d, server=jenkins-hbase4.apache.org,44829,1675944206837}] 2023-02-09 12:03:29,353 INFO [Listener at localhost/46711] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:29,353 INFO [Listener at localhost/46711] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:29,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33037] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-09 12:03:29,412 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 8f1ede7e9faee7a21bd06845200e098d 2023-02-09 12:03:29,412 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 8f1ede7e9faee7a21bd06845200e098d, disabling compactions & flushes 2023-02-09 12:03:29,412 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1675944207868.8f1ede7e9faee7a21bd06845200e098d. 2023-02-09 12:03:29,412 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675944207868.8f1ede7e9faee7a21bd06845200e098d. 2023-02-09 12:03:29,412 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675944207868.8f1ede7e9faee7a21bd06845200e098d. after waiting 0 ms 2023-02-09 12:03:29,412 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1675944207868.8f1ede7e9faee7a21bd06845200e098d. 2023-02-09 12:03:29,415 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/8f1ede7e9faee7a21bd06845200e098d/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 12:03:29,416 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1675944207868.8f1ede7e9faee7a21bd06845200e098d. 2023-02-09 12:03:29,416 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 8f1ede7e9faee7a21bd06845200e098d: Waiting for close lock at 1675944209412Running coprocessor pre-close hooks at 1675944209412Disabling compacts and flushes for region at 1675944209412Disabling writes for close at 1675944209412Writing region close event to WAL at 1675944209413 (+1 ms)Running coprocessor post-close hooks at 1675944209416 (+3 ms)Closed at 1675944209416 2023-02-09 12:03:29,417 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 8f1ede7e9faee7a21bd06845200e098d 2023-02-09 12:03:29,417 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=8f1ede7e9faee7a21bd06845200e098d, regionState=CLOSED 2023-02-09 12:03:29,418 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1675944207868.8f1ede7e9faee7a21bd06845200e098d.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1675944209417"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675944209417"}]},"ts":"1675944209417"} 2023-02-09 12:03:29,420 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-09 12:03:29,420 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 8f1ede7e9faee7a21bd06845200e098d, server=jenkins-hbase4.apache.org,44829,1675944206837 in 160 msec 2023-02-09 12:03:29,421 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-09 12:03:29,421 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=8f1ede7e9faee7a21bd06845200e098d, UNASSIGN in 164 msec 2023-02-09 12:03:29,422 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675944209422"}]},"ts":"1675944209422"} 2023-02-09 12:03:29,423 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLED in hbase:meta 2023-02-09 12:03:29,424 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLED 2023-02-09 12:03:29,426 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 176 msec 2023-02-09 12:03:29,554 INFO [Listener at localhost/46711] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:29,555 INFO [Listener at localhost/46711] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:29,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33037] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-09 12:03:29,556 INFO [Listener at localhost/46711] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 15 completed 2023-02-09 12:03:29,556 INFO [Listener at localhost/46711] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:29,556 INFO [Listener at localhost/46711] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:29,557 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33037] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 12:03:29,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33037] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 12:03:29,559 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 12:03:29,560 INFO [Listener at localhost/46711] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:29,560 INFO [Listener at localhost/46711] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:29,560 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 12:03:29,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33037] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-09 12:03:29,563 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/8f1ede7e9faee7a21bd06845200e098d 2023-02-09 12:03:29,565 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/8f1ede7e9faee7a21bd06845200e098d/f1, FileablePath, hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/8f1ede7e9faee7a21bd06845200e098d/f2, FileablePath, hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/8f1ede7e9faee7a21bd06845200e098d/recovered.edits] 2023-02-09 12:03:29,568 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/8f1ede7e9faee7a21bd06845200e098d/f1/08b205970afc44f8aee2421ef977378e to hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/8f1ede7e9faee7a21bd06845200e098d/f1/08b205970afc44f8aee2421ef977378e 2023-02-09 12:03:29,569 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/8f1ede7e9faee7a21bd06845200e098d/f1/d698dd61555e45698e9aa958cac37a52 to hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/8f1ede7e9faee7a21bd06845200e098d/f1/d698dd61555e45698e9aa958cac37a52 2023-02-09 12:03:29,571 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/8f1ede7e9faee7a21bd06845200e098d/f2/3d453d4572154e109254beb86aa2e499 to hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/8f1ede7e9faee7a21bd06845200e098d/f2/3d453d4572154e109254beb86aa2e499 2023-02-09 12:03:29,572 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/8f1ede7e9faee7a21bd06845200e098d/f2/feec6872c97f4a14b3313d0055f97be4 to hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/8f1ede7e9faee7a21bd06845200e098d/f2/feec6872c97f4a14b3313d0055f97be4 2023-02-09 12:03:29,574 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/8f1ede7e9faee7a21bd06845200e098d/recovered.edits/12.seqid to hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/8f1ede7e9faee7a21bd06845200e098d/recovered.edits/12.seqid 2023-02-09 12:03:29,575 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/8f1ede7e9faee7a21bd06845200e098d 2023-02-09 12:03:29,575 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-09 12:03:29,577 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 12:03:29,578 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testRestoreSnapshotDoesNotCreateBackRefLinks from hbase:meta 2023-02-09 12:03:29,580 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' descriptor. 2023-02-09 12:03:29,583 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 12:03:29,583 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' from region states. 2023-02-09 12:03:29,583 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1675944207868.8f1ede7e9faee7a21bd06845200e098d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675944209583"}]},"ts":"9223372036854775807"} 2023-02-09 12:03:29,585 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-09 12:03:29,585 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 8f1ede7e9faee7a21bd06845200e098d, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1675944207868.8f1ede7e9faee7a21bd06845200e098d.', STARTKEY => '', ENDKEY => ''}] 2023-02-09 12:03:29,585 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testRestoreSnapshotDoesNotCreateBackRefLinks' as deleted. 2023-02-09 12:03:29,585 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1675944209585"}]},"ts":"9223372036854775807"} 2023-02-09 12:03:29,586 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testRestoreSnapshotDoesNotCreateBackRefLinks state from META 2023-02-09 12:03:29,588 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 12:03:29,589 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 31 msec 2023-02-09 12:03:29,661 INFO [Listener at localhost/46711] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:29,661 INFO [Listener at localhost/46711] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:29,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33037] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-09 12:03:29,662 INFO [Listener at localhost/46711] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 18 completed 2023-02-09 12:03:29,662 INFO [Listener at localhost/46711] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-09 12:03:29,662 INFO [Listener at localhost/46711] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-09 12:03:29,663 DEBUG [Listener at localhost/46711] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x770d4e0d to 127.0.0.1:56361 2023-02-09 12:03:29,663 DEBUG [Listener at localhost/46711] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 12:03:29,663 DEBUG [Listener at localhost/46711] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-09 12:03:29,663 DEBUG [Listener at localhost/46711] util.JVMClusterUtil(257): Found active master hash=1016747290, stopped=false 2023-02-09 12:03:29,663 INFO [Listener at localhost/46711] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,33037,1675944206758 2023-02-09 12:03:29,666 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): regionserver:39395-0x10038f70b570001, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 12:03:29,666 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): regionserver:44829-0x10038f70b570002, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 12:03:29,666 INFO [Listener at localhost/46711] procedure2.ProcedureExecutor(629): Stopping 2023-02-09 12:03:29,666 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): master:33037-0x10038f70b570000, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 12:03:29,666 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): master:33037-0x10038f70b570000, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 12:03:29,668 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39395-0x10038f70b570001, quorum=127.0.0.1:56361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 12:03:29,668 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44829-0x10038f70b570002, quorum=127.0.0.1:56361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 12:03:29,668 DEBUG [Listener at localhost/46711] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x52ff1052 to 127.0.0.1:56361 2023-02-09 12:03:29,668 DEBUG [Listener at localhost/46711] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 12:03:29,668 INFO [Listener at localhost/46711] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,39395,1675944206814' ***** 2023-02-09 12:03:29,668 INFO [Listener at localhost/46711] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-09 12:03:29,668 INFO [Listener at localhost/46711] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,44829,1675944206837' ***** 2023-02-09 12:03:29,669 INFO [Listener at localhost/46711] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-09 12:03:29,669 INFO [RS:0;jenkins-hbase4:39395] regionserver.HeapMemoryManager(220): Stopping 2023-02-09 12:03:29,669 INFO [RS:1;jenkins-hbase4:44829] regionserver.HeapMemoryManager(220): Stopping 2023-02-09 12:03:29,669 INFO [RS:0;jenkins-hbase4:39395] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-09 12:03:29,669 INFO [RS:1;jenkins-hbase4:44829] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-09 12:03:29,669 INFO [RS:0;jenkins-hbase4:39395] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-09 12:03:29,669 INFO [RS:1;jenkins-hbase4:44829] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-09 12:03:29,669 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-09 12:03:29,669 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33037-0x10038f70b570000, quorum=127.0.0.1:56361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 12:03:29,669 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-09 12:03:29,669 INFO [RS:1;jenkins-hbase4:44829] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,44829,1675944206837 2023-02-09 12:03:29,669 INFO [RS:0;jenkins-hbase4:39395] regionserver.HRegionServer(3304): Received CLOSE for 758e194e6115e81cc0b4c28becca5aed 2023-02-09 12:03:29,671 DEBUG [RS:1;jenkins-hbase4:44829] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7cc4e8fe to 127.0.0.1:56361 2023-02-09 12:03:29,671 DEBUG [RS:1;jenkins-hbase4:44829] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 12:03:29,671 INFO [RS:1;jenkins-hbase4:44829] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,44829,1675944206837; all regions closed. 2023-02-09 12:03:29,671 INFO [RS:0;jenkins-hbase4:39395] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,39395,1675944206814 2023-02-09 12:03:29,672 DEBUG [RS:0;jenkins-hbase4:39395] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2ab2a1c0 to 127.0.0.1:56361 2023-02-09 12:03:29,672 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 758e194e6115e81cc0b4c28becca5aed, disabling compactions & flushes 2023-02-09 12:03:29,672 DEBUG [RS:0;jenkins-hbase4:39395] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 12:03:29,672 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675944207387.758e194e6115e81cc0b4c28becca5aed. 2023-02-09 12:03:29,672 INFO [RS:0;jenkins-hbase4:39395] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-09 12:03:29,672 INFO [RS:0;jenkins-hbase4:39395] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-09 12:03:29,672 INFO [RS:0;jenkins-hbase4:39395] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-09 12:03:29,672 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675944207387.758e194e6115e81cc0b4c28becca5aed. 2023-02-09 12:03:29,672 INFO [RS:0;jenkins-hbase4:39395] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-09 12:03:29,672 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675944207387.758e194e6115e81cc0b4c28becca5aed. after waiting 0 ms 2023-02-09 12:03:29,672 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675944207387.758e194e6115e81cc0b4c28becca5aed. 2023-02-09 12:03:29,672 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 758e194e6115e81cc0b4c28becca5aed 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-09 12:03:29,672 INFO [RS:0;jenkins-hbase4:39395] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-09 12:03:29,672 DEBUG [RS:0;jenkins-hbase4:39395] regionserver.HRegionServer(1479): Online Regions={758e194e6115e81cc0b4c28becca5aed=hbase:namespace,,1675944207387.758e194e6115e81cc0b4c28becca5aed., 1588230740=hbase:meta,,1.1588230740} 2023-02-09 12:03:29,672 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-09 12:03:29,672 DEBUG [RS:0;jenkins-hbase4:39395] regionserver.HRegionServer(1505): Waiting on 1588230740, 758e194e6115e81cc0b4c28becca5aed 2023-02-09 12:03:29,672 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-09 12:03:29,672 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-09 12:03:29,672 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-09 12:03:29,672 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-09 12:03:29,673 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.46 KB heapSize=7.87 KB 2023-02-09 12:03:29,676 DEBUG [RS:1;jenkins-hbase4:44829] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/oldWALs 2023-02-09 12:03:29,676 INFO [RS:1;jenkins-hbase4:44829] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44829%2C1675944206837:(num 1675944208133) 2023-02-09 12:03:29,676 DEBUG [RS:1;jenkins-hbase4:44829] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 12:03:29,676 INFO [RS:1;jenkins-hbase4:44829] regionserver.LeaseManager(133): Closed leases 2023-02-09 12:03:29,676 INFO [RS:1;jenkins-hbase4:44829] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-09 12:03:29,677 INFO [RS:1;jenkins-hbase4:44829] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-09 12:03:29,677 INFO [RS:1;jenkins-hbase4:44829] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-09 12:03:29,677 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 12:03:29,677 INFO [RS:1;jenkins-hbase4:44829] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-09 12:03:29,678 INFO [RS:1;jenkins-hbase4:44829] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44829 2023-02-09 12:03:29,679 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): regionserver:39395-0x10038f70b570001, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44829,1675944206837 2023-02-09 12:03:29,679 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): regionserver:39395-0x10038f70b570001, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 12:03:29,680 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): master:33037-0x10038f70b570000, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 12:03:29,680 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): regionserver:44829-0x10038f70b570002, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44829,1675944206837 2023-02-09 12:03:29,680 ERROR [Listener at localhost/46711-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6c6ff180 rejected from java.util.concurrent.ThreadPoolExecutor@685078d5[Terminated, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 12:03:29,680 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): regionserver:44829-0x10038f70b570002, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 12:03:29,680 ERROR [Listener at localhost/46711-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@fc5f08f rejected from java.util.concurrent.ThreadPoolExecutor@685078d5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 12:03:29,680 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,44829,1675944206837] 2023-02-09 12:03:29,680 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,44829,1675944206837; numProcessing=1 2023-02-09 12:03:29,681 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,44829,1675944206837 already deleted, retry=false 2023-02-09 12:03:29,681 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,44829,1675944206837 expired; onlineServers=1 2023-02-09 12:03:29,684 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/data/hbase/namespace/758e194e6115e81cc0b4c28becca5aed/.tmp/info/615d9cb1303349cfa78bc48ccf469104 2023-02-09 12:03:29,686 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.77 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/data/hbase/meta/1588230740/.tmp/info/77630612672945c8bc32a3ed18b8c9f3 2023-02-09 12:03:29,689 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/data/hbase/namespace/758e194e6115e81cc0b4c28becca5aed/.tmp/info/615d9cb1303349cfa78bc48ccf469104 as hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/data/hbase/namespace/758e194e6115e81cc0b4c28becca5aed/info/615d9cb1303349cfa78bc48ccf469104 2023-02-09 12:03:29,690 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 77630612672945c8bc32a3ed18b8c9f3 2023-02-09 12:03:29,693 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/data/hbase/namespace/758e194e6115e81cc0b4c28becca5aed/info/615d9cb1303349cfa78bc48ccf469104, entries=2, sequenceid=6, filesize=4.8 K 2023-02-09 12:03:29,694 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 758e194e6115e81cc0b4c28becca5aed in 22ms, sequenceid=6, compaction requested=false 2023-02-09 12:03:29,697 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/data/hbase/meta/1588230740/.tmp/rep_barrier/2350f26ec9d242a49810311f0835eadf 2023-02-09 12:03:29,697 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/data/hbase/namespace/758e194e6115e81cc0b4c28becca5aed/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-09 12:03:29,697 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675944207387.758e194e6115e81cc0b4c28becca5aed. 2023-02-09 12:03:29,697 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 758e194e6115e81cc0b4c28becca5aed: Waiting for close lock at 1675944209672Running coprocessor pre-close hooks at 1675944209672Disabling compacts and flushes for region at 1675944209672Disabling writes for close at 1675944209672Obtaining lock to block concurrent updates at 1675944209672Preparing flush snapshotting stores in 758e194e6115e81cc0b4c28becca5aed at 1675944209672Finished memstore snapshotting hbase:namespace,,1675944207387.758e194e6115e81cc0b4c28becca5aed., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1675944209672Flushing stores of hbase:namespace,,1675944207387.758e194e6115e81cc0b4c28becca5aed. at 1675944209673 (+1 ms)Flushing 758e194e6115e81cc0b4c28becca5aed/info: creating writer at 1675944209673Flushing 758e194e6115e81cc0b4c28becca5aed/info: appending metadata at 1675944209675 (+2 ms)Flushing 758e194e6115e81cc0b4c28becca5aed/info: closing flushed file at 1675944209675Flushing 758e194e6115e81cc0b4c28becca5aed/info: reopening flushed file at 1675944209690 (+15 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 758e194e6115e81cc0b4c28becca5aed in 22ms, sequenceid=6, compaction requested=false at 1675944209694 (+4 ms)Writing region close event to WAL at 1675944209694Running coprocessor post-close hooks at 1675944209697 (+3 ms)Closed at 1675944209697 2023-02-09 12:03:29,698 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1675944207387.758e194e6115e81cc0b4c28becca5aed. 2023-02-09 12:03:29,700 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2350f26ec9d242a49810311f0835eadf 2023-02-09 12:03:29,706 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=590 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/data/hbase/meta/1588230740/.tmp/table/2120102c12e041299882343d41fe4764 2023-02-09 12:03:29,707 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-09 12:03:29,710 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2120102c12e041299882343d41fe4764 2023-02-09 12:03:29,711 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/data/hbase/meta/1588230740/.tmp/info/77630612672945c8bc32a3ed18b8c9f3 as hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/data/hbase/meta/1588230740/info/77630612672945c8bc32a3ed18b8c9f3 2023-02-09 12:03:29,714 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 77630612672945c8bc32a3ed18b8c9f3 2023-02-09 12:03:29,714 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/data/hbase/meta/1588230740/info/77630612672945c8bc32a3ed18b8c9f3, entries=12, sequenceid=21, filesize=6.3 K 2023-02-09 12:03:29,714 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-09 12:03:29,716 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/data/hbase/meta/1588230740/.tmp/rep_barrier/2350f26ec9d242a49810311f0835eadf as hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/data/hbase/meta/1588230740/rep_barrier/2350f26ec9d242a49810311f0835eadf 2023-02-09 12:03:29,720 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2350f26ec9d242a49810311f0835eadf 2023-02-09 12:03:29,720 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/data/hbase/meta/1588230740/rep_barrier/2350f26ec9d242a49810311f0835eadf, entries=1, sequenceid=21, filesize=5.1 K 2023-02-09 12:03:29,721 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/data/hbase/meta/1588230740/.tmp/table/2120102c12e041299882343d41fe4764 as hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/data/hbase/meta/1588230740/table/2120102c12e041299882343d41fe4764 2023-02-09 12:03:29,724 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2120102c12e041299882343d41fe4764 2023-02-09 12:03:29,724 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/data/hbase/meta/1588230740/table/2120102c12e041299882343d41fe4764, entries=4, sequenceid=21, filesize=5.1 K 2023-02-09 12:03:29,725 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.46 KB/4572, heapSize ~7.82 KB/8008, currentSize=0 B/0 for 1588230740 in 53ms, sequenceid=21, compaction requested=false 2023-02-09 12:03:29,728 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-09 12:03:29,729 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-09 12:03:29,729 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-09 12:03:29,729 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675944209672Running coprocessor pre-close hooks at 1675944209672Disabling compacts and flushes for region at 1675944209672Disabling writes for close at 1675944209672Obtaining lock to block concurrent updates at 1675944209673 (+1 ms)Preparing flush snapshotting stores in 1588230740 at 1675944209673Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=4572, getHeapSize=8008, getOffHeapSize=0, getCellsCount=36 at 1675944209673Flushing stores of hbase:meta,,1.1588230740 at 1675944209674 (+1 ms)Flushing 1588230740/info: creating writer at 1675944209674Flushing 1588230740/info: appending metadata at 1675944209676 (+2 ms)Flushing 1588230740/info: closing flushed file at 1675944209676Flushing 1588230740/rep_barrier: creating writer at 1675944209690 (+14 ms)Flushing 1588230740/rep_barrier: appending metadata at 1675944209692 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1675944209692Flushing 1588230740/table: creating writer at 1675944209700 (+8 ms)Flushing 1588230740/table: appending metadata at 1675944209701 (+1 ms)Flushing 1588230740/table: closing flushed file at 1675944209701Flushing 1588230740/info: reopening flushed file at 1675944209711 (+10 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1675944209716 (+5 ms)Flushing 1588230740/table: reopening flushed file at 1675944209721 (+5 ms)Finished flush of dataSize ~4.46 KB/4572, heapSize ~7.82 KB/8008, currentSize=0 B/0 for 1588230740 in 53ms, sequenceid=21, compaction requested=false at 1675944209725 (+4 ms)Writing region close event to WAL at 1675944209726 (+1 ms)Running coprocessor post-close hooks at 1675944209729 (+3 ms)Closed at 1675944209729 2023-02-09 12:03:29,729 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-09 12:03:29,866 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): regionserver:44829-0x10038f70b570002, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 12:03:29,866 INFO [RS:1;jenkins-hbase4:44829] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,44829,1675944206837; zookeeper connection closed. 2023-02-09 12:03:29,866 ERROR [Listener at localhost/46711-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7748a685 rejected from java.util.concurrent.ThreadPoolExecutor@685078d5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 12:03:29,866 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): regionserver:44829-0x10038f70b570002, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 12:03:29,866 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@775e410] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@775e410 2023-02-09 12:03:29,866 ERROR [Listener at localhost/46711-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6d9cd45c rejected from java.util.concurrent.ThreadPoolExecutor@685078d5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 12:03:29,872 INFO [RS:0;jenkins-hbase4:39395] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,39395,1675944206814; all regions closed. 2023-02-09 12:03:29,876 DEBUG [RS:0;jenkins-hbase4:39395] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/oldWALs 2023-02-09 12:03:29,876 INFO [RS:0;jenkins-hbase4:39395] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39395%2C1675944206814.meta:.meta(num 1675944207337) 2023-02-09 12:03:29,879 DEBUG [RS:0;jenkins-hbase4:39395] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/oldWALs 2023-02-09 12:03:29,879 INFO [RS:0;jenkins-hbase4:39395] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39395%2C1675944206814:(num 1675944207736) 2023-02-09 12:03:29,879 DEBUG [RS:0;jenkins-hbase4:39395] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 12:03:29,880 INFO [RS:0;jenkins-hbase4:39395] regionserver.LeaseManager(133): Closed leases 2023-02-09 12:03:29,880 INFO [RS:0;jenkins-hbase4:39395] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-09 12:03:29,880 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 12:03:29,881 INFO [RS:0;jenkins-hbase4:39395] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39395 2023-02-09 12:03:29,884 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): regionserver:39395-0x10038f70b570001, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39395,1675944206814 2023-02-09 12:03:29,884 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): master:33037-0x10038f70b570000, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 12:03:29,884 ERROR [Listener at localhost/46711-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1948b842 rejected from java.util.concurrent.ThreadPoolExecutor@1d772fb3[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1374) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 12:03:29,884 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,39395,1675944206814] 2023-02-09 12:03:29,884 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,39395,1675944206814; numProcessing=2 2023-02-09 12:03:29,886 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,39395,1675944206814 already deleted, retry=false 2023-02-09 12:03:29,886 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,39395,1675944206814 expired; onlineServers=0 2023-02-09 12:03:29,886 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,33037,1675944206758' ***** 2023-02-09 12:03:29,886 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-09 12:03:29,887 DEBUG [M:0;jenkins-hbase4:33037] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@38a5c651, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 12:03:29,887 INFO [M:0;jenkins-hbase4:33037] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,33037,1675944206758 2023-02-09 12:03:29,887 INFO [M:0;jenkins-hbase4:33037] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,33037,1675944206758; all regions closed. 2023-02-09 12:03:29,887 DEBUG [M:0;jenkins-hbase4:33037] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 12:03:29,887 DEBUG [M:0;jenkins-hbase4:33037] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-09 12:03:29,887 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-09 12:03:29,887 DEBUG [M:0;jenkins-hbase4:33037] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-09 12:03:29,887 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675944206987] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675944206987,5,FailOnTimeoutGroup] 2023-02-09 12:03:29,887 INFO [M:0;jenkins-hbase4:33037] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-09 12:03:29,888 INFO [M:0;jenkins-hbase4:33037] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-09 12:03:29,887 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675944206987] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675944206987,5,FailOnTimeoutGroup] 2023-02-09 12:03:29,889 INFO [M:0;jenkins-hbase4:33037] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-09 12:03:29,889 DEBUG [M:0;jenkins-hbase4:33037] master.HMaster(1502): Stopping service threads 2023-02-09 12:03:29,889 INFO [M:0;jenkins-hbase4:33037] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-09 12:03:29,890 ERROR [M:0;jenkins-hbase4:33037] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-09 12:03:29,890 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): master:33037-0x10038f70b570000, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-09 12:03:29,890 INFO [M:0;jenkins-hbase4:33037] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-09 12:03:29,890 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): master:33037-0x10038f70b570000, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 12:03:29,890 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-09 12:03:29,890 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33037-0x10038f70b570000, quorum=127.0.0.1:56361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 12:03:29,890 DEBUG [M:0;jenkins-hbase4:33037] zookeeper.ZKUtil(398): master:33037-0x10038f70b570000, quorum=127.0.0.1:56361, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-09 12:03:29,890 WARN [M:0;jenkins-hbase4:33037] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-09 12:03:29,890 INFO [M:0;jenkins-hbase4:33037] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-09 12:03:29,891 INFO [M:0;jenkins-hbase4:33037] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-09 12:03:29,891 DEBUG [M:0;jenkins-hbase4:33037] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-09 12:03:29,891 INFO [M:0;jenkins-hbase4:33037] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 12:03:29,891 DEBUG [M:0;jenkins-hbase4:33037] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 12:03:29,891 DEBUG [M:0;jenkins-hbase4:33037] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-09 12:03:29,891 DEBUG [M:0;jenkins-hbase4:33037] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 12:03:29,891 INFO [M:0;jenkins-hbase4:33037] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.65 KB heapSize=67.61 KB 2023-02-09 12:03:29,902 INFO [M:0;jenkins-hbase4:33037] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.65 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/6400f238639c424b9ef63347ecbaae6c 2023-02-09 12:03:29,906 DEBUG [M:0;jenkins-hbase4:33037] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/6400f238639c424b9ef63347ecbaae6c as hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/6400f238639c424b9ef63347ecbaae6c 2023-02-09 12:03:29,909 INFO [M:0;jenkins-hbase4:33037] regionserver.HStore(1080): Added hdfs://localhost:46449/user/jenkins/test-data/be154035-80fe-1f88-3cd9-d4ecf8d320b2/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/6400f238639c424b9ef63347ecbaae6c, entries=17, sequenceid=132, filesize=8.7 K 2023-02-09 12:03:29,909 INFO [M:0;jenkins-hbase4:33037] regionserver.HRegion(2947): Finished flush of dataSize ~56.65 KB/58012, heapSize ~67.59 KB/69216, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 18ms, sequenceid=132, compaction requested=false 2023-02-09 12:03:29,910 INFO [M:0;jenkins-hbase4:33037] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 12:03:29,910 DEBUG [M:0;jenkins-hbase4:33037] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675944209891Disabling compacts and flushes for region at 1675944209891Disabling writes for close at 1675944209891Obtaining lock to block concurrent updates at 1675944209891Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1675944209891Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=58012, getHeapSize=69216, getOffHeapSize=0, getCellsCount=145 at 1675944209892 (+1 ms)Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1675944209893 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1675944209893Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1675944209895 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1675944209895Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1675944209906 (+11 ms)Finished flush of dataSize ~56.65 KB/58012, heapSize ~67.59 KB/69216, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 18ms, sequenceid=132, compaction requested=false at 1675944209909 (+3 ms)Writing region close event to WAL at 1675944209910 (+1 ms)Closed at 1675944209910 2023-02-09 12:03:29,912 INFO [M:0;jenkins-hbase4:33037] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-09 12:03:29,912 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 12:03:29,913 INFO [M:0;jenkins-hbase4:33037] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33037 2023-02-09 12:03:29,916 DEBUG [M:0;jenkins-hbase4:33037] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,33037,1675944206758 already deleted, retry=false 2023-02-09 12:03:30,269 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): master:33037-0x10038f70b570000, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 12:03:30,269 INFO [M:0;jenkins-hbase4:33037] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,33037,1675944206758; zookeeper connection closed. 2023-02-09 12:03:30,269 ERROR [Listener at localhost/46711-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@62d7a703 rejected from java.util.concurrent.ThreadPoolExecutor@66e83f81[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 52] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 12:03:30,271 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): master:33037-0x10038f70b570000, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 12:03:30,271 ERROR [Listener at localhost/46711-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4db3d268 rejected from java.util.concurrent.ThreadPoolExecutor@66e83f81[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 52] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 12:03:30,370 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): regionserver:39395-0x10038f70b570001, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 12:03:30,370 INFO [RS:0;jenkins-hbase4:39395] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,39395,1675944206814; zookeeper connection closed. 2023-02-09 12:03:30,370 ERROR [Listener at localhost/46711-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@35b15ce8 rejected from java.util.concurrent.ThreadPoolExecutor@1d772fb3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 12:03:30,370 DEBUG [Listener at localhost/46711-EventThread] zookeeper.ZKWatcher(600): regionserver:39395-0x10038f70b570001, quorum=127.0.0.1:56361, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 12:03:30,370 ERROR [Listener at localhost/46711-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4dc9d88c rejected from java.util.concurrent.ThreadPoolExecutor@1d772fb3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 12:03:30,370 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@530c857c] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@530c857c 2023-02-09 12:03:30,370 INFO [Listener at localhost/46711] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-09 12:03:30,370 WARN [Listener at localhost/46711] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-09 12:03:30,374 INFO [Listener at localhost/46711] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 12:03:30,475 WARN [BP-1615297499-172.31.14.131-1675944206198 heartbeating to localhost/127.0.0.1:46449] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-09 12:03:30,475 WARN [BP-1615297499-172.31.14.131-1675944206198 heartbeating to localhost/127.0.0.1:46449] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1615297499-172.31.14.131-1675944206198 (Datanode Uuid 6657d425-3038-4dc7-9ed9-71075f995e06) service to localhost/127.0.0.1:46449 2023-02-09 12:03:30,479 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e8501bb2-6b19-0548-742d-40ff45bd6565/cluster_1b9eeb62-70a0-0dff-041f-8e422d850948/dfs/data/data3/current/BP-1615297499-172.31.14.131-1675944206198] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 12:03:30,480 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e8501bb2-6b19-0548-742d-40ff45bd6565/cluster_1b9eeb62-70a0-0dff-041f-8e422d850948/dfs/data/data4/current/BP-1615297499-172.31.14.131-1675944206198] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 12:03:30,481 WARN [Listener at localhost/46711] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-09 12:03:30,484 INFO [Listener at localhost/46711] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 12:03:30,587 WARN [BP-1615297499-172.31.14.131-1675944206198 heartbeating to localhost/127.0.0.1:46449] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-09 12:03:30,587 WARN [BP-1615297499-172.31.14.131-1675944206198 heartbeating to localhost/127.0.0.1:46449] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1615297499-172.31.14.131-1675944206198 (Datanode Uuid cbad1f9c-d739-4d57-92e7-67f8a8b0b87c) service to localhost/127.0.0.1:46449 2023-02-09 12:03:30,588 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e8501bb2-6b19-0548-742d-40ff45bd6565/cluster_1b9eeb62-70a0-0dff-041f-8e422d850948/dfs/data/data1/current/BP-1615297499-172.31.14.131-1675944206198] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 12:03:30,588 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e8501bb2-6b19-0548-742d-40ff45bd6565/cluster_1b9eeb62-70a0-0dff-041f-8e422d850948/dfs/data/data2/current/BP-1615297499-172.31.14.131-1675944206198] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 12:03:30,599 INFO [Listener at localhost/46711] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 12:03:30,625 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-09 12:03:30,747 INFO [Listener at localhost/46711] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-09 12:03:30,770 INFO [Listener at localhost/46711] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-09 12:03:30,784 INFO [Listener at localhost/46711] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=276 (was 255) Potentially hanging thread: nioEventLoopGroup-24-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:46449 from jenkins.hfs.10 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-22-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/46711 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:46449 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-23-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-16 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:46449 from jenkins.hfs.11 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-18-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: RS-EventLoopGroup-19-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.10@localhost:46449 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,33037,1675944206758)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:46449 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-23-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.11@localhost:46449 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:46449 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=577 (was 664), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=336 (was 331) - SystemLoadAverage LEAK? -, ProcessCount=166 (was 166), AvailableMemoryMB=3187 (was 3224) 2023-02-09 12:03:30,796 INFO [Listener at localhost/46711] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=276, OpenFileDescriptor=577, MaxFileDescriptor=60000, SystemLoadAverage=336, ProcessCount=166, AvailableMemoryMB=3186 2023-02-09 12:03:30,807 INFO [Listener at localhost/46711] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e8501bb2-6b19-0548-742d-40ff45bd6565/hadoop.log.dir so I do NOT create it in target/test-data/ab20a21e-7e59-2c59-415a-5ed4d329d3c8 2023-02-09 12:03:30,808 WARN [Listener at localhost/46711] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e8501bb2-6b19-0548-742d-40ff45bd6565/hadoop.log.dir Erasing configuration value by system value. 2023-02-09 12:03:30,808 INFO [Listener at localhost/46711] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e8501bb2-6b19-0548-742d-40ff45bd6565/hadoop.tmp.dir so I do NOT create it in target/test-data/ab20a21e-7e59-2c59-415a-5ed4d329d3c8 2023-02-09 12:03:30,808 WARN [Listener at localhost/46711] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e8501bb2-6b19-0548-742d-40ff45bd6565/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-09 12:03:30,808 DEBUG [Listener at localhost/46711] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab20a21e-7e59-2c59-415a-5ed4d329d3c8 2023-02-09 12:03:30,808 INFO [Listener at localhost/46711] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-09 12:03:30,808 INFO [Listener at localhost/46711] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab20a21e-7e59-2c59-415a-5ed4d329d3c8/cluster_113a50a1-eed1-6bd7-c38b-e345bf4940eb, deleteOnExit=true 2023-02-09 12:03:30,808 INFO [Listener at localhost/46711] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-09 12:03:30,808 INFO [Listener at localhost/46711] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab20a21e-7e59-2c59-415a-5ed4d329d3c8/test.cache.data in system properties and HBase conf 2023-02-09 12:03:30,808 INFO [Listener at localhost/46711] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab20a21e-7e59-2c59-415a-5ed4d329d3c8/hadoop.tmp.dir in system properties and HBase conf 2023-02-09 12:03:30,808 INFO [Listener at localhost/46711] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab20a21e-7e59-2c59-415a-5ed4d329d3c8/hadoop.log.dir in system properties and HBase conf 2023-02-09 12:03:30,809 INFO [Listener at localhost/46711] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab20a21e-7e59-2c59-415a-5ed4d329d3c8/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-09 12:03:30,809 INFO [Listener at localhost/46711] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab20a21e-7e59-2c59-415a-5ed4d329d3c8/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-09 12:03:30,809 INFO [Listener at localhost/46711] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-09 12:03:30,809 DEBUG [Listener at localhost/46711] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-09 12:03:30,809 INFO [Listener at localhost/46711] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab20a21e-7e59-2c59-415a-5ed4d329d3c8/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-09 12:03:30,809 INFO [Listener at localhost/46711] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab20a21e-7e59-2c59-415a-5ed4d329d3c8/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-09 12:03:30,809 INFO [Listener at localhost/46711] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab20a21e-7e59-2c59-415a-5ed4d329d3c8/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-09 12:03:30,809 INFO [Listener at localhost/46711] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab20a21e-7e59-2c59-415a-5ed4d329d3c8/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-09 12:03:30,809 INFO [Listener at localhost/46711] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab20a21e-7e59-2c59-415a-5ed4d329d3c8/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-09 12:03:30,809 INFO [Listener at localhost/46711] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab20a21e-7e59-2c59-415a-5ed4d329d3c8/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-09 12:03:30,810 INFO [Listener at localhost/46711] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab20a21e-7e59-2c59-415a-5ed4d329d3c8/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-09 12:03:30,810 INFO [Listener at localhost/46711] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab20a21e-7e59-2c59-415a-5ed4d329d3c8/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-09 12:03:30,810 INFO [Listener at localhost/46711] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab20a21e-7e59-2c59-415a-5ed4d329d3c8/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-09 12:03:30,810 INFO [Listener at localhost/46711] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab20a21e-7e59-2c59-415a-5ed4d329d3c8/nfs.dump.dir in system properties and HBase conf 2023-02-09 12:03:30,810 INFO [Listener at localhost/46711] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab20a21e-7e59-2c59-415a-5ed4d329d3c8/java.io.tmpdir in system properties and HBase conf 2023-02-09 12:03:30,810 INFO [Listener at localhost/46711] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab20a21e-7e59-2c59-415a-5ed4d329d3c8/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-09 12:03:30,810 INFO [Listener at localhost/46711] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab20a21e-7e59-2c59-415a-5ed4d329d3c8/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-09 12:03:30,810 INFO [Listener at localhost/46711] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab20a21e-7e59-2c59-415a-5ed4d329d3c8/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-09 12:03:30,814 WARN [Listener at localhost/46711] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-09 12:03:30,814 WARN [Listener at localhost/46711] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-09 12:03:30,852 WARN [Listener at localhost/46711] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 12:03:30,853 INFO [Listener at localhost/46711] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 12:03:30,857 INFO [Listener at localhost/46711] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab20a21e-7e59-2c59-415a-5ed4d329d3c8/java.io.tmpdir/Jetty_localhost_41461_hdfs____khhszg/webapp 2023-02-09 12:03:30,948 INFO [Listener at localhost/46711] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41461 2023-02-09 12:03:30,953 WARN [Listener at localhost/46711] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-09 12:03:30,953 WARN [Listener at localhost/46711] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-09 12:03:30,992 WARN [Listener at localhost/44979] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 12:03:31,004 WARN [Listener at localhost/44979] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-09 12:03:31,006 WARN [Listener at localhost/44979] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 12:03:31,007 INFO [Listener at localhost/44979] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 12:03:31,011 INFO [Listener at localhost/44979] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab20a21e-7e59-2c59-415a-5ed4d329d3c8/java.io.tmpdir/Jetty_localhost_45311_datanode____wi81g9/webapp 2023-02-09 12:03:31,103 INFO [Listener at localhost/44979] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45311 2023-02-09 12:03:31,111 WARN [Listener at localhost/35237] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 12:03:31,125 WARN [Listener at localhost/35237] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-09 12:03:31,128 WARN [Listener at localhost/35237] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 12:03:31,129 INFO [Listener at localhost/35237] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 12:03:31,131 INFO [Listener at localhost/35237] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab20a21e-7e59-2c59-415a-5ed4d329d3c8/java.io.tmpdir/Jetty_localhost_40867_datanode____.dliduk/webapp 2023-02-09 12:03:31,226 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xdbf88e393409c16a: Processing first storage report for DS-9a0b6269-aa90-4b0d-acd8-475a4b15ee60 from datanode fcadec84-a2f1-4aa3-a481-0a57c91f4ee9 2023-02-09 12:03:31,227 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xdbf88e393409c16a: from storage DS-9a0b6269-aa90-4b0d-acd8-475a4b15ee60 node DatanodeRegistration(127.0.0.1:39655, datanodeUuid=fcadec84-a2f1-4aa3-a481-0a57c91f4ee9, infoPort=40859, infoSecurePort=0, ipcPort=35237, storageInfo=lv=-57;cid=testClusterID;nsid=1631573404;c=1675944210817), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-09 12:03:31,227 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xdbf88e393409c16a: Processing first storage report for DS-2d19b61f-e2af-41c2-af77-5cfe06bd231b from datanode fcadec84-a2f1-4aa3-a481-0a57c91f4ee9 2023-02-09 12:03:31,227 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xdbf88e393409c16a: from storage DS-2d19b61f-e2af-41c2-af77-5cfe06bd231b node DatanodeRegistration(127.0.0.1:39655, datanodeUuid=fcadec84-a2f1-4aa3-a481-0a57c91f4ee9, infoPort=40859, infoSecurePort=0, ipcPort=35237, storageInfo=lv=-57;cid=testClusterID;nsid=1631573404;c=1675944210817), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 12:03:31,234 INFO [Listener at localhost/35237] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40867 2023-02-09 12:03:31,243 WARN [Listener at localhost/39711] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 12:03:31,347 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5d9dda62fcb0c8c: Processing first storage report for DS-84b75b28-7ea1-4f75-846f-c0986e3b322a from datanode 0cf42f62-b49c-4fcd-bee7-89110a6cd2c9 2023-02-09 12:03:31,347 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5d9dda62fcb0c8c: from storage DS-84b75b28-7ea1-4f75-846f-c0986e3b322a node DatanodeRegistration(127.0.0.1:38153, datanodeUuid=0cf42f62-b49c-4fcd-bee7-89110a6cd2c9, infoPort=40595, infoSecurePort=0, ipcPort=39711, storageInfo=lv=-57;cid=testClusterID;nsid=1631573404;c=1675944210817), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 12:03:31,347 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5d9dda62fcb0c8c: Processing first storage report for DS-5cef92ad-5897-4e8c-9026-d99639d70aef from datanode 0cf42f62-b49c-4fcd-bee7-89110a6cd2c9 2023-02-09 12:03:31,347 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5d9dda62fcb0c8c: from storage DS-5cef92ad-5897-4e8c-9026-d99639d70aef node DatanodeRegistration(127.0.0.1:38153, datanodeUuid=0cf42f62-b49c-4fcd-bee7-89110a6cd2c9, infoPort=40595, infoSecurePort=0, ipcPort=39711, storageInfo=lv=-57;cid=testClusterID;nsid=1631573404;c=1675944210817), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 12:03:31,349 DEBUG [Listener at localhost/39711] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab20a21e-7e59-2c59-415a-5ed4d329d3c8 2023-02-09 12:03:31,356 INFO [Listener at localhost/39711] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab20a21e-7e59-2c59-415a-5ed4d329d3c8/cluster_113a50a1-eed1-6bd7-c38b-e345bf4940eb/zookeeper_0, clientPort=63427, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab20a21e-7e59-2c59-415a-5ed4d329d3c8/cluster_113a50a1-eed1-6bd7-c38b-e345bf4940eb/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab20a21e-7e59-2c59-415a-5ed4d329d3c8/cluster_113a50a1-eed1-6bd7-c38b-e345bf4940eb/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-09 12:03:31,358 INFO [Listener at localhost/39711] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=63427 2023-02-09 12:03:31,358 INFO [Listener at localhost/39711] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 12:03:31,358 INFO [Listener at localhost/39711] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 12:03:31,372 INFO [Listener at localhost/39711] util.FSUtils(479): Created version file at hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384 with version=8 2023-02-09 12:03:31,372 INFO [Listener at localhost/39711] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 12:03:31,373 INFO [Listener at localhost/39711] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 12:03:31,374 INFO [Listener at localhost/39711] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:44979/user/jenkins/test-data/6d6b940c-b7aa-6d9b-6ce7-5cf1b35ab10b/hbase-staging 2023-02-09 12:03:31,376 INFO [Listener at localhost/39711] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 12:03:31,376 INFO [Listener at localhost/39711] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 12:03:31,376 INFO [Listener at localhost/39711] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 12:03:31,376 INFO [Listener at localhost/39711] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 12:03:31,376 INFO [Listener at localhost/39711] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 12:03:31,376 INFO [Listener at localhost/39711] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 12:03:31,376 INFO [Listener at localhost/39711] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 12:03:31,377 INFO [Listener at localhost/39711] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37757 2023-02-09 12:03:31,377 INFO [Listener at localhost/39711] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 12:03:31,378 INFO [Listener at localhost/39711] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 12:03:31,379 INFO [Listener at localhost/39711] zookeeper.RecoverableZooKeeper(93): Process identifier=master:37757 connecting to ZooKeeper ensemble=127.0.0.1:63427 2023-02-09 12:03:31,388 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): master:377570x0, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 12:03:31,391 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:37757-0x10038f71d5b0000 connected 2023-02-09 12:03:31,410 DEBUG [Listener at localhost/39711] zookeeper.ZKUtil(164): master:37757-0x10038f71d5b0000, quorum=127.0.0.1:63427, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 12:03:31,410 DEBUG [Listener at localhost/39711] zookeeper.ZKUtil(164): master:37757-0x10038f71d5b0000, quorum=127.0.0.1:63427, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 12:03:31,411 DEBUG [Listener at localhost/39711] zookeeper.ZKUtil(164): master:37757-0x10038f71d5b0000, quorum=127.0.0.1:63427, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 12:03:31,412 DEBUG [Listener at localhost/39711] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37757 2023-02-09 12:03:31,413 DEBUG [Listener at localhost/39711] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37757 2023-02-09 12:03:31,416 DEBUG [Listener at localhost/39711] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37757 2023-02-09 12:03:31,420 DEBUG [Listener at localhost/39711] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37757 2023-02-09 12:03:31,424 DEBUG [Listener at localhost/39711] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37757 2023-02-09 12:03:31,424 INFO [Listener at localhost/39711] master.HMaster(439): hbase.rootdir=hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384, hbase.cluster.distributed=false 2023-02-09 12:03:31,440 INFO [Listener at localhost/39711] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 12:03:31,441 INFO [Listener at localhost/39711] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 12:03:31,441 INFO [Listener at localhost/39711] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 12:03:31,441 INFO [Listener at localhost/39711] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 12:03:31,441 INFO [Listener at localhost/39711] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 12:03:31,441 INFO [Listener at localhost/39711] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 12:03:31,441 INFO [Listener at localhost/39711] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 12:03:31,442 INFO [Listener at localhost/39711] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36449 2023-02-09 12:03:31,442 INFO [Listener at localhost/39711] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-09 12:03:31,443 DEBUG [Listener at localhost/39711] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 12:03:31,444 INFO [Listener at localhost/39711] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 12:03:31,444 INFO [Listener at localhost/39711] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 12:03:31,445 INFO [Listener at localhost/39711] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36449 connecting to ZooKeeper ensemble=127.0.0.1:63427 2023-02-09 12:03:31,448 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): regionserver:364490x0, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 12:03:31,451 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:36449-0x10038f71d5b0001 connected 2023-02-09 12:03:31,451 DEBUG [Listener at localhost/39711] zookeeper.ZKUtil(164): regionserver:36449-0x10038f71d5b0001, quorum=127.0.0.1:63427, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 12:03:31,452 DEBUG [Listener at localhost/39711] zookeeper.ZKUtil(164): regionserver:36449-0x10038f71d5b0001, quorum=127.0.0.1:63427, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 12:03:31,453 DEBUG [Listener at localhost/39711] zookeeper.ZKUtil(164): regionserver:36449-0x10038f71d5b0001, quorum=127.0.0.1:63427, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 12:03:31,456 DEBUG [Listener at localhost/39711] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36449 2023-02-09 12:03:31,456 DEBUG [Listener at localhost/39711] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36449 2023-02-09 12:03:31,456 DEBUG [Listener at localhost/39711] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36449 2023-02-09 12:03:31,460 DEBUG [Listener at localhost/39711] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36449 2023-02-09 12:03:31,460 DEBUG [Listener at localhost/39711] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36449 2023-02-09 12:03:31,471 INFO [Listener at localhost/39711] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 12:03:31,471 INFO [Listener at localhost/39711] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 12:03:31,471 INFO [Listener at localhost/39711] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 12:03:31,471 INFO [Listener at localhost/39711] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 12:03:31,471 INFO [Listener at localhost/39711] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 12:03:31,471 INFO [Listener at localhost/39711] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 12:03:31,471 INFO [Listener at localhost/39711] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 12:03:31,472 INFO [Listener at localhost/39711] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45749 2023-02-09 12:03:31,472 INFO [Listener at localhost/39711] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-09 12:03:31,473 DEBUG [Listener at localhost/39711] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 12:03:31,473 INFO [Listener at localhost/39711] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 12:03:31,474 INFO [Listener at localhost/39711] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 12:03:31,475 INFO [Listener at localhost/39711] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45749 connecting to ZooKeeper ensemble=127.0.0.1:63427 2023-02-09 12:03:31,477 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): regionserver:457490x0, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 12:03:31,478 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:45749-0x10038f71d5b0002 connected 2023-02-09 12:03:31,478 DEBUG [Listener at localhost/39711] zookeeper.ZKUtil(164): regionserver:45749-0x10038f71d5b0002, quorum=127.0.0.1:63427, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 12:03:31,479 DEBUG [Listener at localhost/39711] zookeeper.ZKUtil(164): regionserver:45749-0x10038f71d5b0002, quorum=127.0.0.1:63427, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 12:03:31,479 DEBUG [Listener at localhost/39711] zookeeper.ZKUtil(164): regionserver:45749-0x10038f71d5b0002, quorum=127.0.0.1:63427, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 12:03:31,480 DEBUG [Listener at localhost/39711] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45749 2023-02-09 12:03:31,480 DEBUG [Listener at localhost/39711] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45749 2023-02-09 12:03:31,484 DEBUG [Listener at localhost/39711] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45749 2023-02-09 12:03:31,484 DEBUG [Listener at localhost/39711] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45749 2023-02-09 12:03:31,485 DEBUG [Listener at localhost/39711] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45749 2023-02-09 12:03:31,488 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,37757,1675944211375 2023-02-09 12:03:31,489 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): master:37757-0x10038f71d5b0000, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-09 12:03:31,490 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37757-0x10038f71d5b0000, quorum=127.0.0.1:63427, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,37757,1675944211375 2023-02-09 12:03:31,492 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): regionserver:36449-0x10038f71d5b0001, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 12:03:31,492 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): master:37757-0x10038f71d5b0000, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 12:03:31,492 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): regionserver:45749-0x10038f71d5b0002, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 12:03:31,493 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): master:37757-0x10038f71d5b0000, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 12:03:31,494 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37757-0x10038f71d5b0000, quorum=127.0.0.1:63427, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-09 12:03:31,495 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:37757-0x10038f71d5b0000, quorum=127.0.0.1:63427, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-09 12:03:31,495 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,37757,1675944211375 from backup master directory 2023-02-09 12:03:31,496 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): master:37757-0x10038f71d5b0000, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,37757,1675944211375 2023-02-09 12:03:31,496 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): master:37757-0x10038f71d5b0000, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-09 12:03:31,496 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 12:03:31,496 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,37757,1675944211375 2023-02-09 12:03:31,507 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/hbase.id with ID: 2af60c90-6912-4fb9-adb1-32538eec2004 2023-02-09 12:03:31,515 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 12:03:31,517 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): master:37757-0x10038f71d5b0000, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 12:03:31,526 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x7d8f37b9 to 127.0.0.1:63427 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 12:03:31,529 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3a901493, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 12:03:31,529 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-09 12:03:31,530 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-09 12:03:31,530 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 12:03:31,531 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/MasterData/data/master/store-tmp 2023-02-09 12:03:31,537 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:31,537 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-09 12:03:31,537 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 12:03:31,537 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 12:03:31,537 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-09 12:03:31,537 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 12:03:31,537 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 12:03:31,537 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675944211537Disabling compacts and flushes for region at 1675944211537Disabling writes for close at 1675944211537Writing region close event to WAL at 1675944211537Closed at 1675944211537 2023-02-09 12:03:31,538 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/MasterData/WALs/jenkins-hbase4.apache.org,37757,1675944211375 2023-02-09 12:03:31,540 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37757%2C1675944211375, suffix=, logDir=hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/MasterData/WALs/jenkins-hbase4.apache.org,37757,1675944211375, archiveDir=hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/MasterData/oldWALs, maxLogs=10 2023-02-09 12:03:31,552 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38153,DS-84b75b28-7ea1-4f75-846f-c0986e3b322a,DISK] 2023-02-09 12:03:31,552 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39655,DS-9a0b6269-aa90-4b0d-acd8-475a4b15ee60,DISK] 2023-02-09 12:03:31,554 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/MasterData/WALs/jenkins-hbase4.apache.org,37757,1675944211375/jenkins-hbase4.apache.org%2C37757%2C1675944211375.1675944211540 2023-02-09 12:03:31,554 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38153,DS-84b75b28-7ea1-4f75-846f-c0986e3b322a,DISK], DatanodeInfoWithStorage[127.0.0.1:39655,DS-9a0b6269-aa90-4b0d-acd8-475a4b15ee60,DISK]] 2023-02-09 12:03:31,554 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-09 12:03:31,554 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:31,554 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 12:03:31,554 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 12:03:31,555 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-09 12:03:31,556 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-09 12:03:31,556 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-09 12:03:31,557 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:31,557 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-09 12:03:31,558 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-09 12:03:31,560 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 12:03:31,561 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 12:03:31,561 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71649267, jitterRate=0.06765727698802948}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 12:03:31,561 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1675944211554Initializing all the Stores at 1675944211555 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944211555Cleaning up temporary data from old regions at 1675944211558 (+3 ms)Cleaning up detritus from prior splits at 1675944211558Region opened successfully at 1675944211561 (+3 ms) 2023-02-09 12:03:31,562 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-09 12:03:31,563 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-09 12:03:31,563 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-09 12:03:31,563 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-09 12:03:31,564 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-09 12:03:31,564 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-09 12:03:31,564 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-09 12:03:31,565 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-09 12:03:31,565 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-09 12:03:31,579 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-09 12:03:31,579 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-09 12:03:31,580 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37757-0x10038f71d5b0000, quorum=127.0.0.1:63427, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-09 12:03:31,580 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-09 12:03:31,580 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37757-0x10038f71d5b0000, quorum=127.0.0.1:63427, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-09 12:03:31,583 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): master:37757-0x10038f71d5b0000, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 12:03:31,583 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37757-0x10038f71d5b0000, quorum=127.0.0.1:63427, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-09 12:03:31,583 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37757-0x10038f71d5b0000, quorum=127.0.0.1:63427, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-09 12:03:31,584 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37757-0x10038f71d5b0000, quorum=127.0.0.1:63427, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-09 12:03:31,585 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): regionserver:45749-0x10038f71d5b0002, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 12:03:31,585 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): master:37757-0x10038f71d5b0000, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 12:03:31,585 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): regionserver:36449-0x10038f71d5b0001, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 12:03:31,585 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): master:37757-0x10038f71d5b0000, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 12:03:31,586 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,37757,1675944211375, sessionid=0x10038f71d5b0000, setting cluster-up flag (Was=false) 2023-02-09 12:03:31,591 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): master:37757-0x10038f71d5b0000, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 12:03:31,597 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-09 12:03:31,597 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,37757,1675944211375 2023-02-09 12:03:31,601 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): master:37757-0x10038f71d5b0000, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 12:03:31,604 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-09 12:03:31,605 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,37757,1675944211375 2023-02-09 12:03:31,605 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/.hbase-snapshot/.tmp 2023-02-09 12:03:31,606 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-09 12:03:31,607 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 12:03:31,607 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 12:03:31,607 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 12:03:31,607 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 12:03:31,607 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-09 12:03:31,607 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:31,607 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 12:03:31,607 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:31,609 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1675944241609 2023-02-09 12:03:31,610 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-09 12:03:31,610 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-09 12:03:31,610 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-09 12:03:31,610 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-09 12:03:31,610 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-09 12:03:31,610 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-09 12:03:31,610 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:31,611 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-09 12:03:31,611 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-09 12:03:31,611 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-09 12:03:31,611 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-09 12:03:31,611 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-09 12:03:31,611 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-09 12:03:31,611 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-09 12:03:31,612 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675944211611,5,FailOnTimeoutGroup] 2023-02-09 12:03:31,612 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675944211612,5,FailOnTimeoutGroup] 2023-02-09 12:03:31,612 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:31,612 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-09 12:03:31,612 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-09 12:03:31,612 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:31,612 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:31,622 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-09 12:03:31,623 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-09 12:03:31,623 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384 2023-02-09 12:03:31,629 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:31,630 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-09 12:03:31,631 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/data/hbase/meta/1588230740/info 2023-02-09 12:03:31,631 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-09 12:03:31,632 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:31,632 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-09 12:03:31,633 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/data/hbase/meta/1588230740/rep_barrier 2023-02-09 12:03:31,633 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-09 12:03:31,633 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:31,633 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-09 12:03:31,634 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/data/hbase/meta/1588230740/table 2023-02-09 12:03:31,634 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-09 12:03:31,635 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:31,635 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/data/hbase/meta/1588230740 2023-02-09 12:03:31,635 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/data/hbase/meta/1588230740 2023-02-09 12:03:31,637 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-09 12:03:31,637 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-09 12:03:31,639 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 12:03:31,639 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61487040, jitterRate=-0.0837717056274414}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-09 12:03:31,639 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1675944211630Initializing all the Stores at 1675944211630Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675944211630Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944211630Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675944211630Cleaning up temporary data from old regions at 1675944211636 (+6 ms)Cleaning up detritus from prior splits at 1675944211636Region opened successfully at 1675944211639 (+3 ms) 2023-02-09 12:03:31,639 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-09 12:03:31,639 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-09 12:03:31,639 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-09 12:03:31,639 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-09 12:03:31,639 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-09 12:03:31,640 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-09 12:03:31,640 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675944211639Disabling compacts and flushes for region at 1675944211639Disabling writes for close at 1675944211639Writing region close event to WAL at 1675944211640 (+1 ms)Closed at 1675944211640 2023-02-09 12:03:31,640 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-09 12:03:31,640 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-09 12:03:31,640 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-09 12:03:31,642 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-09 12:03:31,643 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-09 12:03:31,690 INFO [RS:1;jenkins-hbase4:45749] regionserver.HRegionServer(952): ClusterId : 2af60c90-6912-4fb9-adb1-32538eec2004 2023-02-09 12:03:31,690 INFO [RS:0;jenkins-hbase4:36449] regionserver.HRegionServer(952): ClusterId : 2af60c90-6912-4fb9-adb1-32538eec2004 2023-02-09 12:03:31,690 DEBUG [RS:1;jenkins-hbase4:45749] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-09 12:03:31,690 DEBUG [RS:0;jenkins-hbase4:36449] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-09 12:03:31,693 DEBUG [RS:0;jenkins-hbase4:36449] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-09 12:03:31,693 DEBUG [RS:0;jenkins-hbase4:36449] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-09 12:03:31,693 DEBUG [RS:1;jenkins-hbase4:45749] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-09 12:03:31,693 DEBUG [RS:1;jenkins-hbase4:45749] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-09 12:03:31,695 DEBUG [RS:0;jenkins-hbase4:36449] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-09 12:03:31,696 DEBUG [RS:0;jenkins-hbase4:36449] zookeeper.ReadOnlyZKClient(139): Connect 0x4520eb80 to 127.0.0.1:63427 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 12:03:31,696 DEBUG [RS:1;jenkins-hbase4:45749] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-09 12:03:31,697 DEBUG [RS:1;jenkins-hbase4:45749] zookeeper.ReadOnlyZKClient(139): Connect 0x0eb1d6e8 to 127.0.0.1:63427 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 12:03:31,701 DEBUG [RS:0;jenkins-hbase4:36449] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4be71d54, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 12:03:31,702 DEBUG [RS:0;jenkins-hbase4:36449] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4fd880f0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 12:03:31,702 DEBUG [RS:1;jenkins-hbase4:45749] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@76294e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 12:03:31,702 DEBUG [RS:1;jenkins-hbase4:45749] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@449bd98, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 12:03:31,710 DEBUG [RS:1;jenkins-hbase4:45749] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:45749 2023-02-09 12:03:31,710 DEBUG [RS:0;jenkins-hbase4:36449] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:36449 2023-02-09 12:03:31,710 INFO [RS:1;jenkins-hbase4:45749] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-09 12:03:31,710 INFO [RS:1;jenkins-hbase4:45749] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-09 12:03:31,710 INFO [RS:0;jenkins-hbase4:36449] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-09 12:03:31,710 INFO [RS:0;jenkins-hbase4:36449] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-09 12:03:31,710 DEBUG [RS:1;jenkins-hbase4:45749] regionserver.HRegionServer(1023): About to register with Master. 2023-02-09 12:03:31,710 DEBUG [RS:0;jenkins-hbase4:36449] regionserver.HRegionServer(1023): About to register with Master. 2023-02-09 12:03:31,711 INFO [RS:1;jenkins-hbase4:45749] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,37757,1675944211375 with isa=jenkins-hbase4.apache.org/172.31.14.131:45749, startcode=1675944211470 2023-02-09 12:03:31,711 INFO [RS:0;jenkins-hbase4:36449] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,37757,1675944211375 with isa=jenkins-hbase4.apache.org/172.31.14.131:36449, startcode=1675944211440 2023-02-09 12:03:31,711 DEBUG [RS:1;jenkins-hbase4:45749] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-09 12:03:31,711 DEBUG [RS:0;jenkins-hbase4:36449] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-09 12:03:31,713 INFO [RS-EventLoopGroup-21-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48251, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.13 (auth:SIMPLE), service=RegionServerStatusService 2023-02-09 12:03:31,713 INFO [RS-EventLoopGroup-21-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42137, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.12 (auth:SIMPLE), service=RegionServerStatusService 2023-02-09 12:03:31,714 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37757] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,45749,1675944211470 2023-02-09 12:03:31,715 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37757] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,36449,1675944211440 2023-02-09 12:03:31,716 DEBUG [RS:1;jenkins-hbase4:45749] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384 2023-02-09 12:03:31,716 DEBUG [RS:1;jenkins-hbase4:45749] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:44979 2023-02-09 12:03:31,716 DEBUG [RS:1;jenkins-hbase4:45749] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-09 12:03:31,716 DEBUG [RS:0;jenkins-hbase4:36449] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384 2023-02-09 12:03:31,716 DEBUG [RS:0;jenkins-hbase4:36449] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:44979 2023-02-09 12:03:31,716 DEBUG [RS:0;jenkins-hbase4:36449] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-09 12:03:31,717 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): master:37757-0x10038f71d5b0000, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 12:03:31,721 DEBUG [RS:1;jenkins-hbase4:45749] zookeeper.ZKUtil(162): regionserver:45749-0x10038f71d5b0002, quorum=127.0.0.1:63427, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45749,1675944211470 2023-02-09 12:03:31,721 WARN [RS:1;jenkins-hbase4:45749] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 12:03:31,721 INFO [RS:1;jenkins-hbase4:45749] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 12:03:31,721 DEBUG [RS:0;jenkins-hbase4:36449] zookeeper.ZKUtil(162): regionserver:36449-0x10038f71d5b0001, quorum=127.0.0.1:63427, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36449,1675944211440 2023-02-09 12:03:31,721 DEBUG [RS:1;jenkins-hbase4:45749] regionserver.HRegionServer(1947): logDir=hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/WALs/jenkins-hbase4.apache.org,45749,1675944211470 2023-02-09 12:03:31,721 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,36449,1675944211440] 2023-02-09 12:03:31,721 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,45749,1675944211470] 2023-02-09 12:03:31,721 WARN [RS:0;jenkins-hbase4:36449] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 12:03:31,721 INFO [RS:0;jenkins-hbase4:36449] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 12:03:31,721 DEBUG [RS:0;jenkins-hbase4:36449] regionserver.HRegionServer(1947): logDir=hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/WALs/jenkins-hbase4.apache.org,36449,1675944211440 2023-02-09 12:03:31,735 DEBUG [RS:1;jenkins-hbase4:45749] zookeeper.ZKUtil(162): regionserver:45749-0x10038f71d5b0002, quorum=127.0.0.1:63427, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36449,1675944211440 2023-02-09 12:03:31,735 DEBUG [RS:0;jenkins-hbase4:36449] zookeeper.ZKUtil(162): regionserver:36449-0x10038f71d5b0001, quorum=127.0.0.1:63427, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36449,1675944211440 2023-02-09 12:03:31,736 DEBUG [RS:1;jenkins-hbase4:45749] zookeeper.ZKUtil(162): regionserver:45749-0x10038f71d5b0002, quorum=127.0.0.1:63427, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45749,1675944211470 2023-02-09 12:03:31,736 DEBUG [RS:0;jenkins-hbase4:36449] zookeeper.ZKUtil(162): regionserver:36449-0x10038f71d5b0001, quorum=127.0.0.1:63427, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45749,1675944211470 2023-02-09 12:03:31,736 DEBUG [RS:1;jenkins-hbase4:45749] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-09 12:03:31,736 DEBUG [RS:0;jenkins-hbase4:36449] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-09 12:03:31,736 INFO [RS:1;jenkins-hbase4:45749] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-09 12:03:31,737 INFO [RS:0;jenkins-hbase4:36449] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-09 12:03:31,740 INFO [RS:1;jenkins-hbase4:45749] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-09 12:03:31,740 INFO [RS:0;jenkins-hbase4:36449] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-09 12:03:31,744 INFO [RS:1;jenkins-hbase4:45749] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 12:03:31,744 INFO [RS:1;jenkins-hbase4:45749] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:31,744 INFO [RS:0;jenkins-hbase4:36449] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 12:03:31,744 INFO [RS:0;jenkins-hbase4:36449] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:31,745 INFO [RS:1;jenkins-hbase4:45749] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-09 12:03:31,747 INFO [RS:0;jenkins-hbase4:36449] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-09 12:03:31,749 INFO [RS:0;jenkins-hbase4:36449] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:31,750 INFO [RS:1;jenkins-hbase4:45749] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:31,750 DEBUG [RS:0;jenkins-hbase4:36449] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:31,750 DEBUG [RS:0;jenkins-hbase4:36449] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:31,750 DEBUG [RS:1;jenkins-hbase4:45749] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:31,750 DEBUG [RS:0;jenkins-hbase4:36449] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:31,751 DEBUG [RS:1;jenkins-hbase4:45749] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:31,751 DEBUG [RS:0;jenkins-hbase4:36449] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:31,751 DEBUG [RS:1;jenkins-hbase4:45749] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:31,751 DEBUG [RS:0;jenkins-hbase4:36449] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:31,751 DEBUG [RS:1;jenkins-hbase4:45749] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:31,751 DEBUG [RS:0;jenkins-hbase4:36449] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 12:03:31,751 DEBUG [RS:1;jenkins-hbase4:45749] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:31,751 DEBUG [RS:0;jenkins-hbase4:36449] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:31,751 DEBUG [RS:1;jenkins-hbase4:45749] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 12:03:31,751 DEBUG [RS:0;jenkins-hbase4:36449] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:31,751 DEBUG [RS:1;jenkins-hbase4:45749] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:31,751 DEBUG [RS:0;jenkins-hbase4:36449] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:31,751 DEBUG [RS:1;jenkins-hbase4:45749] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:31,751 DEBUG [RS:0;jenkins-hbase4:36449] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:31,751 DEBUG [RS:1;jenkins-hbase4:45749] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:31,751 DEBUG [RS:1;jenkins-hbase4:45749] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 12:03:31,756 INFO [RS:0;jenkins-hbase4:36449] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:31,756 INFO [RS:0;jenkins-hbase4:36449] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:31,756 INFO [RS:0;jenkins-hbase4:36449] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:31,757 INFO [RS:1;jenkins-hbase4:45749] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:31,757 INFO [RS:1;jenkins-hbase4:45749] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:31,757 INFO [RS:1;jenkins-hbase4:45749] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:31,768 INFO [RS:0;jenkins-hbase4:36449] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-09 12:03:31,768 INFO [RS:1;jenkins-hbase4:45749] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-09 12:03:31,768 INFO [RS:0;jenkins-hbase4:36449] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36449,1675944211440-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:31,768 INFO [RS:1;jenkins-hbase4:45749] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45749,1675944211470-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:31,783 INFO [RS:0;jenkins-hbase4:36449] regionserver.Replication(203): jenkins-hbase4.apache.org,36449,1675944211440 started 2023-02-09 12:03:31,783 INFO [RS:0;jenkins-hbase4:36449] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,36449,1675944211440, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:36449, sessionid=0x10038f71d5b0001 2023-02-09 12:03:31,783 INFO [RS:1;jenkins-hbase4:45749] regionserver.Replication(203): jenkins-hbase4.apache.org,45749,1675944211470 started 2023-02-09 12:03:31,783 DEBUG [RS:0;jenkins-hbase4:36449] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-09 12:03:31,783 DEBUG [RS:0;jenkins-hbase4:36449] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,36449,1675944211440 2023-02-09 12:03:31,783 DEBUG [RS:0;jenkins-hbase4:36449] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36449,1675944211440' 2023-02-09 12:03:31,783 INFO [RS:1;jenkins-hbase4:45749] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,45749,1675944211470, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:45749, sessionid=0x10038f71d5b0002 2023-02-09 12:03:31,783 DEBUG [RS:0;jenkins-hbase4:36449] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 12:03:31,783 DEBUG [RS:1;jenkins-hbase4:45749] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-09 12:03:31,783 DEBUG [RS:1;jenkins-hbase4:45749] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,45749,1675944211470 2023-02-09 12:03:31,783 DEBUG [RS:1;jenkins-hbase4:45749] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45749,1675944211470' 2023-02-09 12:03:31,783 DEBUG [RS:1;jenkins-hbase4:45749] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 12:03:31,783 DEBUG [RS:0;jenkins-hbase4:36449] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 12:03:31,783 DEBUG [RS:1;jenkins-hbase4:45749] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 12:03:31,784 DEBUG [RS:0;jenkins-hbase4:36449] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-09 12:03:31,784 DEBUG [RS:1;jenkins-hbase4:45749] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-09 12:03:31,784 DEBUG [RS:1;jenkins-hbase4:45749] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-09 12:03:31,784 DEBUG [RS:1;jenkins-hbase4:45749] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,45749,1675944211470 2023-02-09 12:03:31,784 DEBUG [RS:0;jenkins-hbase4:36449] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-09 12:03:31,784 DEBUG [RS:1;jenkins-hbase4:45749] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45749,1675944211470' 2023-02-09 12:03:31,784 DEBUG [RS:1;jenkins-hbase4:45749] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 12:03:31,784 DEBUG [RS:0;jenkins-hbase4:36449] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,36449,1675944211440 2023-02-09 12:03:31,784 DEBUG [RS:0;jenkins-hbase4:36449] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36449,1675944211440' 2023-02-09 12:03:31,784 DEBUG [RS:0;jenkins-hbase4:36449] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 12:03:31,784 DEBUG [RS:1;jenkins-hbase4:45749] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 12:03:31,784 DEBUG [RS:0;jenkins-hbase4:36449] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 12:03:31,784 DEBUG [RS:1;jenkins-hbase4:45749] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-09 12:03:31,784 DEBUG [RS:0;jenkins-hbase4:36449] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-09 12:03:31,784 INFO [RS:1;jenkins-hbase4:45749] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-09 12:03:31,784 INFO [RS:1;jenkins-hbase4:45749] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-09 12:03:31,784 INFO [RS:0;jenkins-hbase4:36449] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-09 12:03:31,784 INFO [RS:0;jenkins-hbase4:36449] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-09 12:03:31,793 DEBUG [jenkins-hbase4:37757] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-09 12:03:31,793 DEBUG [jenkins-hbase4:37757] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 12:03:31,794 DEBUG [jenkins-hbase4:37757] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 12:03:31,794 DEBUG [jenkins-hbase4:37757] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 12:03:31,794 DEBUG [jenkins-hbase4:37757] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 12:03:31,795 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,45749,1675944211470, state=OPENING 2023-02-09 12:03:31,796 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-09 12:03:31,797 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): master:37757-0x10038f71d5b0000, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 12:03:31,798 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,45749,1675944211470}] 2023-02-09 12:03:31,798 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-09 12:03:31,952 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,45749,1675944211470 2023-02-09 12:03:31,953 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-09 12:03:31,954 INFO [RS-EventLoopGroup-23-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32898, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-09 12:03:31,957 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-09 12:03:31,957 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 12:03:31,959 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45749%2C1675944211470.meta, suffix=.meta, logDir=hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/WALs/jenkins-hbase4.apache.org,45749,1675944211470, archiveDir=hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/oldWALs, maxLogs=32 2023-02-09 12:03:31,974 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38153,DS-84b75b28-7ea1-4f75-846f-c0986e3b322a,DISK] 2023-02-09 12:03:31,974 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39655,DS-9a0b6269-aa90-4b0d-acd8-475a4b15ee60,DISK] 2023-02-09 12:03:31,976 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/WALs/jenkins-hbase4.apache.org,45749,1675944211470/jenkins-hbase4.apache.org%2C45749%2C1675944211470.meta.1675944211959.meta 2023-02-09 12:03:31,976 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38153,DS-84b75b28-7ea1-4f75-846f-c0986e3b322a,DISK], DatanodeInfoWithStorage[127.0.0.1:39655,DS-9a0b6269-aa90-4b0d-acd8-475a4b15ee60,DISK]] 2023-02-09 12:03:31,976 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-09 12:03:31,976 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-09 12:03:31,977 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-09 12:03:31,977 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-09 12:03:31,977 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-09 12:03:31,977 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:31,977 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-09 12:03:31,977 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-09 12:03:31,978 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-09 12:03:31,978 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/data/hbase/meta/1588230740/info 2023-02-09 12:03:31,978 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/data/hbase/meta/1588230740/info 2023-02-09 12:03:31,979 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-09 12:03:31,979 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:31,979 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-09 12:03:31,980 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/data/hbase/meta/1588230740/rep_barrier 2023-02-09 12:03:31,980 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/data/hbase/meta/1588230740/rep_barrier 2023-02-09 12:03:31,980 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-09 12:03:31,981 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:31,981 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-09 12:03:31,981 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/data/hbase/meta/1588230740/table 2023-02-09 12:03:31,981 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/data/hbase/meta/1588230740/table 2023-02-09 12:03:31,981 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-09 12:03:31,982 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:31,982 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/data/hbase/meta/1588230740 2023-02-09 12:03:31,983 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/data/hbase/meta/1588230740 2023-02-09 12:03:31,984 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-09 12:03:31,985 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-09 12:03:31,986 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58997541, jitterRate=-0.12086813151836395}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-09 12:03:31,986 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1675944211977Writing region info on filesystem at 1675944211977Initializing all the Stores at 1675944211977Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675944211977Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944211978 (+1 ms)Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675944211978Cleaning up temporary data from old regions at 1675944211984 (+6 ms)Cleaning up detritus from prior splits at 1675944211984Running coprocessor post-open hooks at 1675944211986 (+2 ms)Region opened successfully at 1675944211986 2023-02-09 12:03:31,986 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1675944211952 2023-02-09 12:03:31,990 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-09 12:03:31,992 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-09 12:03:31,992 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,45749,1675944211470, state=OPEN 2023-02-09 12:03:31,995 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): master:37757-0x10038f71d5b0000, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-09 12:03:31,995 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-09 12:03:31,997 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-09 12:03:31,997 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,45749,1675944211470 in 197 msec 2023-02-09 12:03:31,998 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-09 12:03:31,998 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 357 msec 2023-02-09 12:03:31,999 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 392 msec 2023-02-09 12:03:31,999 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1675944211490, completionTime=-1 2023-02-09 12:03:31,999 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-09 12:03:31,999 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-09 12:03:32,002 DEBUG [hconnection-0x2d5b0536-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 12:03:32,003 INFO [RS-EventLoopGroup-23-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32904, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 12:03:32,004 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-09 12:03:32,004 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1675944272004 2023-02-09 12:03:32,004 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1675944332004 2023-02-09 12:03:32,004 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 5 msec 2023-02-09 12:03:32,009 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37757,1675944211375-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:32,009 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37757,1675944211375-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:32,009 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37757,1675944211375-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:32,009 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:37757, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:32,009 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-09 12:03:32,009 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-09 12:03:32,010 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-09 12:03:32,010 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-09 12:03:32,012 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-09 12:03:32,012 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 12:03:32,013 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 12:03:32,014 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/.tmp/data/hbase/namespace/6a5818b67b368e114b0f9c6ad1f607a6 2023-02-09 12:03:32,014 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/.tmp/data/hbase/namespace/6a5818b67b368e114b0f9c6ad1f607a6 empty. 2023-02-09 12:03:32,015 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/.tmp/data/hbase/namespace/6a5818b67b368e114b0f9c6ad1f607a6 2023-02-09 12:03:32,015 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-09 12:03:32,026 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-09 12:03:32,027 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 6a5818b67b368e114b0f9c6ad1f607a6, NAME => 'hbase:namespace,,1675944212010.6a5818b67b368e114b0f9c6ad1f607a6.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/.tmp 2023-02-09 12:03:32,034 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675944212010.6a5818b67b368e114b0f9c6ad1f607a6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:32,034 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 6a5818b67b368e114b0f9c6ad1f607a6, disabling compactions & flushes 2023-02-09 12:03:32,034 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675944212010.6a5818b67b368e114b0f9c6ad1f607a6. 2023-02-09 12:03:32,034 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675944212010.6a5818b67b368e114b0f9c6ad1f607a6. 2023-02-09 12:03:32,034 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675944212010.6a5818b67b368e114b0f9c6ad1f607a6. after waiting 0 ms 2023-02-09 12:03:32,034 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675944212010.6a5818b67b368e114b0f9c6ad1f607a6. 2023-02-09 12:03:32,034 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675944212010.6a5818b67b368e114b0f9c6ad1f607a6. 2023-02-09 12:03:32,034 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 6a5818b67b368e114b0f9c6ad1f607a6: Waiting for close lock at 1675944212034Disabling compacts and flushes for region at 1675944212034Disabling writes for close at 1675944212034Writing region close event to WAL at 1675944212034Closed at 1675944212034 2023-02-09 12:03:32,036 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 12:03:32,037 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1675944212010.6a5818b67b368e114b0f9c6ad1f607a6.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675944212037"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675944212037"}]},"ts":"1675944212037"} 2023-02-09 12:03:32,038 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-09 12:03:32,039 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 12:03:32,039 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675944212039"}]},"ts":"1675944212039"} 2023-02-09 12:03:32,040 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-09 12:03:32,049 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 12:03:32,050 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 12:03:32,050 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 12:03:32,050 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 12:03:32,051 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=6a5818b67b368e114b0f9c6ad1f607a6, ASSIGN}] 2023-02-09 12:03:32,055 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=6a5818b67b368e114b0f9c6ad1f607a6, ASSIGN 2023-02-09 12:03:32,055 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=6a5818b67b368e114b0f9c6ad1f607a6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36449,1675944211440; forceNewPlan=false, retain=false 2023-02-09 12:03:32,206 INFO [jenkins-hbase4:37757] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-09 12:03:32,206 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=6a5818b67b368e114b0f9c6ad1f607a6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36449,1675944211440 2023-02-09 12:03:32,206 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1675944212010.6a5818b67b368e114b0f9c6ad1f607a6.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675944212206"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675944212206"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675944212206"}]},"ts":"1675944212206"} 2023-02-09 12:03:32,208 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 6a5818b67b368e114b0f9c6ad1f607a6, server=jenkins-hbase4.apache.org,36449,1675944211440}] 2023-02-09 12:03:32,361 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,36449,1675944211440 2023-02-09 12:03:32,361 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-09 12:03:32,362 INFO [RS-EventLoopGroup-22-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41100, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-09 12:03:32,366 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1675944212010.6a5818b67b368e114b0f9c6ad1f607a6. 2023-02-09 12:03:32,367 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36449%2C1675944211440, suffix=, logDir=hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/WALs/jenkins-hbase4.apache.org,36449,1675944211440, archiveDir=hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/oldWALs, maxLogs=32 2023-02-09 12:03:32,381 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38153,DS-84b75b28-7ea1-4f75-846f-c0986e3b322a,DISK] 2023-02-09 12:03:32,381 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39655,DS-9a0b6269-aa90-4b0d-acd8-475a4b15ee60,DISK] 2023-02-09 12:03:32,383 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/WALs/jenkins-hbase4.apache.org,36449,1675944211440/jenkins-hbase4.apache.org%2C36449%2C1675944211440.1675944212368 2023-02-09 12:03:32,384 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38153,DS-84b75b28-7ea1-4f75-846f-c0986e3b322a,DISK], DatanodeInfoWithStorage[127.0.0.1:39655,DS-9a0b6269-aa90-4b0d-acd8-475a4b15ee60,DISK]] 2023-02-09 12:03:32,384 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 6a5818b67b368e114b0f9c6ad1f607a6, NAME => 'hbase:namespace,,1675944212010.6a5818b67b368e114b0f9c6ad1f607a6.', STARTKEY => '', ENDKEY => ''} 2023-02-09 12:03:32,384 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 6a5818b67b368e114b0f9c6ad1f607a6 2023-02-09 12:03:32,384 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675944212010.6a5818b67b368e114b0f9c6ad1f607a6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:32,384 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 6a5818b67b368e114b0f9c6ad1f607a6 2023-02-09 12:03:32,384 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 6a5818b67b368e114b0f9c6ad1f607a6 2023-02-09 12:03:32,385 INFO [StoreOpener-6a5818b67b368e114b0f9c6ad1f607a6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 6a5818b67b368e114b0f9c6ad1f607a6 2023-02-09 12:03:32,386 DEBUG [StoreOpener-6a5818b67b368e114b0f9c6ad1f607a6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/data/hbase/namespace/6a5818b67b368e114b0f9c6ad1f607a6/info 2023-02-09 12:03:32,386 DEBUG [StoreOpener-6a5818b67b368e114b0f9c6ad1f607a6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/data/hbase/namespace/6a5818b67b368e114b0f9c6ad1f607a6/info 2023-02-09 12:03:32,387 INFO [StoreOpener-6a5818b67b368e114b0f9c6ad1f607a6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6a5818b67b368e114b0f9c6ad1f607a6 columnFamilyName info 2023-02-09 12:03:32,387 INFO [StoreOpener-6a5818b67b368e114b0f9c6ad1f607a6-1] regionserver.HStore(310): Store=6a5818b67b368e114b0f9c6ad1f607a6/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:32,388 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/data/hbase/namespace/6a5818b67b368e114b0f9c6ad1f607a6 2023-02-09 12:03:32,388 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/data/hbase/namespace/6a5818b67b368e114b0f9c6ad1f607a6 2023-02-09 12:03:32,390 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 6a5818b67b368e114b0f9c6ad1f607a6 2023-02-09 12:03:32,392 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/data/hbase/namespace/6a5818b67b368e114b0f9c6ad1f607a6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 12:03:32,392 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 6a5818b67b368e114b0f9c6ad1f607a6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61018586, jitterRate=-0.09075221419334412}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 12:03:32,392 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 6a5818b67b368e114b0f9c6ad1f607a6: Running coprocessor pre-open hook at 1675944212384Writing region info on filesystem at 1675944212384Initializing all the Stores at 1675944212385 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675944212385Cleaning up temporary data from old regions at 1675944212389 (+4 ms)Cleaning up detritus from prior splits at 1675944212389Running coprocessor post-open hooks at 1675944212392 (+3 ms)Region opened successfully at 1675944212392 2023-02-09 12:03:32,393 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1675944212010.6a5818b67b368e114b0f9c6ad1f607a6., pid=6, masterSystemTime=1675944212361 2023-02-09 12:03:32,396 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1675944212010.6a5818b67b368e114b0f9c6ad1f607a6. 2023-02-09 12:03:32,396 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1675944212010.6a5818b67b368e114b0f9c6ad1f607a6. 2023-02-09 12:03:32,396 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=6a5818b67b368e114b0f9c6ad1f607a6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36449,1675944211440 2023-02-09 12:03:32,396 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1675944212010.6a5818b67b368e114b0f9c6ad1f607a6.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675944212396"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675944212396"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675944212396"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675944212396"}]},"ts":"1675944212396"} 2023-02-09 12:03:32,399 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-09 12:03:32,399 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 6a5818b67b368e114b0f9c6ad1f607a6, server=jenkins-hbase4.apache.org,36449,1675944211440 in 189 msec 2023-02-09 12:03:32,400 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-09 12:03:32,400 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=6a5818b67b368e114b0f9c6ad1f607a6, ASSIGN in 348 msec 2023-02-09 12:03:32,400 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 12:03:32,401 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675944212401"}]},"ts":"1675944212401"} 2023-02-09 12:03:32,402 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-09 12:03:32,404 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 12:03:32,405 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 394 msec 2023-02-09 12:03:32,411 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37757-0x10038f71d5b0000, quorum=127.0.0.1:63427, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-09 12:03:32,413 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): master:37757-0x10038f71d5b0000, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-09 12:03:32,413 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): master:37757-0x10038f71d5b0000, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 12:03:32,414 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 12:03:32,416 INFO [RS-EventLoopGroup-22-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41112, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 12:03:32,417 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-09 12:03:32,423 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): master:37757-0x10038f71d5b0000, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-09 12:03:32,426 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 8 msec 2023-02-09 12:03:32,428 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-09 12:03:32,434 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): master:37757-0x10038f71d5b0000, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-09 12:03:32,436 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 7 msec 2023-02-09 12:03:32,443 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): master:37757-0x10038f71d5b0000, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-09 12:03:32,445 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): master:37757-0x10038f71d5b0000, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-09 12:03:32,445 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 0.949sec 2023-02-09 12:03:32,445 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-09 12:03:32,445 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-09 12:03:32,445 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-09 12:03:32,445 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37757,1675944211375-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-09 12:03:32,445 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37757,1675944211375-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-09 12:03:32,446 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-09 12:03:32,490 DEBUG [Listener at localhost/39711] zookeeper.ReadOnlyZKClient(139): Connect 0x262aec8b to 127.0.0.1:63427 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 12:03:32,494 DEBUG [Listener at localhost/39711] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@74dea0fb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 12:03:32,495 DEBUG [hconnection-0x1ca8bf52-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 12:03:32,497 INFO [RS-EventLoopGroup-23-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32910, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 12:03:32,498 INFO [Listener at localhost/39711] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,37757,1675944211375 2023-02-09 12:03:32,498 DEBUG [Listener at localhost/39711] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-09 12:03:32,498 INFO [Listener at localhost/39711] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:32,498 INFO [Listener at localhost/39711] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:32,500 DEBUG [Listener at localhost/39711] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-09 12:03:32,502 INFO [RS-EventLoopGroup-21-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57460, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-09 12:03:32,502 INFO [Listener at localhost/39711] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-09 12:03:32,503 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37757] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-09 12:03:32,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37757] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-09 12:03:32,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37757] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 77 connection: 172.31.14.131:57460 deadline: 1675944272502, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-09 12:03:32,503 INFO [Listener at localhost/39711] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-09 12:03:32,504 INFO [Listener at localhost/39711] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:32,504 INFO [Listener at localhost/39711] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:32,506 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37757] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-09 12:03:32,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37757] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-09 12:03:32,508 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 12:03:32,508 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37757] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-09 12:03:32,508 INFO [Listener at localhost/39711] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:32,509 INFO [Listener at localhost/39711] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:32,509 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 12:03:32,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37757] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 12:03:32,510 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/.tmp/data/default/testWithMapReduce/229a17d98726696f52568199fafeb0c8 2023-02-09 12:03:32,510 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/.tmp/data/default/testWithMapReduce/229a17d98726696f52568199fafeb0c8 empty. 2023-02-09 12:03:32,511 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/.tmp/data/default/testWithMapReduce/229a17d98726696f52568199fafeb0c8 2023-02-09 12:03:32,511 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-09 12:03:32,523 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-09 12:03:32,524 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 229a17d98726696f52568199fafeb0c8, NAME => 'testWithMapReduce,,1675944212506.229a17d98726696f52568199fafeb0c8.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/.tmp 2023-02-09 12:03:32,531 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675944212506.229a17d98726696f52568199fafeb0c8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:32,531 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 229a17d98726696f52568199fafeb0c8, disabling compactions & flushes 2023-02-09 12:03:32,531 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675944212506.229a17d98726696f52568199fafeb0c8. 2023-02-09 12:03:32,531 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675944212506.229a17d98726696f52568199fafeb0c8. 2023-02-09 12:03:32,531 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675944212506.229a17d98726696f52568199fafeb0c8. after waiting 0 ms 2023-02-09 12:03:32,531 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675944212506.229a17d98726696f52568199fafeb0c8. 2023-02-09 12:03:32,531 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675944212506.229a17d98726696f52568199fafeb0c8. 2023-02-09 12:03:32,531 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 229a17d98726696f52568199fafeb0c8: Waiting for close lock at 1675944212531Disabling compacts and flushes for region at 1675944212531Disabling writes for close at 1675944212531Writing region close event to WAL at 1675944212531Closed at 1675944212531 2023-02-09 12:03:32,533 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 12:03:32,534 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1675944212506.229a17d98726696f52568199fafeb0c8.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1675944212534"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675944212534"}]},"ts":"1675944212534"} 2023-02-09 12:03:32,535 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-09 12:03:32,536 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 12:03:32,536 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675944212536"}]},"ts":"1675944212536"} 2023-02-09 12:03:32,538 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-09 12:03:32,542 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 12:03:32,543 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 12:03:32,543 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 12:03:32,543 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 12:03:32,543 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=229a17d98726696f52568199fafeb0c8, ASSIGN}] 2023-02-09 12:03:32,544 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=229a17d98726696f52568199fafeb0c8, ASSIGN 2023-02-09 12:03:32,545 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=229a17d98726696f52568199fafeb0c8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45749,1675944211470; forceNewPlan=false, retain=false 2023-02-09 12:03:32,610 INFO [Listener at localhost/39711] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:32,610 INFO [Listener at localhost/39711] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:32,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37757] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 12:03:32,695 INFO [jenkins-hbase4:37757] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-09 12:03:32,695 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=229a17d98726696f52568199fafeb0c8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45749,1675944211470 2023-02-09 12:03:32,695 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1675944212506.229a17d98726696f52568199fafeb0c8.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1675944212695"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675944212695"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675944212695"}]},"ts":"1675944212695"} 2023-02-09 12:03:32,697 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 229a17d98726696f52568199fafeb0c8, server=jenkins-hbase4.apache.org,45749,1675944211470}] 2023-02-09 12:03:32,786 INFO [RS:1;jenkins-hbase4:45749] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45749%2C1675944211470, suffix=, logDir=hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/WALs/jenkins-hbase4.apache.org,45749,1675944211470, archiveDir=hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/oldWALs, maxLogs=32 2023-02-09 12:03:32,800 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38153,DS-84b75b28-7ea1-4f75-846f-c0986e3b322a,DISK] 2023-02-09 12:03:32,800 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39655,DS-9a0b6269-aa90-4b0d-acd8-475a4b15ee60,DISK] 2023-02-09 12:03:32,801 INFO [RS:1;jenkins-hbase4:45749] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/WALs/jenkins-hbase4.apache.org,45749,1675944211470/jenkins-hbase4.apache.org%2C45749%2C1675944211470.1675944212787 2023-02-09 12:03:32,802 DEBUG [RS:1;jenkins-hbase4:45749] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38153,DS-84b75b28-7ea1-4f75-846f-c0986e3b322a,DISK], DatanodeInfoWithStorage[127.0.0.1:39655,DS-9a0b6269-aa90-4b0d-acd8-475a4b15ee60,DISK]] 2023-02-09 12:03:32,811 INFO [Listener at localhost/39711] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:32,812 INFO [Listener at localhost/39711] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:32,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37757] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 12:03:32,851 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1675944212506.229a17d98726696f52568199fafeb0c8. 2023-02-09 12:03:32,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 229a17d98726696f52568199fafeb0c8, NAME => 'testWithMapReduce,,1675944212506.229a17d98726696f52568199fafeb0c8.', STARTKEY => '', ENDKEY => ''} 2023-02-09 12:03:32,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 229a17d98726696f52568199fafeb0c8 2023-02-09 12:03:32,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675944212506.229a17d98726696f52568199fafeb0c8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:32,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 229a17d98726696f52568199fafeb0c8 2023-02-09 12:03:32,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 229a17d98726696f52568199fafeb0c8 2023-02-09 12:03:32,853 INFO [StoreOpener-229a17d98726696f52568199fafeb0c8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 229a17d98726696f52568199fafeb0c8 2023-02-09 12:03:32,854 DEBUG [StoreOpener-229a17d98726696f52568199fafeb0c8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/data/default/testWithMapReduce/229a17d98726696f52568199fafeb0c8/f1 2023-02-09 12:03:32,854 DEBUG [StoreOpener-229a17d98726696f52568199fafeb0c8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/data/default/testWithMapReduce/229a17d98726696f52568199fafeb0c8/f1 2023-02-09 12:03:32,854 INFO [StoreOpener-229a17d98726696f52568199fafeb0c8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 229a17d98726696f52568199fafeb0c8 columnFamilyName f1 2023-02-09 12:03:32,855 INFO [StoreOpener-229a17d98726696f52568199fafeb0c8-1] regionserver.HStore(310): Store=229a17d98726696f52568199fafeb0c8/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:32,855 INFO [StoreOpener-229a17d98726696f52568199fafeb0c8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 229a17d98726696f52568199fafeb0c8 2023-02-09 12:03:32,856 DEBUG [StoreOpener-229a17d98726696f52568199fafeb0c8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/data/default/testWithMapReduce/229a17d98726696f52568199fafeb0c8/f2 2023-02-09 12:03:32,856 DEBUG [StoreOpener-229a17d98726696f52568199fafeb0c8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/data/default/testWithMapReduce/229a17d98726696f52568199fafeb0c8/f2 2023-02-09 12:03:32,856 INFO [StoreOpener-229a17d98726696f52568199fafeb0c8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 229a17d98726696f52568199fafeb0c8 columnFamilyName f2 2023-02-09 12:03:32,857 INFO [StoreOpener-229a17d98726696f52568199fafeb0c8-1] regionserver.HStore(310): Store=229a17d98726696f52568199fafeb0c8/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:32,857 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/data/default/testWithMapReduce/229a17d98726696f52568199fafeb0c8 2023-02-09 12:03:32,858 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/data/default/testWithMapReduce/229a17d98726696f52568199fafeb0c8 2023-02-09 12:03:32,859 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 12:03:32,860 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 229a17d98726696f52568199fafeb0c8 2023-02-09 12:03:32,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/data/default/testWithMapReduce/229a17d98726696f52568199fafeb0c8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 12:03:32,862 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 229a17d98726696f52568199fafeb0c8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66122364, jitterRate=-0.014699995517730713}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 12:03:32,862 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 229a17d98726696f52568199fafeb0c8: Running coprocessor pre-open hook at 1675944212852Writing region info on filesystem at 1675944212852Initializing all the Stores at 1675944212853 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944212853Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944212853Cleaning up temporary data from old regions at 1675944212858 (+5 ms)Cleaning up detritus from prior splits at 1675944212858Running coprocessor post-open hooks at 1675944212862 (+4 ms)Region opened successfully at 1675944212862 2023-02-09 12:03:32,862 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1675944212506.229a17d98726696f52568199fafeb0c8., pid=12, masterSystemTime=1675944212849 2023-02-09 12:03:32,864 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1675944212506.229a17d98726696f52568199fafeb0c8. 2023-02-09 12:03:32,865 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1675944212506.229a17d98726696f52568199fafeb0c8. 2023-02-09 12:03:32,865 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=229a17d98726696f52568199fafeb0c8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45749,1675944211470 2023-02-09 12:03:32,865 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1675944212506.229a17d98726696f52568199fafeb0c8.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1675944212865"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675944212865"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675944212865"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675944212865"}]},"ts":"1675944212865"} 2023-02-09 12:03:32,868 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-09 12:03:32,868 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 229a17d98726696f52568199fafeb0c8, server=jenkins-hbase4.apache.org,45749,1675944211470 in 169 msec 2023-02-09 12:03:32,869 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-09 12:03:32,869 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=229a17d98726696f52568199fafeb0c8, ASSIGN in 325 msec 2023-02-09 12:03:32,869 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 12:03:32,870 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675944212869"}]},"ts":"1675944212869"} 2023-02-09 12:03:32,871 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-09 12:03:32,873 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 12:03:32,874 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 367 msec 2023-02-09 12:03:33,113 INFO [Listener at localhost/39711] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:33,113 INFO [Listener at localhost/39711] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:33,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37757] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 12:03:33,114 INFO [Listener at localhost/39711] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-09 12:03:33,114 DEBUG [Listener at localhost/39711] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-09 12:03:33,115 INFO [Listener at localhost/39711] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-09 12:03:33,116 INFO [Listener at localhost/39711] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-09 12:03:33,117 INFO [Listener at localhost/39711] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-09 12:03:33,117 INFO [Listener at localhost/39711] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-09 12:03:33,117 INFO [Listener at localhost/39711] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-09 12:03:33,147 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45749] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,,1675944212506.229a17d98726696f52568199fafeb0c8. 2023-02-09 12:03:33,242 INFO [Listener at localhost/39711] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-09 12:03:33,242 INFO [Listener at localhost/39711] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-09 12:03:33,242 INFO [Listener at localhost/39711] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:33,242 INFO [Listener at localhost/39711] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:33,243 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37757] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-09 12:03:33,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37757] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1675944213243 (current time:1675944213243). 2023-02-09 12:03:33,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37757] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-09 12:03:33,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37757] zookeeper.ReadOnlyZKClient(139): Connect 0x3e89b6f1 to 127.0.0.1:63427 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 12:03:33,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37757] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@158eaf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 12:03:33,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37757] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 12:03:33,249 INFO [RS-EventLoopGroup-23-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32920, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 12:03:33,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37757] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3e89b6f1 to 127.0.0.1:63427 2023-02-09 12:03:33,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37757] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 12:03:33,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37757] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-09 12:03:33,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37757] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-09 12:03:33,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37757] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-09 12:03:33,253 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-09 12:03:33,254 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1675944813254 2023-02-09 12:03:33,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37757] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-09 12:03:33,254 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-09 12:03:33,255 DEBUG [Listener at localhost/39711] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-09 12:03:33,255 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-09 12:03:33,255 DEBUG [Listener at localhost/39711] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-09 12:03:33,256 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-09 12:03:33,256 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 4 msec 2023-02-09 12:03:33,257 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-09 12:03:33,258 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1675944813258 2023-02-09 12:03:33,268 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceSingleRegion 2023-02-09 12:03:33,268 INFO [(jenkins-hbase4.apache.org,37757,1675944211375)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceSingleRegion' 2023-02-09 12:03:33,268 DEBUG [(jenkins-hbase4.apache.org,37757,1675944211375)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 12:03:33,269 DEBUG [(jenkins-hbase4.apache.org,37757,1675944211375)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceSingleRegion' starting 'acquire' 2023-02-09 12:03:33,269 DEBUG [(jenkins-hbase4.apache.org,37757,1675944211375)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-09 12:03:33,269 DEBUG [(jenkins-hbase4.apache.org,37757,1675944211375)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37757-0x10038f71d5b0000, quorum=127.0.0.1:63427, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-09 12:03:33,269 DEBUG [(jenkins-hbase4.apache.org,37757,1675944211375)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-09 12:03:33,271 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): regionserver:45749-0x10038f71d5b0002, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 12:03:33,271 DEBUG [(jenkins-hbase4.apache.org,37757,1675944211375)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,45749,1675944211470 2023-02-09 12:03:33,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 12:03:33,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 12:03:33,271 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): regionserver:36449-0x10038f71d5b0001, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 12:03:33,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 12:03:33,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 12:03:33,271 DEBUG [(jenkins-hbase4.apache.org,37757,1675944211375)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37757-0x10038f71d5b0000, quorum=127.0.0.1:63427, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,45749,1675944211470 2023-02-09 12:03:33,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-09 12:03:33,271 DEBUG [(jenkins-hbase4.apache.org,37757,1675944211375)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 12:03:33,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-09 12:03:33,271 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45749-0x10038f71d5b0002, quorum=127.0.0.1:63427, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-09 12:03:33,272 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36449-0x10038f71d5b0001, quorum=127.0.0.1:63427, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-09 12:03:33,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-09 12:03:33,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-09 12:03:33,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-09 12:03:33,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-09 12:03:33,272 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-09 12:03:33,272 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-09 12:03:33,272 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-09 12:03:33,272 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-09 12:03:33,272 DEBUG [member: 'jenkins-hbase4.apache.org,45749,1675944211470' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-09 12:03:33,272 DEBUG [member: 'jenkins-hbase4.apache.org,45749,1675944211470' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 12:03:33,273 DEBUG [member: 'jenkins-hbase4.apache.org,45749,1675944211470' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-09 12:03:33,273 DEBUG [member: 'jenkins-hbase4.apache.org,36449,1675944211440' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-09 12:03:33,273 DEBUG [member: 'jenkins-hbase4.apache.org,36449,1675944211440' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 12:03:33,273 DEBUG [member: 'jenkins-hbase4.apache.org,45749,1675944211470' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-09 12:03:33,274 DEBUG [member: 'jenkins-hbase4.apache.org,45749,1675944211470' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45749,1675944211470' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-09 12:03:33,277 DEBUG [member: 'jenkins-hbase4.apache.org,36449,1675944211440' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-09 12:03:33,277 DEBUG [member: 'jenkins-hbase4.apache.org,36449,1675944211440' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-09 12:03:33,277 DEBUG [member: 'jenkins-hbase4.apache.org,36449,1675944211440' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36449,1675944211440' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-09 12:03:33,279 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): master:37757-0x10038f71d5b0000, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,45749,1675944211470 2023-02-09 12:03:33,279 DEBUG [member: 'jenkins-hbase4.apache.org,45749,1675944211470' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-09 12:03:33,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,45749,1675944211470 2023-02-09 12:03:33,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 12:03:33,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 12:03:33,280 DEBUG [member: 'jenkins-hbase4.apache.org,45749,1675944211470' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45749-0x10038f71d5b0002, quorum=127.0.0.1:63427, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-09 12:03:33,280 DEBUG [member: 'jenkins-hbase4.apache.org,36449,1675944211440' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-09 12:03:33,280 DEBUG [member: 'jenkins-hbase4.apache.org,45749,1675944211470' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 12:03:33,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 12:03:33,280 DEBUG [member: 'jenkins-hbase4.apache.org,36449,1675944211440' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36449-0x10038f71d5b0001, quorum=127.0.0.1:63427, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-09 12:03:33,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 12:03:33,280 DEBUG [member: 'jenkins-hbase4.apache.org,36449,1675944211440' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 12:03:33,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-09 12:03:33,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36449,1675944211440 2023-02-09 12:03:33,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45749,1675944211470 2023-02-09 12:03:33,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 12:03:33,281 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45749,1675944211470' joining acquired barrier for procedure 'testWithMapReduceSingleRegion' on coordinator 2023-02-09 12:03:33,281 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@338d59fa[Count = 0] remaining members to acquire global barrier 2023-02-09 12:03:33,281 DEBUG [(jenkins-hbase4.apache.org,37757,1675944211375)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-09 12:03:33,281 DEBUG [(jenkins-hbase4.apache.org,37757,1675944211375)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-09 12:03:33,284 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): regionserver:36449-0x10038f71d5b0001, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-09 12:03:33,284 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): regionserver:45749-0x10038f71d5b0002, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-09 12:03:33,284 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-09 12:03:33,284 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-09 12:03:33,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-09 12:03:33,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-09 12:03:33,284 DEBUG [member: 'jenkins-hbase4.apache.org,45749,1675944211470' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-09 12:03:33,284 DEBUG [member: 'jenkins-hbase4.apache.org,36449,1675944211440' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-09 12:03:33,284 DEBUG [member: 'jenkins-hbase4.apache.org,36449,1675944211440' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-09 12:03:33,284 DEBUG [(jenkins-hbase4.apache.org,37757,1675944211375)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37757-0x10038f71d5b0000, quorum=127.0.0.1:63427, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,45749,1675944211470 2023-02-09 12:03:33,284 DEBUG [(jenkins-hbase4.apache.org,37757,1675944211375)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 12:03:33,284 DEBUG [member: 'jenkins-hbase4.apache.org,36449,1675944211440' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,36449,1675944211440' in zk 2023-02-09 12:03:33,284 DEBUG [member: 'jenkins-hbase4.apache.org,45749,1675944211470' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-09 12:03:33,284 DEBUG [member: 'jenkins-hbase4.apache.org,45749,1675944211470' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-09 12:03:33,284 DEBUG [rs(jenkins-hbase4.apache.org,45749,1675944211470)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1675944212506.229a17d98726696f52568199fafeb0c8. 2023-02-09 12:03:33,284 DEBUG [rs(jenkins-hbase4.apache.org,45749,1675944211470)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1675944212506.229a17d98726696f52568199fafeb0c8. started... 2023-02-09 12:03:33,284 INFO [rs(jenkins-hbase4.apache.org,45749,1675944211470)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 229a17d98726696f52568199fafeb0c8 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-09 12:03:33,286 DEBUG [member: 'jenkins-hbase4.apache.org,36449,1675944211440' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-09 12:03:33,286 DEBUG [member: 'jenkins-hbase4.apache.org,36449,1675944211440' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 12:03:33,286 DEBUG [member: 'jenkins-hbase4.apache.org,36449,1675944211440' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-09 12:03:33,298 INFO [rs(jenkins-hbase4.apache.org,45749,1675944211470)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/data/default/testWithMapReduce/229a17d98726696f52568199fafeb0c8/.tmp/f1/fbd57d76f0f646b6b8f12a5aaf27858c 2023-02-09 12:03:33,314 INFO [rs(jenkins-hbase4.apache.org,45749,1675944211470)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/data/default/testWithMapReduce/229a17d98726696f52568199fafeb0c8/.tmp/f2/77416d1cf491493487f4d14e413a1257 2023-02-09 12:03:33,319 DEBUG [rs(jenkins-hbase4.apache.org,45749,1675944211470)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/data/default/testWithMapReduce/229a17d98726696f52568199fafeb0c8/.tmp/f1/fbd57d76f0f646b6b8f12a5aaf27858c as hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/data/default/testWithMapReduce/229a17d98726696f52568199fafeb0c8/f1/fbd57d76f0f646b6b8f12a5aaf27858c 2023-02-09 12:03:33,322 INFO [rs(jenkins-hbase4.apache.org,45749,1675944211470)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/data/default/testWithMapReduce/229a17d98726696f52568199fafeb0c8/f1/fbd57d76f0f646b6b8f12a5aaf27858c, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-09 12:03:33,323 DEBUG [rs(jenkins-hbase4.apache.org,45749,1675944211470)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/data/default/testWithMapReduce/229a17d98726696f52568199fafeb0c8/.tmp/f2/77416d1cf491493487f4d14e413a1257 as hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/data/default/testWithMapReduce/229a17d98726696f52568199fafeb0c8/f2/77416d1cf491493487f4d14e413a1257 2023-02-09 12:03:33,326 INFO [rs(jenkins-hbase4.apache.org,45749,1675944211470)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/data/default/testWithMapReduce/229a17d98726696f52568199fafeb0c8/f2/77416d1cf491493487f4d14e413a1257, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-09 12:03:33,327 INFO [rs(jenkins-hbase4.apache.org,45749,1675944211470)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 229a17d98726696f52568199fafeb0c8 in 43ms, sequenceid=5, compaction requested=false 2023-02-09 12:03:33,327 DEBUG [rs(jenkins-hbase4.apache.org,45749,1675944211470)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 229a17d98726696f52568199fafeb0c8: 2023-02-09 12:03:33,327 DEBUG [rs(jenkins-hbase4.apache.org,45749,1675944211470)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1675944212506.229a17d98726696f52568199fafeb0c8.' region-info for snapshot=testWithMapReduceSingleRegion 2023-02-09 12:03:33,327 DEBUG [rs(jenkins-hbase4.apache.org,45749,1675944211470)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 12:03:33,327 DEBUG [rs(jenkins-hbase4.apache.org,45749,1675944211470)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/data/default/testWithMapReduce/229a17d98726696f52568199fafeb0c8/f1/fbd57d76f0f646b6b8f12a5aaf27858c] hfiles 2023-02-09 12:03:33,328 DEBUG [rs(jenkins-hbase4.apache.org,45749,1675944211470)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/data/default/testWithMapReduce/229a17d98726696f52568199fafeb0c8/f1/fbd57d76f0f646b6b8f12a5aaf27858c for snapshot=testWithMapReduceSingleRegion 2023-02-09 12:03:33,328 DEBUG [rs(jenkins-hbase4.apache.org,45749,1675944211470)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/data/default/testWithMapReduce/229a17d98726696f52568199fafeb0c8/f2/77416d1cf491493487f4d14e413a1257] hfiles 2023-02-09 12:03:33,328 DEBUG [rs(jenkins-hbase4.apache.org,45749,1675944211470)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/data/default/testWithMapReduce/229a17d98726696f52568199fafeb0c8/f2/77416d1cf491493487f4d14e413a1257 for snapshot=testWithMapReduceSingleRegion 2023-02-09 12:03:33,334 DEBUG [rs(jenkins-hbase4.apache.org,45749,1675944211470)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1675944212506.229a17d98726696f52568199fafeb0c8. completed. 2023-02-09 12:03:33,334 DEBUG [rs(jenkins-hbase4.apache.org,45749,1675944211470)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1675944212506.229a17d98726696f52568199fafeb0c8. 2023-02-09 12:03:33,334 DEBUG [member: 'jenkins-hbase4.apache.org,45749,1675944211470' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-09 12:03:33,334 DEBUG [member: 'jenkins-hbase4.apache.org,45749,1675944211470' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-09 12:03:33,334 DEBUG [member: 'jenkins-hbase4.apache.org,45749,1675944211470' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45749,1675944211470 2023-02-09 12:03:33,334 DEBUG [member: 'jenkins-hbase4.apache.org,45749,1675944211470' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-09 12:03:33,334 DEBUG [member: 'jenkins-hbase4.apache.org,45749,1675944211470' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,45749,1675944211470' in zk 2023-02-09 12:03:33,336 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): master:37757-0x10038f71d5b0000, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,45749,1675944211470 2023-02-09 12:03:33,336 DEBUG [member: 'jenkins-hbase4.apache.org,45749,1675944211470' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-09 12:03:33,336 DEBUG [member: 'jenkins-hbase4.apache.org,45749,1675944211470' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 12:03:33,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,45749,1675944211470 2023-02-09 12:03:33,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 12:03:33,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 12:03:33,336 DEBUG [member: 'jenkins-hbase4.apache.org,45749,1675944211470' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-09 12:03:33,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 12:03:33,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 12:03:33,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-09 12:03:33,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36449,1675944211440 2023-02-09 12:03:33,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45749,1675944211470 2023-02-09 12:03:33,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 12:03:33,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-09 12:03:33,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36449,1675944211440 2023-02-09 12:03:33,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45749,1675944211470 2023-02-09 12:03:33,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,45749,1675944211470': 2023-02-09 12:03:33,339 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45749,1675944211470' released barrier for procedure'testWithMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-09 12:03:33,339 INFO [(jenkins-hbase4.apache.org,37757,1675944211375)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceSingleRegion' execution completed 2023-02-09 12:03:33,339 DEBUG [(jenkins-hbase4.apache.org,37757,1675944211375)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 12:03:33,339 DEBUG [(jenkins-hbase4.apache.org,37757,1675944211375)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 12:03:33,339 DEBUG [(jenkins-hbase4.apache.org,37757,1675944211375)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceSingleRegion 2023-02-09 12:03:33,339 INFO [(jenkins-hbase4.apache.org,37757,1675944211375)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-09 12:03:33,341 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): master:37757-0x10038f71d5b0000, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-09 12:03:33,341 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): regionserver:36449-0x10038f71d5b0001, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-09 12:03:33,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-09 12:03:33,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 12:03:33,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 12:03:33,341 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): regionserver:45749-0x10038f71d5b0002, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-09 12:03:33,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-09 12:03:33,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-09 12:03:33,341 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): regionserver:36449-0x10038f71d5b0001, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 12:03:33,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-09 12:03:33,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-09 12:03:33,342 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): regionserver:45749-0x10038f71d5b0002, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 12:03:33,342 DEBUG [(jenkins-hbase4.apache.org,37757,1675944211375)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37757-0x10038f71d5b0000, quorum=127.0.0.1:63427, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,36449,1675944211440 2023-02-09 12:03:33,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 12:03:33,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 12:03:33,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 12:03:33,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 12:03:33,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 12:03:33,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-09 12:03:33,343 DEBUG [(jenkins-hbase4.apache.org,37757,1675944211375)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37757-0x10038f71d5b0000, quorum=127.0.0.1:63427, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,45749,1675944211470 2023-02-09 12:03:33,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-09 12:03:33,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-09 12:03:33,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 12:03:33,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-09 12:03:33,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36449,1675944211440 2023-02-09 12:03:33,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45749,1675944211470 2023-02-09 12:03:33,344 DEBUG [(jenkins-hbase4.apache.org,37757,1675944211375)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37757-0x10038f71d5b0000, quorum=127.0.0.1:63427, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,36449,1675944211440 2023-02-09 12:03:33,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 12:03:33,344 DEBUG [(jenkins-hbase4.apache.org,37757,1675944211375)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37757-0x10038f71d5b0000, quorum=127.0.0.1:63427, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,45749,1675944211470 2023-02-09 12:03:33,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-09 12:03:33,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36449,1675944211440 2023-02-09 12:03:33,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45749,1675944211470 2023-02-09 12:03:33,351 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): master:37757-0x10038f71d5b0000, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,45749,1675944211470 2023-02-09 12:03:33,351 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): regionserver:36449-0x10038f71d5b0001, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 12:03:33,351 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): regionserver:45749-0x10038f71d5b0002, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 12:03:33,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 12:03:33,352 DEBUG [(jenkins-hbase4.apache.org,37757,1675944211375)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 12:03:33,351 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): regionserver:36449-0x10038f71d5b0001, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 12:03:33,351 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): master:37757-0x10038f71d5b0000, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-09 12:03:33,352 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceSingleRegion 2023-02-09 12:03:33,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 12:03:33,352 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 12:03:33,352 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): regionserver:45749-0x10038f71d5b0002, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 12:03:33,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 12:03:33,352 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceSingleRegion 2023-02-09 12:03:33,352 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): master:37757-0x10038f71d5b0000, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,36449,1675944211440 2023-02-09 12:03:33,352 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): master:37757-0x10038f71d5b0000, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-09 12:03:33,352 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): master:37757-0x10038f71d5b0000, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,45749,1675944211470 2023-02-09 12:03:33,352 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): master:37757-0x10038f71d5b0000, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-09 12:03:33,352 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): master:37757-0x10038f71d5b0000, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,36449,1675944211440 2023-02-09 12:03:33,352 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): master:37757-0x10038f71d5b0000, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-09 12:03:33,352 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): master:37757-0x10038f71d5b0000, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-09 12:03:33,353 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-09 12:03:33,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 12:03:33,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 12:03:33,356 DEBUG [Listener at localhost/39711] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 12:03:33,356 INFO [Listener at localhost/39711] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:33,356 INFO [Listener at localhost/39711] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:33,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37757] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-09 12:03:33,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37757] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-09 12:03:33,357 DEBUG [Listener at localhost/39711] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-09 12:03:33,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 12:03:33,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 12:03:33,372 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion to hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/.hbase-snapshot/testWithMapReduceSingleRegion 2023-02-09 12:03:33,389 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed 2023-02-09 12:03:33,389 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-09 12:03:33,390 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-09 12:03:33,390 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1675944213254Consolidate snapshot: testWithMapReduceSingleRegion at 1675944213352 (+98 ms)Loading Region manifests for testWithMapReduceSingleRegion at 1675944213352Writing data manifest for testWithMapReduceSingleRegion at 1675944213359 (+7 ms)Verifying snapshot: testWithMapReduceSingleRegion at 1675944213365 (+6 ms)Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed at 1675944213389 (+24 ms) 2023-02-09 12:03:33,393 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-09 12:03:33,394 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 138 msec 2023-02-09 12:03:33,557 DEBUG [Listener at localhost/39711] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 12:03:33,557 INFO [Listener at localhost/39711] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:33,557 INFO [Listener at localhost/39711] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:33,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37757] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-09 12:03:33,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37757] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-09 12:03:33,559 INFO [Listener at localhost/39711] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-09 12:03:33,559 INFO [Listener at localhost/39711] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:33,559 INFO [Listener at localhost/39711] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:33,562 INFO [Listener at localhost/39711] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-09 12:03:33,567 INFO [Listener at localhost/39711] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-09 12:03:33,604 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45749] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,,1675944212506.229a17d98726696f52568199fafeb0c8. 2023-02-09 12:03:33,693 INFO [Listener at localhost/39711] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-09 12:03:33,696 INFO [Listener at localhost/39711] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:33,697 INFO [Listener at localhost/39711] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:33,698 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37757] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 12:03:33,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37757] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-09 12:03:33,700 INFO [(jenkins-hbase4.apache.org,37757,1675944211375)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-09 12:03:33,700 DEBUG [(jenkins-hbase4.apache.org,37757,1675944211375)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 12:03:33,700 DEBUG [(jenkins-hbase4.apache.org,37757,1675944211375)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-09 12:03:33,700 DEBUG [(jenkins-hbase4.apache.org,37757,1675944211375)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-09 12:03:33,701 DEBUG [(jenkins-hbase4.apache.org,37757,1675944211375)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37757-0x10038f71d5b0000, quorum=127.0.0.1:63427, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 12:03:33,701 DEBUG [(jenkins-hbase4.apache.org,37757,1675944211375)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 12:03:33,702 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): regionserver:45749-0x10038f71d5b0002, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 12:03:33,702 DEBUG [(jenkins-hbase4.apache.org,37757,1675944211375)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,45749,1675944211470 2023-02-09 12:03:33,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 12:03:33,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 12:03:33,702 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): regionserver:36449-0x10038f71d5b0001, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 12:03:33,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 12:03:33,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 12:03:33,702 DEBUG [(jenkins-hbase4.apache.org,37757,1675944211375)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37757-0x10038f71d5b0000, quorum=127.0.0.1:63427, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,45749,1675944211470 2023-02-09 12:03:33,702 DEBUG [(jenkins-hbase4.apache.org,37757,1675944211375)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 12:03:33,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 12:03:33,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 12:03:33,703 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45749-0x10038f71d5b0002, quorum=127.0.0.1:63427, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 12:03:33,703 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36449-0x10038f71d5b0001, quorum=127.0.0.1:63427, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 12:03:33,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 12:03:33,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 12:03:33,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 12:03:33,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 12:03:33,703 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-09 12:03:33,703 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-09 12:03:33,704 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-09 12:03:33,704 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-09 12:03:33,704 DEBUG [member: 'jenkins-hbase4.apache.org,45749,1675944211470' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-09 12:03:33,704 DEBUG [member: 'jenkins-hbase4.apache.org,45749,1675944211470' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 12:03:33,704 DEBUG [member: 'jenkins-hbase4.apache.org,45749,1675944211470' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-09 12:03:33,708 DEBUG [member: 'jenkins-hbase4.apache.org,36449,1675944211440' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-09 12:03:33,708 DEBUG [member: 'jenkins-hbase4.apache.org,36449,1675944211440' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 12:03:33,708 DEBUG [member: 'jenkins-hbase4.apache.org,45749,1675944211470' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 12:03:33,708 DEBUG [rs(jenkins-hbase4.apache.org,45749,1675944211470)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1675944212506.229a17d98726696f52568199fafeb0c8. 2023-02-09 12:03:33,708 DEBUG [member: 'jenkins-hbase4.apache.org,45749,1675944211470' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 12:03:33,708 DEBUG [rs(jenkins-hbase4.apache.org,45749,1675944211470)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1675944212506.229a17d98726696f52568199fafeb0c8. started... 2023-02-09 12:03:33,708 DEBUG [member: 'jenkins-hbase4.apache.org,36449,1675944211440' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-09 12:03:33,708 DEBUG [member: 'jenkins-hbase4.apache.org,36449,1675944211440' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-09 12:03:33,708 DEBUG [member: 'jenkins-hbase4.apache.org,36449,1675944211440' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36449,1675944211440' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-09 12:03:33,708 INFO [rs(jenkins-hbase4.apache.org,45749,1675944211470)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 229a17d98726696f52568199fafeb0c8 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-09 12:03:33,709 DEBUG [member: 'jenkins-hbase4.apache.org,36449,1675944211440' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 12:03:33,710 DEBUG [member: 'jenkins-hbase4.apache.org,36449,1675944211440' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36449-0x10038f71d5b0001, quorum=127.0.0.1:63427, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 12:03:33,710 DEBUG [member: 'jenkins-hbase4.apache.org,36449,1675944211440' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 12:03:33,723 INFO [rs(jenkins-hbase4.apache.org,45749,1675944211470)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/data/default/testWithMapReduce/229a17d98726696f52568199fafeb0c8/.tmp/f1/8fa5edce0fea4920a24d1585908c5825 2023-02-09 12:03:33,748 INFO [rs(jenkins-hbase4.apache.org,45749,1675944211470)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/data/default/testWithMapReduce/229a17d98726696f52568199fafeb0c8/.tmp/f2/7a88a730d40b436f9768c6f98c0a21d9 2023-02-09 12:03:33,752 DEBUG [rs(jenkins-hbase4.apache.org,45749,1675944211470)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/data/default/testWithMapReduce/229a17d98726696f52568199fafeb0c8/.tmp/f1/8fa5edce0fea4920a24d1585908c5825 as hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/data/default/testWithMapReduce/229a17d98726696f52568199fafeb0c8/f1/8fa5edce0fea4920a24d1585908c5825 2023-02-09 12:03:33,756 INFO [rs(jenkins-hbase4.apache.org,45749,1675944211470)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/data/default/testWithMapReduce/229a17d98726696f52568199fafeb0c8/f1/8fa5edce0fea4920a24d1585908c5825, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-09 12:03:33,757 DEBUG [rs(jenkins-hbase4.apache.org,45749,1675944211470)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/data/default/testWithMapReduce/229a17d98726696f52568199fafeb0c8/.tmp/f2/7a88a730d40b436f9768c6f98c0a21d9 as hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/data/default/testWithMapReduce/229a17d98726696f52568199fafeb0c8/f2/7a88a730d40b436f9768c6f98c0a21d9 2023-02-09 12:03:33,761 INFO [rs(jenkins-hbase4.apache.org,45749,1675944211470)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/data/default/testWithMapReduce/229a17d98726696f52568199fafeb0c8/f2/7a88a730d40b436f9768c6f98c0a21d9, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-09 12:03:33,762 INFO [rs(jenkins-hbase4.apache.org,45749,1675944211470)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 229a17d98726696f52568199fafeb0c8 in 54ms, sequenceid=9, compaction requested=false 2023-02-09 12:03:33,762 DEBUG [rs(jenkins-hbase4.apache.org,45749,1675944211470)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 229a17d98726696f52568199fafeb0c8: 2023-02-09 12:03:33,762 DEBUG [rs(jenkins-hbase4.apache.org,45749,1675944211470)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1675944212506.229a17d98726696f52568199fafeb0c8. 2023-02-09 12:03:33,762 DEBUG [member: 'jenkins-hbase4.apache.org,45749,1675944211470' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 12:03:33,762 DEBUG [member: 'jenkins-hbase4.apache.org,45749,1675944211470' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 12:03:33,762 DEBUG [member: 'jenkins-hbase4.apache.org,45749,1675944211470' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45749,1675944211470 2023-02-09 12:03:33,762 DEBUG [member: 'jenkins-hbase4.apache.org,45749,1675944211470' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-09 12:03:33,762 DEBUG [member: 'jenkins-hbase4.apache.org,45749,1675944211470' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45749,1675944211470' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-09 12:03:33,769 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): master:37757-0x10038f71d5b0000, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,45749,1675944211470 2023-02-09 12:03:33,769 DEBUG [member: 'jenkins-hbase4.apache.org,45749,1675944211470' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 12:03:33,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,45749,1675944211470 2023-02-09 12:03:33,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 12:03:33,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 12:03:33,769 DEBUG [member: 'jenkins-hbase4.apache.org,45749,1675944211470' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45749-0x10038f71d5b0002, quorum=127.0.0.1:63427, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 12:03:33,769 DEBUG [member: 'jenkins-hbase4.apache.org,45749,1675944211470' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 12:03:33,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 12:03:33,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 12:03:33,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 12:03:33,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36449,1675944211440 2023-02-09 12:03:33,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45749,1675944211470 2023-02-09 12:03:33,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 12:03:33,771 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45749,1675944211470' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-09 12:03:33,771 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@37b2db53[Count = 0] remaining members to acquire global barrier 2023-02-09 12:03:33,771 DEBUG [(jenkins-hbase4.apache.org,37757,1675944211375)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-09 12:03:33,771 DEBUG [(jenkins-hbase4.apache.org,37757,1675944211375)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 12:03:33,772 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): regionserver:36449-0x10038f71d5b0001, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 12:03:33,772 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): regionserver:45749-0x10038f71d5b0002, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 12:03:33,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 12:03:33,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 12:03:33,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 12:03:33,773 DEBUG [(jenkins-hbase4.apache.org,37757,1675944211375)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37757-0x10038f71d5b0000, quorum=127.0.0.1:63427, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,45749,1675944211470 2023-02-09 12:03:33,773 DEBUG [(jenkins-hbase4.apache.org,37757,1675944211375)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 12:03:33,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 12:03:33,773 DEBUG [member: 'jenkins-hbase4.apache.org,45749,1675944211470' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-09 12:03:33,773 DEBUG [member: 'jenkins-hbase4.apache.org,45749,1675944211470' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-09 12:03:33,773 DEBUG [member: 'jenkins-hbase4.apache.org,45749,1675944211470' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,45749,1675944211470' in zk 2023-02-09 12:03:33,773 DEBUG [member: 'jenkins-hbase4.apache.org,36449,1675944211440' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-09 12:03:33,773 DEBUG [member: 'jenkins-hbase4.apache.org,36449,1675944211440' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-09 12:03:33,773 DEBUG [member: 'jenkins-hbase4.apache.org,36449,1675944211440' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,36449,1675944211440' in zk 2023-02-09 12:03:33,774 DEBUG [member: 'jenkins-hbase4.apache.org,36449,1675944211440' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-09 12:03:33,774 DEBUG [member: 'jenkins-hbase4.apache.org,36449,1675944211440' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 12:03:33,774 DEBUG [member: 'jenkins-hbase4.apache.org,36449,1675944211440' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-09 12:03:33,775 DEBUG [member: 'jenkins-hbase4.apache.org,45749,1675944211470' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-09 12:03:33,775 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): master:37757-0x10038f71d5b0000, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,45749,1675944211470 2023-02-09 12:03:33,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,45749,1675944211470 2023-02-09 12:03:33,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 12:03:33,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 12:03:33,776 DEBUG [member: 'jenkins-hbase4.apache.org,45749,1675944211470' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 12:03:33,776 DEBUG [member: 'jenkins-hbase4.apache.org,45749,1675944211470' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-09 12:03:33,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 12:03:33,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 12:03:33,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 12:03:33,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36449,1675944211440 2023-02-09 12:03:33,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45749,1675944211470 2023-02-09 12:03:33,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 12:03:33,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 12:03:33,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36449,1675944211440 2023-02-09 12:03:33,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45749,1675944211470 2023-02-09 12:03:33,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,45749,1675944211470': 2023-02-09 12:03:33,779 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45749,1675944211470' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-09 12:03:33,779 INFO [(jenkins-hbase4.apache.org,37757,1675944211375)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-09 12:03:33,779 DEBUG [(jenkins-hbase4.apache.org,37757,1675944211375)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 12:03:33,779 DEBUG [(jenkins-hbase4.apache.org,37757,1675944211375)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 12:03:33,779 DEBUG [(jenkins-hbase4.apache.org,37757,1675944211375)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-09 12:03:33,779 INFO [(jenkins-hbase4.apache.org,37757,1675944211375)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 12:03:33,782 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): regionserver:36449-0x10038f71d5b0001, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 12:03:33,782 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): regionserver:45749-0x10038f71d5b0002, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 12:03:33,782 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): regionserver:36449-0x10038f71d5b0001, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 12:03:33,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 12:03:33,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 12:03:33,782 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): master:37757-0x10038f71d5b0000, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 12:03:33,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 12:03:33,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 12:03:33,782 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): regionserver:45749-0x10038f71d5b0002, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 12:03:33,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 12:03:33,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 12:03:33,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 12:03:33,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 12:03:33,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 12:03:33,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 12:03:33,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 12:03:33,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 12:03:33,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 12:03:33,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 12:03:33,783 DEBUG [(jenkins-hbase4.apache.org,37757,1675944211375)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37757-0x10038f71d5b0000, quorum=127.0.0.1:63427, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,36449,1675944211440 2023-02-09 12:03:33,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 12:03:33,784 DEBUG [(jenkins-hbase4.apache.org,37757,1675944211375)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37757-0x10038f71d5b0000, quorum=127.0.0.1:63427, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,45749,1675944211470 2023-02-09 12:03:33,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 12:03:33,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 12:03:33,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36449,1675944211440 2023-02-09 12:03:33,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45749,1675944211470 2023-02-09 12:03:33,785 DEBUG [(jenkins-hbase4.apache.org,37757,1675944211375)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37757-0x10038f71d5b0000, quorum=127.0.0.1:63427, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,36449,1675944211440 2023-02-09 12:03:33,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 12:03:33,785 DEBUG [(jenkins-hbase4.apache.org,37757,1675944211375)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37757-0x10038f71d5b0000, quorum=127.0.0.1:63427, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,45749,1675944211470 2023-02-09 12:03:33,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 12:03:33,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36449,1675944211440 2023-02-09 12:03:33,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45749,1675944211470 2023-02-09 12:03:33,789 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): regionserver:36449-0x10038f71d5b0001, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 12:03:33,789 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): master:37757-0x10038f71d5b0000, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,45749,1675944211470 2023-02-09 12:03:33,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 12:03:33,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 12:03:33,789 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): master:37757-0x10038f71d5b0000, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 12:03:33,789 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): regionserver:45749-0x10038f71d5b0002, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 12:03:33,789 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): regionserver:45749-0x10038f71d5b0002, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 12:03:33,789 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): master:37757-0x10038f71d5b0000, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,36449,1675944211440 2023-02-09 12:03:33,790 DEBUG [(jenkins-hbase4.apache.org,37757,1675944211375)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 12:03:33,789 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): regionserver:36449-0x10038f71d5b0001, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 12:03:33,790 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): master:37757-0x10038f71d5b0000, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 12:03:33,790 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): master:37757-0x10038f71d5b0000, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,45749,1675944211470 2023-02-09 12:03:33,790 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): master:37757-0x10038f71d5b0000, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 12:03:33,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 12:03:33,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 12:03:33,790 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37757] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-09 12:03:33,790 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37757] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 12:03:33,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 12:03:33,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 12:03:33,790 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): master:37757-0x10038f71d5b0000, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,36449,1675944211440 2023-02-09 12:03:33,790 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): master:37757-0x10038f71d5b0000, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 12:03:33,790 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): master:37757-0x10038f71d5b0000, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 12:03:33,790 DEBUG [Listener at localhost/39711] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-09 12:03:33,791 DEBUG [Listener at localhost/39711] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 12:03:33,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 12:03:33,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 12:03:33,891 DEBUG [Listener at localhost/39711] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 12:03:33,891 INFO [Listener at localhost/39711] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:33,891 INFO [Listener at localhost/39711] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:33,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37757] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 12:03:33,977 DEBUG [Listener at localhost/39711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab20a21e-7e59-2c59-415a-5ed4d329d3c8/hadoop-4665004700646259730.jar 2023-02-09 12:03:33,981 INFO [Listener at localhost/39711] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1675944213243 type: FLUSH version: 2 ttl: 0 2023-02-09 12:03:33,981 DEBUG [Listener at localhost/39711] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:44979/user/jenkins/test-data/6d6b940c-b7aa-6d9b-6ce7-5cf1b35ab10b/testWithMapReduceSingleRegion/775efbcf-74e3-45e0-b644-6d03e4949dbc/data/default/testWithMapReduce 2023-02-09 12:03:33,981 INFO [Listener at localhost/39711] snapshot.RestoreSnapshotHelper(239): region to add: 229a17d98726696f52568199fafeb0c8 2023-02-09 12:03:33,982 INFO [Listener at localhost/39711] snapshot.RestoreSnapshotHelper(585): clone region=229a17d98726696f52568199fafeb0c8 as 229a17d98726696f52568199fafeb0c8 in snapshot testWithMapReduceSingleRegion 2023-02-09 12:03:33,982 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 229a17d98726696f52568199fafeb0c8, NAME => 'testWithMapReduce,,1675944212506.229a17d98726696f52568199fafeb0c8.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44979/user/jenkins/test-data/6d6b940c-b7aa-6d9b-6ce7-5cf1b35ab10b/testWithMapReduceSingleRegion/775efbcf-74e3-45e0-b644-6d03e4949dbc 2023-02-09 12:03:33,989 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675944212506.229a17d98726696f52568199fafeb0c8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:33,989 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink fbd57d76f0f646b6b8f12a5aaf27858c from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-09 12:03:33,991 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 77416d1cf491493487f4d14e413a1257 from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-09 12:03:33,993 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 229a17d98726696f52568199fafeb0c8, disabling compactions & flushes 2023-02-09 12:03:33,993 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675944212506.229a17d98726696f52568199fafeb0c8. 2023-02-09 12:03:33,993 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675944212506.229a17d98726696f52568199fafeb0c8. 2023-02-09 12:03:33,993 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675944212506.229a17d98726696f52568199fafeb0c8. after waiting 0 ms 2023-02-09 12:03:33,993 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675944212506.229a17d98726696f52568199fafeb0c8. 2023-02-09 12:03:33,993 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675944212506.229a17d98726696f52568199fafeb0c8. 2023-02-09 12:03:33,993 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 229a17d98726696f52568199fafeb0c8: Waiting for close lock at 1675944213993Disabling compacts and flushes for region at 1675944213993Disabling writes for close at 1675944213993Writing region close event to WAL at 1675944213993Closed at 1675944213993 2023-02-09 12:03:33,993 INFO [Listener at localhost/39711] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1675944213243 type: FLUSH version: 2 ttl: 0 2023-02-09 12:03:33,993 DEBUG [Listener at localhost/39711] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:44979/user/jenkins/test-data/6d6b940c-b7aa-6d9b-6ce7-5cf1b35ab10b/testWithMapReduceSingleRegion/775efbcf-74e3-45e0-b644-6d03e4949dbc 2023-02-09 12:03:33,993 DEBUG [Listener at localhost/39711] util.CommonFSUtils(682): File system contents for path hdfs://localhost:44979/user/jenkins/test-data/6d6b940c-b7aa-6d9b-6ce7-5cf1b35ab10b/testWithMapReduceSingleRegion/775efbcf-74e3-45e0-b644-6d03e4949dbc 2023-02-09 12:03:33,994 DEBUG [Listener at localhost/39711] util.CommonFSUtils(699): |-data/ 2023-02-09 12:03:33,994 DEBUG [Listener at localhost/39711] util.CommonFSUtils(699): |----default/ 2023-02-09 12:03:33,994 DEBUG [Listener at localhost/39711] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-09 12:03:33,995 DEBUG [Listener at localhost/39711] util.CommonFSUtils(699): |----------229a17d98726696f52568199fafeb0c8/ 2023-02-09 12:03:33,995 DEBUG [Listener at localhost/39711] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 12:03:33,995 DEBUG [Listener at localhost/39711] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 12:03:33,995 DEBUG [Listener at localhost/39711] util.CommonFSUtils(702): |----------------testWithMapReduce=229a17d98726696f52568199fafeb0c8-fbd57d76f0f646b6b8f12a5aaf27858c 2023-02-09 12:03:33,995 DEBUG [Listener at localhost/39711] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 12:03:33,996 DEBUG [Listener at localhost/39711] util.CommonFSUtils(702): |----------------testWithMapReduce=229a17d98726696f52568199fafeb0c8-77416d1cf491493487f4d14e413a1257 2023-02-09 12:03:33,996 DEBUG [Listener at localhost/39711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-09 12:03:33,997 DEBUG [Listener at localhost/39711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-09 12:03:33,997 DEBUG [Listener at localhost/39711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-09 12:03:33,997 DEBUG [Listener at localhost/39711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-09 12:03:33,997 DEBUG [Listener at localhost/39711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.17-SNAPSHOT.jar 2023-02-09 12:03:33,998 DEBUG [Listener at localhost/39711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-09 12:03:33,998 DEBUG [Listener at localhost/39711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-09 12:03:34,063 DEBUG [Listener at localhost/39711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab20a21e-7e59-2c59-415a-5ed4d329d3c8/hadoop-5811522052251731223.jar 2023-02-09 12:03:34,064 DEBUG [Listener at localhost/39711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-09 12:03:34,064 DEBUG [Listener at localhost/39711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-09 12:03:34,065 DEBUG [Listener at localhost/39711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-09 12:03:34,065 DEBUG [Listener at localhost/39711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-09 12:03:34,065 DEBUG [Listener at localhost/39711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-09 12:03:34,065 DEBUG [Listener at localhost/39711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-09 12:03:34,066 DEBUG [Listener at localhost/39711] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-09 12:03:34,066 DEBUG [Listener at localhost/39711] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-09 12:03:34,066 DEBUG [Listener at localhost/39711] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-09 12:03:34,067 DEBUG [Listener at localhost/39711] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-09 12:03:34,067 DEBUG [Listener at localhost/39711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-09 12:03:34,067 DEBUG [Listener at localhost/39711] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-09 12:03:34,068 DEBUG [Listener at localhost/39711] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-09 12:03:34,068 DEBUG [Listener at localhost/39711] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-09 12:03:34,068 DEBUG [Listener at localhost/39711] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-09 12:03:34,069 DEBUG [Listener at localhost/39711] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-09 12:03:34,069 DEBUG [Listener at localhost/39711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-09 12:03:34,069 DEBUG [Listener at localhost/39711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-09 12:03:34,070 DEBUG [Listener at localhost/39711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-09 12:03:34,070 DEBUG [Listener at localhost/39711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-09 12:03:34,070 DEBUG [Listener at localhost/39711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-09 12:03:34,136 DEBUG [Listener at localhost/39711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab20a21e-7e59-2c59-415a-5ed4d329d3c8/hadoop-1660214713607680749.jar 2023-02-09 12:03:34,136 DEBUG [Listener at localhost/39711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-09 12:03:34,142 WARN [Listener at localhost/39711] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-09 12:03:34,172 INFO [Listener at localhost/39711] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-09 12:03:34,252 WARN [Listener at localhost/39711] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab20a21e-7e59-2c59-415a-5ed4d329d3c8/mapreduce.cluster.local.dir/1675944214218/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-09 12:03:34,253 WARN [Listener at localhost/39711] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab20a21e-7e59-2c59-415a-5ed4d329d3c8/mapreduce.cluster.local.dir/1675944214218/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-09 12:03:34,283 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675944212506.229a17d98726696f52568199fafeb0c8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 12:03:34,284 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 12:03:34,284 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 12:03:34,286 INFO [StoreOpener-229a17d98726696f52568199fafeb0c8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 229a17d98726696f52568199fafeb0c8 2023-02-09 12:03:34,286 DEBUG [StoreOpener-229a17d98726696f52568199fafeb0c8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44979/user/jenkins/test-data/6d6b940c-b7aa-6d9b-6ce7-5cf1b35ab10b/testWithMapReduceSingleRegion/775efbcf-74e3-45e0-b644-6d03e4949dbc/data/default/testWithMapReduce/229a17d98726696f52568199fafeb0c8/f1 2023-02-09 12:03:34,287 INFO [StoreOpener-229a17d98726696f52568199fafeb0c8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 229a17d98726696f52568199fafeb0c8 columnFamilyName f1 2023-02-09 12:03:34,290 DEBUG [StoreOpener-229a17d98726696f52568199fafeb0c8-1] regionserver.HStore(539): loaded hdfs://localhost:44979/user/jenkins/test-data/6d6b940c-b7aa-6d9b-6ce7-5cf1b35ab10b/testWithMapReduceSingleRegion/775efbcf-74e3-45e0-b644-6d03e4949dbc/data/default/testWithMapReduce/229a17d98726696f52568199fafeb0c8/f1/testWithMapReduce=229a17d98726696f52568199fafeb0c8-fbd57d76f0f646b6b8f12a5aaf27858c 2023-02-09 12:03:34,290 INFO [StoreOpener-229a17d98726696f52568199fafeb0c8-1] regionserver.HStore(310): Store=229a17d98726696f52568199fafeb0c8/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:34,291 INFO [StoreOpener-229a17d98726696f52568199fafeb0c8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 229a17d98726696f52568199fafeb0c8 2023-02-09 12:03:34,291 DEBUG [StoreOpener-229a17d98726696f52568199fafeb0c8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44979/user/jenkins/test-data/6d6b940c-b7aa-6d9b-6ce7-5cf1b35ab10b/testWithMapReduceSingleRegion/775efbcf-74e3-45e0-b644-6d03e4949dbc/data/default/testWithMapReduce/229a17d98726696f52568199fafeb0c8/f2 2023-02-09 12:03:34,291 INFO [StoreOpener-229a17d98726696f52568199fafeb0c8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 229a17d98726696f52568199fafeb0c8 columnFamilyName f2 2023-02-09 12:03:34,295 DEBUG [StoreOpener-229a17d98726696f52568199fafeb0c8-1] regionserver.HStore(539): loaded hdfs://localhost:44979/user/jenkins/test-data/6d6b940c-b7aa-6d9b-6ce7-5cf1b35ab10b/testWithMapReduceSingleRegion/775efbcf-74e3-45e0-b644-6d03e4949dbc/data/default/testWithMapReduce/229a17d98726696f52568199fafeb0c8/f2/testWithMapReduce=229a17d98726696f52568199fafeb0c8-77416d1cf491493487f4d14e413a1257 2023-02-09 12:03:34,295 INFO [StoreOpener-229a17d98726696f52568199fafeb0c8-1] regionserver.HStore(310): Store=229a17d98726696f52568199fafeb0c8/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 12:03:34,296 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 12:03:34,296 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 229a17d98726696f52568199fafeb0c8; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69622350, jitterRate=0.03745386004447937}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 12:03:34,296 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 229a17d98726696f52568199fafeb0c8: Writing region info on filesystem at 1675944214284Initializing all the Stores at 1675944214285 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944214285Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675944214285Region opened successfully at 1675944214296 (+11 ms) 2023-02-09 12:03:34,418 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 229a17d98726696f52568199fafeb0c8, disabling compactions & flushes 2023-02-09 12:03:34,419 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675944212506.229a17d98726696f52568199fafeb0c8. 2023-02-09 12:03:34,419 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675944212506.229a17d98726696f52568199fafeb0c8. 2023-02-09 12:03:34,419 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675944212506.229a17d98726696f52568199fafeb0c8. after waiting 0 ms 2023-02-09 12:03:34,419 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675944212506.229a17d98726696f52568199fafeb0c8. 2023-02-09 12:03:34,419 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675944212506.229a17d98726696f52568199fafeb0c8. 2023-02-09 12:03:34,419 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 229a17d98726696f52568199fafeb0c8: Waiting for close lock at 1675944214418Disabling compacts and flushes for region at 1675944214418Disabling writes for close at 1675944214419 (+1 ms)Writing region close event to WAL at 1675944214419Closed at 1675944214419 2023-02-09 12:03:35,286 INFO [Listener at localhost/39711] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:35,286 INFO [Listener at localhost/39711] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:35,287 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37757] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMapReduceSingleRegion" 2023-02-09 12:03:35,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37757] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceSingleRegion 2023-02-09 12:03:35,290 INFO [Listener at localhost/39711] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:35,290 INFO [Listener at localhost/39711] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:35,290 INFO [Listener at localhost/39711] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-09 12:03:35,291 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37757] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-09 12:03:35,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37757] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-09 12:03:35,293 INFO [Listener at localhost/39711] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:35,293 INFO [Listener at localhost/39711] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:35,294 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675944215294"}]},"ts":"1675944215294"} 2023-02-09 12:03:35,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37757] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-09 12:03:35,295 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-09 12:03:35,297 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-09 12:03:35,297 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=229a17d98726696f52568199fafeb0c8, UNASSIGN}] 2023-02-09 12:03:35,298 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=229a17d98726696f52568199fafeb0c8, UNASSIGN 2023-02-09 12:03:35,299 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=229a17d98726696f52568199fafeb0c8, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45749,1675944211470 2023-02-09 12:03:35,299 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1675944212506.229a17d98726696f52568199fafeb0c8.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1675944215299"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675944215299"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675944215299"}]},"ts":"1675944215299"} 2023-02-09 12:03:35,300 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 229a17d98726696f52568199fafeb0c8, server=jenkins-hbase4.apache.org,45749,1675944211470}] 2023-02-09 12:03:35,394 INFO [Listener at localhost/39711] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:35,394 INFO [Listener at localhost/39711] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:35,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37757] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-09 12:03:35,452 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 229a17d98726696f52568199fafeb0c8 2023-02-09 12:03:35,452 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 229a17d98726696f52568199fafeb0c8, disabling compactions & flushes 2023-02-09 12:03:35,452 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675944212506.229a17d98726696f52568199fafeb0c8. 2023-02-09 12:03:35,452 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675944212506.229a17d98726696f52568199fafeb0c8. 2023-02-09 12:03:35,452 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675944212506.229a17d98726696f52568199fafeb0c8. after waiting 0 ms 2023-02-09 12:03:35,452 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675944212506.229a17d98726696f52568199fafeb0c8. 2023-02-09 12:03:35,455 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/data/default/testWithMapReduce/229a17d98726696f52568199fafeb0c8/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 12:03:35,456 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675944212506.229a17d98726696f52568199fafeb0c8. 2023-02-09 12:03:35,456 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 229a17d98726696f52568199fafeb0c8: Waiting for close lock at 1675944215452Running coprocessor pre-close hooks at 1675944215452Disabling compacts and flushes for region at 1675944215452Disabling writes for close at 1675944215452Writing region close event to WAL at 1675944215453 (+1 ms)Running coprocessor post-close hooks at 1675944215456 (+3 ms)Closed at 1675944215456 2023-02-09 12:03:35,457 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 229a17d98726696f52568199fafeb0c8 2023-02-09 12:03:35,457 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=229a17d98726696f52568199fafeb0c8, regionState=CLOSED 2023-02-09 12:03:35,458 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1675944212506.229a17d98726696f52568199fafeb0c8.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1675944215457"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675944215457"}]},"ts":"1675944215457"} 2023-02-09 12:03:35,460 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-09 12:03:35,460 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 229a17d98726696f52568199fafeb0c8, server=jenkins-hbase4.apache.org,45749,1675944211470 in 159 msec 2023-02-09 12:03:35,461 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-09 12:03:35,461 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=229a17d98726696f52568199fafeb0c8, UNASSIGN in 163 msec 2023-02-09 12:03:35,461 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675944215461"}]},"ts":"1675944215461"} 2023-02-09 12:03:35,462 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-09 12:03:35,464 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-09 12:03:35,465 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 173 msec 2023-02-09 12:03:35,596 INFO [Listener at localhost/39711] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:35,596 INFO [Listener at localhost/39711] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:35,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37757] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-09 12:03:35,597 INFO [Listener at localhost/39711] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 15 completed 2023-02-09 12:03:35,597 INFO [Listener at localhost/39711] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:35,597 INFO [Listener at localhost/39711] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:35,598 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37757] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testWithMapReduce 2023-02-09 12:03:35,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37757] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-09 12:03:35,601 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-09 12:03:35,601 INFO [Listener at localhost/39711] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:35,601 INFO [Listener at localhost/39711] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:35,601 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-09 12:03:35,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37757] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-09 12:03:35,604 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/.tmp/data/default/testWithMapReduce/229a17d98726696f52568199fafeb0c8 2023-02-09 12:03:35,606 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/.tmp/data/default/testWithMapReduce/229a17d98726696f52568199fafeb0c8/f1, FileablePath, hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/.tmp/data/default/testWithMapReduce/229a17d98726696f52568199fafeb0c8/f2, FileablePath, hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/.tmp/data/default/testWithMapReduce/229a17d98726696f52568199fafeb0c8/recovered.edits] 2023-02-09 12:03:35,608 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/.tmp/data/default/testWithMapReduce/229a17d98726696f52568199fafeb0c8/f1/8fa5edce0fea4920a24d1585908c5825 to hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/archive/data/default/testWithMapReduce/229a17d98726696f52568199fafeb0c8/f1/8fa5edce0fea4920a24d1585908c5825 2023-02-09 12:03:35,609 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/.tmp/data/default/testWithMapReduce/229a17d98726696f52568199fafeb0c8/f1/fbd57d76f0f646b6b8f12a5aaf27858c to hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/archive/data/default/testWithMapReduce/229a17d98726696f52568199fafeb0c8/f1/fbd57d76f0f646b6b8f12a5aaf27858c 2023-02-09 12:03:35,611 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/.tmp/data/default/testWithMapReduce/229a17d98726696f52568199fafeb0c8/f2/77416d1cf491493487f4d14e413a1257 to hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/archive/data/default/testWithMapReduce/229a17d98726696f52568199fafeb0c8/f2/77416d1cf491493487f4d14e413a1257 2023-02-09 12:03:35,612 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/.tmp/data/default/testWithMapReduce/229a17d98726696f52568199fafeb0c8/f2/7a88a730d40b436f9768c6f98c0a21d9 to hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/archive/data/default/testWithMapReduce/229a17d98726696f52568199fafeb0c8/f2/7a88a730d40b436f9768c6f98c0a21d9 2023-02-09 12:03:35,614 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/.tmp/data/default/testWithMapReduce/229a17d98726696f52568199fafeb0c8/recovered.edits/12.seqid to hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/archive/data/default/testWithMapReduce/229a17d98726696f52568199fafeb0c8/recovered.edits/12.seqid 2023-02-09 12:03:35,615 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/.tmp/data/default/testWithMapReduce/229a17d98726696f52568199fafeb0c8 2023-02-09 12:03:35,615 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-09 12:03:35,616 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-09 12:03:35,618 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMapReduce from hbase:meta 2023-02-09 12:03:35,619 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-09 12:03:35,620 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-09 12:03:35,620 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-09 12:03:35,620 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1675944212506.229a17d98726696f52568199fafeb0c8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675944215620"}]},"ts":"9223372036854775807"} 2023-02-09 12:03:35,622 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-09 12:03:35,622 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 229a17d98726696f52568199fafeb0c8, NAME => 'testWithMapReduce,,1675944212506.229a17d98726696f52568199fafeb0c8.', STARTKEY => '', ENDKEY => ''}] 2023-02-09 12:03:35,622 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-09 12:03:35,622 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1675944215622"}]},"ts":"9223372036854775807"} 2023-02-09 12:03:35,623 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-09 12:03:35,625 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-09 12:03:35,626 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 27 msec 2023-02-09 12:03:35,702 INFO [Listener at localhost/39711] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 12:03:35,702 INFO [Listener at localhost/39711] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 12:03:35,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37757] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-09 12:03:35,703 INFO [Listener at localhost/39711] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 18 completed 2023-02-09 12:03:35,704 INFO [Listener at localhost/39711] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-09 12:03:35,704 INFO [Listener at localhost/39711] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-09 12:03:35,704 DEBUG [Listener at localhost/39711] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x262aec8b to 127.0.0.1:63427 2023-02-09 12:03:35,704 DEBUG [Listener at localhost/39711] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 12:03:35,704 DEBUG [Listener at localhost/39711] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-09 12:03:35,704 DEBUG [Listener at localhost/39711] util.JVMClusterUtil(257): Found active master hash=1669774751, stopped=false 2023-02-09 12:03:35,704 INFO [Listener at localhost/39711] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,37757,1675944211375 2023-02-09 12:03:35,706 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): master:37757-0x10038f71d5b0000, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 12:03:35,706 INFO [Listener at localhost/39711] procedure2.ProcedureExecutor(629): Stopping 2023-02-09 12:03:35,706 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): regionserver:36449-0x10038f71d5b0001, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 12:03:35,706 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): master:37757-0x10038f71d5b0000, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 12:03:35,706 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): regionserver:45749-0x10038f71d5b0002, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 12:03:35,707 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37757-0x10038f71d5b0000, quorum=127.0.0.1:63427, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 12:03:35,708 DEBUG [Listener at localhost/39711] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7d8f37b9 to 127.0.0.1:63427 2023-02-09 12:03:35,708 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45749-0x10038f71d5b0002, quorum=127.0.0.1:63427, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 12:03:35,708 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36449-0x10038f71d5b0001, quorum=127.0.0.1:63427, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 12:03:35,708 DEBUG [Listener at localhost/39711] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 12:03:35,708 INFO [Listener at localhost/39711] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,36449,1675944211440' ***** 2023-02-09 12:03:35,708 INFO [Listener at localhost/39711] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-09 12:03:35,708 INFO [Listener at localhost/39711] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,45749,1675944211470' ***** 2023-02-09 12:03:35,708 INFO [Listener at localhost/39711] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-09 12:03:35,708 INFO [RS:0;jenkins-hbase4:36449] regionserver.HeapMemoryManager(220): Stopping 2023-02-09 12:03:35,708 INFO [RS:1;jenkins-hbase4:45749] regionserver.HeapMemoryManager(220): Stopping 2023-02-09 12:03:35,709 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-09 12:03:35,709 INFO [RS:1;jenkins-hbase4:45749] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-09 12:03:35,709 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-09 12:03:35,709 INFO [RS:0;jenkins-hbase4:36449] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-09 12:03:35,710 INFO [RS:1;jenkins-hbase4:45749] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-09 12:03:35,711 INFO [RS:1;jenkins-hbase4:45749] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,45749,1675944211470 2023-02-09 12:03:35,711 DEBUG [RS:1;jenkins-hbase4:45749] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0eb1d6e8 to 127.0.0.1:63427 2023-02-09 12:03:35,711 DEBUG [RS:1;jenkins-hbase4:45749] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 12:03:35,711 INFO [RS:1;jenkins-hbase4:45749] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-09 12:03:35,711 INFO [RS:1;jenkins-hbase4:45749] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-09 12:03:35,711 INFO [RS:1;jenkins-hbase4:45749] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-09 12:03:35,711 INFO [RS:1;jenkins-hbase4:45749] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-09 12:03:35,710 INFO [RS:0;jenkins-hbase4:36449] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-09 12:03:35,711 INFO [RS:1;jenkins-hbase4:45749] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-09 12:03:35,711 INFO [RS:0;jenkins-hbase4:36449] regionserver.HRegionServer(3304): Received CLOSE for 6a5818b67b368e114b0f9c6ad1f607a6 2023-02-09 12:03:35,711 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-09 12:03:35,711 DEBUG [RS:1;jenkins-hbase4:45749] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-09 12:03:35,711 INFO [RS:0;jenkins-hbase4:36449] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,36449,1675944211440 2023-02-09 12:03:35,711 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-09 12:03:35,711 DEBUG [RS:0;jenkins-hbase4:36449] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4520eb80 to 127.0.0.1:63427 2023-02-09 12:03:35,711 DEBUG [RS:1;jenkins-hbase4:45749] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-09 12:03:35,711 DEBUG [RS:0;jenkins-hbase4:36449] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 12:03:35,711 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 6a5818b67b368e114b0f9c6ad1f607a6, disabling compactions & flushes 2023-02-09 12:03:35,711 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-09 12:03:35,712 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675944212010.6a5818b67b368e114b0f9c6ad1f607a6. 2023-02-09 12:03:35,712 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-09 12:03:35,712 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-09 12:03:35,711 INFO [RS:0;jenkins-hbase4:36449] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-09 12:03:35,712 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=3.70 KB heapSize=7.12 KB 2023-02-09 12:03:35,712 DEBUG [RS:0;jenkins-hbase4:36449] regionserver.HRegionServer(1479): Online Regions={6a5818b67b368e114b0f9c6ad1f607a6=hbase:namespace,,1675944212010.6a5818b67b368e114b0f9c6ad1f607a6.} 2023-02-09 12:03:35,712 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675944212010.6a5818b67b368e114b0f9c6ad1f607a6. 2023-02-09 12:03:35,712 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675944212010.6a5818b67b368e114b0f9c6ad1f607a6. after waiting 0 ms 2023-02-09 12:03:35,712 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675944212010.6a5818b67b368e114b0f9c6ad1f607a6. 2023-02-09 12:03:35,712 DEBUG [RS:0;jenkins-hbase4:36449] regionserver.HRegionServer(1505): Waiting on 6a5818b67b368e114b0f9c6ad1f607a6 2023-02-09 12:03:35,712 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 6a5818b67b368e114b0f9c6ad1f607a6 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-09 12:03:35,719 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/data/hbase/namespace/6a5818b67b368e114b0f9c6ad1f607a6/.tmp/info/06922b92d6bb4742b589594f221d22fb 2023-02-09 12:03:35,720 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.19 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/data/hbase/meta/1588230740/.tmp/info/1f0c09d5c99f47cdb7e64638cdcf0caf 2023-02-09 12:03:35,724 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/data/hbase/namespace/6a5818b67b368e114b0f9c6ad1f607a6/.tmp/info/06922b92d6bb4742b589594f221d22fb as hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/data/hbase/namespace/6a5818b67b368e114b0f9c6ad1f607a6/info/06922b92d6bb4742b589594f221d22fb 2023-02-09 12:03:35,724 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1f0c09d5c99f47cdb7e64638cdcf0caf 2023-02-09 12:03:35,727 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/data/hbase/namespace/6a5818b67b368e114b0f9c6ad1f607a6/info/06922b92d6bb4742b589594f221d22fb, entries=2, sequenceid=6, filesize=4.8 K 2023-02-09 12:03:35,727 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 6a5818b67b368e114b0f9c6ad1f607a6 in 15ms, sequenceid=6, compaction requested=false 2023-02-09 12:03:35,730 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/data/hbase/namespace/6a5818b67b368e114b0f9c6ad1f607a6/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-09 12:03:35,731 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675944212010.6a5818b67b368e114b0f9c6ad1f607a6. 2023-02-09 12:03:35,731 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 6a5818b67b368e114b0f9c6ad1f607a6: Waiting for close lock at 1675944215711Running coprocessor pre-close hooks at 1675944215711Disabling compacts and flushes for region at 1675944215711Disabling writes for close at 1675944215712 (+1 ms)Obtaining lock to block concurrent updates at 1675944215712Preparing flush snapshotting stores in 6a5818b67b368e114b0f9c6ad1f607a6 at 1675944215712Finished memstore snapshotting hbase:namespace,,1675944212010.6a5818b67b368e114b0f9c6ad1f607a6., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1675944215712Flushing stores of hbase:namespace,,1675944212010.6a5818b67b368e114b0f9c6ad1f607a6. at 1675944215712Flushing 6a5818b67b368e114b0f9c6ad1f607a6/info: creating writer at 1675944215712Flushing 6a5818b67b368e114b0f9c6ad1f607a6/info: appending metadata at 1675944215714 (+2 ms)Flushing 6a5818b67b368e114b0f9c6ad1f607a6/info: closing flushed file at 1675944215714Flushing 6a5818b67b368e114b0f9c6ad1f607a6/info: reopening flushed file at 1675944215724 (+10 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 6a5818b67b368e114b0f9c6ad1f607a6 in 15ms, sequenceid=6, compaction requested=false at 1675944215727 (+3 ms)Writing region close event to WAL at 1675944215728 (+1 ms)Running coprocessor post-close hooks at 1675944215731 (+3 ms)Closed at 1675944215731 2023-02-09 12:03:35,731 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=97 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/data/hbase/meta/1588230740/.tmp/rep_barrier/ada6b9a8e8b14af7ab424442794fcc70 2023-02-09 12:03:35,731 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1675944212010.6a5818b67b368e114b0f9c6ad1f607a6. 2023-02-09 12:03:35,734 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ada6b9a8e8b14af7ab424442794fcc70 2023-02-09 12:03:35,740 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=428 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/data/hbase/meta/1588230740/.tmp/table/e83db080ca8c40cf8cc066c8a8942a33 2023-02-09 12:03:35,743 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e83db080ca8c40cf8cc066c8a8942a33 2023-02-09 12:03:35,744 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/data/hbase/meta/1588230740/.tmp/info/1f0c09d5c99f47cdb7e64638cdcf0caf as hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/data/hbase/meta/1588230740/info/1f0c09d5c99f47cdb7e64638cdcf0caf 2023-02-09 12:03:35,747 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1f0c09d5c99f47cdb7e64638cdcf0caf 2023-02-09 12:03:35,747 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/data/hbase/meta/1588230740/info/1f0c09d5c99f47cdb7e64638cdcf0caf, entries=12, sequenceid=21, filesize=6.2 K 2023-02-09 12:03:35,747 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/data/hbase/meta/1588230740/.tmp/rep_barrier/ada6b9a8e8b14af7ab424442794fcc70 as hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/data/hbase/meta/1588230740/rep_barrier/ada6b9a8e8b14af7ab424442794fcc70 2023-02-09 12:03:35,750 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ada6b9a8e8b14af7ab424442794fcc70 2023-02-09 12:03:35,751 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/data/hbase/meta/1588230740/rep_barrier/ada6b9a8e8b14af7ab424442794fcc70, entries=1, sequenceid=21, filesize=5.0 K 2023-02-09 12:03:35,751 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/data/hbase/meta/1588230740/.tmp/table/e83db080ca8c40cf8cc066c8a8942a33 as hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/data/hbase/meta/1588230740/table/e83db080ca8c40cf8cc066c8a8942a33 2023-02-09 12:03:35,754 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e83db080ca8c40cf8cc066c8a8942a33 2023-02-09 12:03:35,754 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/data/hbase/meta/1588230740/table/e83db080ca8c40cf8cc066c8a8942a33, entries=4, sequenceid=21, filesize=5.0 K 2023-02-09 12:03:35,755 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~3.70 KB/3789, heapSize ~7.07 KB/7240, currentSize=0 B/0 for 1588230740 in 43ms, sequenceid=21, compaction requested=false 2023-02-09 12:03:35,758 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-09 12:03:35,758 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-09 12:03:35,759 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-09 12:03:35,759 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675944215711Running coprocessor pre-close hooks at 1675944215711Disabling compacts and flushes for region at 1675944215711Disabling writes for close at 1675944215712 (+1 ms)Obtaining lock to block concurrent updates at 1675944215712Preparing flush snapshotting stores in 1588230740 at 1675944215712Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=3789, getHeapSize=7240, getOffHeapSize=0, getCellsCount=36 at 1675944215712Flushing stores of hbase:meta,,1.1588230740 at 1675944215712Flushing 1588230740/info: creating writer at 1675944215712Flushing 1588230740/info: appending metadata at 1675944215714 (+2 ms)Flushing 1588230740/info: closing flushed file at 1675944215714Flushing 1588230740/rep_barrier: creating writer at 1675944215724 (+10 ms)Flushing 1588230740/rep_barrier: appending metadata at 1675944215726 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1675944215726Flushing 1588230740/table: creating writer at 1675944215734 (+8 ms)Flushing 1588230740/table: appending metadata at 1675944215736 (+2 ms)Flushing 1588230740/table: closing flushed file at 1675944215736Flushing 1588230740/info: reopening flushed file at 1675944215744 (+8 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1675944215748 (+4 ms)Flushing 1588230740/table: reopening flushed file at 1675944215752 (+4 ms)Finished flush of dataSize ~3.70 KB/3789, heapSize ~7.07 KB/7240, currentSize=0 B/0 for 1588230740 in 43ms, sequenceid=21, compaction requested=false at 1675944215755 (+3 ms)Writing region close event to WAL at 1675944215756 (+1 ms)Running coprocessor post-close hooks at 1675944215758 (+2 ms)Closed at 1675944215759 (+1 ms) 2023-02-09 12:03:35,759 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-09 12:03:35,760 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-09 12:03:35,761 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-09 12:03:35,794 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-09 12:03:35,795 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-09 12:03:35,822 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-09 12:03:35,822 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-09 12:03:35,911 INFO [RS:1;jenkins-hbase4:45749] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,45749,1675944211470; all regions closed. 2023-02-09 12:03:35,912 INFO [RS:0;jenkins-hbase4:36449] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,36449,1675944211440; all regions closed. 2023-02-09 12:03:35,918 DEBUG [RS:1;jenkins-hbase4:45749] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/oldWALs 2023-02-09 12:03:35,918 DEBUG [RS:0;jenkins-hbase4:36449] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/oldWALs 2023-02-09 12:03:35,918 INFO [RS:1;jenkins-hbase4:45749] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45749%2C1675944211470.meta:.meta(num 1675944211959) 2023-02-09 12:03:35,919 INFO [RS:0;jenkins-hbase4:36449] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36449%2C1675944211440:(num 1675944212368) 2023-02-09 12:03:35,919 DEBUG [RS:0;jenkins-hbase4:36449] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 12:03:35,919 INFO [RS:0;jenkins-hbase4:36449] regionserver.LeaseManager(133): Closed leases 2023-02-09 12:03:35,919 INFO [RS:0;jenkins-hbase4:36449] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-09 12:03:35,919 INFO [RS:0;jenkins-hbase4:36449] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-09 12:03:35,919 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 12:03:35,919 INFO [RS:0;jenkins-hbase4:36449] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-09 12:03:35,919 INFO [RS:0;jenkins-hbase4:36449] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-09 12:03:35,920 INFO [RS:0;jenkins-hbase4:36449] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36449 2023-02-09 12:03:35,922 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): regionserver:36449-0x10038f71d5b0001, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36449,1675944211440 2023-02-09 12:03:35,922 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): master:37757-0x10038f71d5b0000, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 12:03:35,922 ERROR [Listener at localhost/39711-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@320f2134 rejected from java.util.concurrent.ThreadPoolExecutor@3630b3ad[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 12:03:35,922 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): regionserver:36449-0x10038f71d5b0001, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 12:03:35,922 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): regionserver:45749-0x10038f71d5b0002, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36449,1675944211440 2023-02-09 12:03:35,923 ERROR [Listener at localhost/39711-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@9460b84 rejected from java.util.concurrent.ThreadPoolExecutor@3630b3ad[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 12:03:35,923 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): regionserver:45749-0x10038f71d5b0002, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 12:03:35,923 DEBUG [RS:1;jenkins-hbase4:45749] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/oldWALs 2023-02-09 12:03:35,923 INFO [RS:1;jenkins-hbase4:45749] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45749%2C1675944211470:(num 1675944212787) 2023-02-09 12:03:35,923 DEBUG [RS:1;jenkins-hbase4:45749] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 12:03:35,923 INFO [RS:1;jenkins-hbase4:45749] regionserver.LeaseManager(133): Closed leases 2023-02-09 12:03:35,923 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,36449,1675944211440] 2023-02-09 12:03:35,923 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,36449,1675944211440; numProcessing=1 2023-02-09 12:03:35,923 INFO [RS:1;jenkins-hbase4:45749] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-09 12:03:35,924 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 12:03:35,927 INFO [RS:1;jenkins-hbase4:45749] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45749 2023-02-09 12:03:35,927 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,36449,1675944211440 already deleted, retry=false 2023-02-09 12:03:35,927 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,36449,1675944211440 expired; onlineServers=1 2023-02-09 12:03:35,928 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): master:37757-0x10038f71d5b0000, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 12:03:35,928 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): regionserver:45749-0x10038f71d5b0002, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45749,1675944211470 2023-02-09 12:03:35,928 ERROR [Listener at localhost/39711-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7028b64a rejected from java.util.concurrent.ThreadPoolExecutor@74173c97[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 12:03:35,928 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,45749,1675944211470] 2023-02-09 12:03:35,928 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,45749,1675944211470; numProcessing=2 2023-02-09 12:03:35,930 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,45749,1675944211470 already deleted, retry=false 2023-02-09 12:03:35,930 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,45749,1675944211470 expired; onlineServers=0 2023-02-09 12:03:35,930 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,37757,1675944211375' ***** 2023-02-09 12:03:35,930 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-09 12:03:35,931 DEBUG [M:0;jenkins-hbase4:37757] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@67b92537, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 12:03:35,931 INFO [M:0;jenkins-hbase4:37757] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,37757,1675944211375 2023-02-09 12:03:35,931 INFO [M:0;jenkins-hbase4:37757] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,37757,1675944211375; all regions closed. 2023-02-09 12:03:35,931 DEBUG [M:0;jenkins-hbase4:37757] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 12:03:35,931 DEBUG [M:0;jenkins-hbase4:37757] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-09 12:03:35,931 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-09 12:03:35,931 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675944211611] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675944211611,5,FailOnTimeoutGroup] 2023-02-09 12:03:35,931 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675944211612] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675944211612,5,FailOnTimeoutGroup] 2023-02-09 12:03:35,931 DEBUG [M:0;jenkins-hbase4:37757] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-09 12:03:35,933 INFO [M:0;jenkins-hbase4:37757] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-09 12:03:35,933 INFO [M:0;jenkins-hbase4:37757] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-09 12:03:35,933 INFO [M:0;jenkins-hbase4:37757] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-09 12:03:35,933 DEBUG [M:0;jenkins-hbase4:37757] master.HMaster(1502): Stopping service threads 2023-02-09 12:03:35,933 INFO [M:0;jenkins-hbase4:37757] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-09 12:03:35,933 ERROR [M:0;jenkins-hbase4:37757] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-09 12:03:35,933 INFO [M:0;jenkins-hbase4:37757] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-09 12:03:35,933 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): master:37757-0x10038f71d5b0000, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-09 12:03:35,933 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-09 12:03:35,933 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): master:37757-0x10038f71d5b0000, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 12:03:35,934 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37757-0x10038f71d5b0000, quorum=127.0.0.1:63427, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 12:03:35,934 DEBUG [M:0;jenkins-hbase4:37757] zookeeper.ZKUtil(398): master:37757-0x10038f71d5b0000, quorum=127.0.0.1:63427, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-09 12:03:35,934 WARN [M:0;jenkins-hbase4:37757] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-09 12:03:35,934 INFO [M:0;jenkins-hbase4:37757] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-09 12:03:35,934 INFO [M:0;jenkins-hbase4:37757] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-09 12:03:35,935 DEBUG [M:0;jenkins-hbase4:37757] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-09 12:03:35,935 INFO [M:0;jenkins-hbase4:37757] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 12:03:35,935 DEBUG [M:0;jenkins-hbase4:37757] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 12:03:35,935 DEBUG [M:0;jenkins-hbase4:37757] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-09 12:03:35,935 DEBUG [M:0;jenkins-hbase4:37757] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 12:03:35,935 INFO [M:0;jenkins-hbase4:37757] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=54.67 KB heapSize=65.63 KB 2023-02-09 12:03:35,942 INFO [M:0;jenkins-hbase4:37757] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=54.67 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/65a9d1fbc7cf4c02a75c0de569fd6bc2 2023-02-09 12:03:35,946 DEBUG [M:0;jenkins-hbase4:37757] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/65a9d1fbc7cf4c02a75c0de569fd6bc2 as hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/65a9d1fbc7cf4c02a75c0de569fd6bc2 2023-02-09 12:03:35,950 INFO [M:0;jenkins-hbase4:37757] regionserver.HStore(1080): Added hdfs://localhost:44979/user/jenkins/test-data/bd58708f-eec3-dd64-77b3-de3d44f81384/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/65a9d1fbc7cf4c02a75c0de569fd6bc2, entries=17, sequenceid=132, filesize=8.6 K 2023-02-09 12:03:35,950 INFO [M:0;jenkins-hbase4:37757] regionserver.HRegion(2947): Finished flush of dataSize ~54.67 KB/55987, heapSize ~65.61 KB/67184, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 15ms, sequenceid=132, compaction requested=false 2023-02-09 12:03:35,951 INFO [M:0;jenkins-hbase4:37757] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 12:03:35,951 DEBUG [M:0;jenkins-hbase4:37757] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675944215935Disabling compacts and flushes for region at 1675944215935Disabling writes for close at 1675944215935Obtaining lock to block concurrent updates at 1675944215935Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1675944215935Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=55987, getHeapSize=67184, getOffHeapSize=0, getCellsCount=145 at 1675944215935Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1675944215936 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1675944215936Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1675944215937 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1675944215938 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1675944215947 (+9 ms)Finished flush of dataSize ~54.67 KB/55987, heapSize ~65.61 KB/67184, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 15ms, sequenceid=132, compaction requested=false at 1675944215950 (+3 ms)Writing region close event to WAL at 1675944215951 (+1 ms)Closed at 1675944215951 2023-02-09 12:03:35,953 INFO [M:0;jenkins-hbase4:37757] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-09 12:03:35,953 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 12:03:35,953 INFO [M:0;jenkins-hbase4:37757] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37757 2023-02-09 12:03:35,955 DEBUG [M:0;jenkins-hbase4:37757] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,37757,1675944211375 already deleted, retry=false 2023-02-09 12:03:36,207 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): master:37757-0x10038f71d5b0000, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 12:03:36,207 INFO [M:0;jenkins-hbase4:37757] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,37757,1675944211375; zookeeper connection closed. 2023-02-09 12:03:36,207 ERROR [Listener at localhost/39711-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@594e7d31 rejected from java.util.concurrent.ThreadPoolExecutor@5d71f2c0[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 12:03:36,208 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): master:37757-0x10038f71d5b0000, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 12:03:36,208 ERROR [Listener at localhost/39711-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3ac29ad rejected from java.util.concurrent.ThreadPoolExecutor@5d71f2c0[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 12:03:36,307 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): regionserver:45749-0x10038f71d5b0002, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 12:03:36,307 INFO [RS:1;jenkins-hbase4:45749] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,45749,1675944211470; zookeeper connection closed. 2023-02-09 12:03:36,307 ERROR [Listener at localhost/39711-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@35c185db rejected from java.util.concurrent.ThreadPoolExecutor@74173c97[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 12:03:36,307 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): regionserver:45749-0x10038f71d5b0002, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 12:03:36,307 ERROR [Listener at localhost/39711-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4d5088d1 rejected from java.util.concurrent.ThreadPoolExecutor@74173c97[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 12:03:36,308 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@55ba29d1] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@55ba29d1 2023-02-09 12:03:36,407 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): regionserver:36449-0x10038f71d5b0001, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 12:03:36,407 INFO [RS:0;jenkins-hbase4:36449] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,36449,1675944211440; zookeeper connection closed. 2023-02-09 12:03:36,408 ERROR [Listener at localhost/39711-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7115e33e rejected from java.util.concurrent.ThreadPoolExecutor@3630b3ad[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 12:03:36,408 DEBUG [Listener at localhost/39711-EventThread] zookeeper.ZKWatcher(600): regionserver:36449-0x10038f71d5b0001, quorum=127.0.0.1:63427, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 12:03:36,408 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@682fea8a] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@682fea8a 2023-02-09 12:03:36,408 ERROR [Listener at localhost/39711-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2abee78c rejected from java.util.concurrent.ThreadPoolExecutor@3630b3ad[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 12:03:36,408 INFO [Listener at localhost/39711] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-09 12:03:36,408 WARN [Listener at localhost/39711] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-09 12:03:36,412 INFO [Listener at localhost/39711] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 12:03:36,517 WARN [BP-1605604850-172.31.14.131-1675944210817 heartbeating to localhost/127.0.0.1:44979] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-09 12:03:36,517 WARN [BP-1605604850-172.31.14.131-1675944210817 heartbeating to localhost/127.0.0.1:44979] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1605604850-172.31.14.131-1675944210817 (Datanode Uuid 0cf42f62-b49c-4fcd-bee7-89110a6cd2c9) service to localhost/127.0.0.1:44979 2023-02-09 12:03:36,518 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab20a21e-7e59-2c59-415a-5ed4d329d3c8/cluster_113a50a1-eed1-6bd7-c38b-e345bf4940eb/dfs/data/data3/current/BP-1605604850-172.31.14.131-1675944210817] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 12:03:36,518 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab20a21e-7e59-2c59-415a-5ed4d329d3c8/cluster_113a50a1-eed1-6bd7-c38b-e345bf4940eb/dfs/data/data4/current/BP-1605604850-172.31.14.131-1675944210817] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 12:03:36,519 WARN [Listener at localhost/39711] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-09 12:03:36,522 INFO [Listener at localhost/39711] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 12:03:36,623 WARN [BP-1605604850-172.31.14.131-1675944210817 heartbeating to localhost/127.0.0.1:44979] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-09 12:03:36,623 WARN [BP-1605604850-172.31.14.131-1675944210817 heartbeating to localhost/127.0.0.1:44979] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1605604850-172.31.14.131-1675944210817 (Datanode Uuid fcadec84-a2f1-4aa3-a481-0a57c91f4ee9) service to localhost/127.0.0.1:44979 2023-02-09 12:03:36,624 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab20a21e-7e59-2c59-415a-5ed4d329d3c8/cluster_113a50a1-eed1-6bd7-c38b-e345bf4940eb/dfs/data/data1/current/BP-1605604850-172.31.14.131-1675944210817] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 12:03:36,624 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab20a21e-7e59-2c59-415a-5ed4d329d3c8/cluster_113a50a1-eed1-6bd7-c38b-e345bf4940eb/dfs/data/data2/current/BP-1605604850-172.31.14.131-1675944210817] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 12:03:36,635 INFO [Listener at localhost/39711] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 12:03:36,748 INFO [Listener at localhost/39711] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-09 12:03:36,769 INFO [Listener at localhost/39711] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-09 12:03:36,782 INFO [Listener at localhost/39711] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=296 (was 276) Potentially hanging thread: RS-EventLoopGroup-23-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.13@localhost:44979 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/39711 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,37757,1675944211375)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:44979 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:44979 from jenkins.hfs.13 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-22-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:44979 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:44979 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins.hfs.12@localhost:44979 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:44979 from jenkins.hfs.12 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-28-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=607 (was 577) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=339 (was 336) - SystemLoadAverage LEAK? -, ProcessCount=166 (was 166), AvailableMemoryMB=3160 (was 3186)