2023-02-17 02:00:59,957 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat timeout: 13 mins 2023-02-17 02:01:00,052 INFO [Time-limited test] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=7, OpenFileDescriptor=240, MaxFileDescriptor=60000, SystemLoadAverage=221, ProcessCount=167, AvailableMemoryMB=9663 2023-02-17 02:01:00,356 DEBUG [Time-limited test] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9fcbabae-fa27-eae4-5e88-a8a591b6719e 2023-02-17 02:01:00,364 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-17 02:01:00,364 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9fcbabae-fa27-eae4-5e88-a8a591b6719e/cluster_8d6fc572-0034-0c6e-550f-84d1b147065c, deleteOnExit=true 2023-02-17 02:01:00,365 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-17 02:01:00,365 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9fcbabae-fa27-eae4-5e88-a8a591b6719e/test.cache.data in system properties and HBase conf 2023-02-17 02:01:00,365 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9fcbabae-fa27-eae4-5e88-a8a591b6719e/hadoop.tmp.dir in system properties and HBase conf 2023-02-17 02:01:00,366 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9fcbabae-fa27-eae4-5e88-a8a591b6719e/hadoop.log.dir in system properties and HBase conf 2023-02-17 02:01:00,366 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9fcbabae-fa27-eae4-5e88-a8a591b6719e/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-17 02:01:00,367 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9fcbabae-fa27-eae4-5e88-a8a591b6719e/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-17 02:01:00,367 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-17 02:01:00,477 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-02-17 02:01:00,890 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-17 02:01:00,896 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9fcbabae-fa27-eae4-5e88-a8a591b6719e/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-17 02:01:00,896 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9fcbabae-fa27-eae4-5e88-a8a591b6719e/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-17 02:01:00,896 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9fcbabae-fa27-eae4-5e88-a8a591b6719e/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-17 02:01:00,897 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9fcbabae-fa27-eae4-5e88-a8a591b6719e/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-17 02:01:00,897 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9fcbabae-fa27-eae4-5e88-a8a591b6719e/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-17 02:01:00,897 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9fcbabae-fa27-eae4-5e88-a8a591b6719e/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-17 02:01:00,897 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9fcbabae-fa27-eae4-5e88-a8a591b6719e/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-17 02:01:00,898 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9fcbabae-fa27-eae4-5e88-a8a591b6719e/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-17 02:01:00,898 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9fcbabae-fa27-eae4-5e88-a8a591b6719e/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-17 02:01:00,899 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9fcbabae-fa27-eae4-5e88-a8a591b6719e/nfs.dump.dir in system properties and HBase conf 2023-02-17 02:01:00,899 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9fcbabae-fa27-eae4-5e88-a8a591b6719e/java.io.tmpdir in system properties and HBase conf 2023-02-17 02:01:00,900 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9fcbabae-fa27-eae4-5e88-a8a591b6719e/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-17 02:01:00,900 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9fcbabae-fa27-eae4-5e88-a8a591b6719e/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-17 02:01:00,901 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9fcbabae-fa27-eae4-5e88-a8a591b6719e/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-17 02:01:01,456 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-17 02:01:01,461 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-17 02:01:01,805 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-02-17 02:01:02,001 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-02-17 02:01:02,016 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-17 02:01:02,072 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-02-17 02:01:02,121 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9fcbabae-fa27-eae4-5e88-a8a591b6719e/java.io.tmpdir/Jetty_localhost_38539_hdfs____.5q9qbk/webapp 2023-02-17 02:01:02,279 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38539 2023-02-17 02:01:02,320 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-17 02:01:02,320 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-17 02:01:02,837 WARN [Listener at localhost/44409] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-17 02:01:02,936 WARN [Listener at localhost/44409] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-17 02:01:02,961 WARN [Listener at localhost/44409] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-17 02:01:02,968 INFO [Listener at localhost/44409] log.Slf4jLog(67): jetty-6.1.26 2023-02-17 02:01:02,976 INFO [Listener at localhost/44409] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9fcbabae-fa27-eae4-5e88-a8a591b6719e/java.io.tmpdir/Jetty_localhost_36261_datanode____5z407l/webapp 2023-02-17 02:01:03,137 INFO [Listener at localhost/44409] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36261 2023-02-17 02:01:03,587 WARN [Listener at localhost/38757] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-17 02:01:03,618 WARN [Listener at localhost/38757] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-17 02:01:03,624 WARN [Listener at localhost/38757] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-17 02:01:03,626 INFO [Listener at localhost/38757] log.Slf4jLog(67): jetty-6.1.26 2023-02-17 02:01:03,634 INFO [Listener at localhost/38757] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9fcbabae-fa27-eae4-5e88-a8a591b6719e/java.io.tmpdir/Jetty_localhost_35389_datanode____.g6ubev/webapp 2023-02-17 02:01:03,781 INFO [Listener at localhost/38757] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35389 2023-02-17 02:01:03,812 WARN [Listener at localhost/39237] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-17 02:01:04,182 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xbebc0e857b28ebbd: Processing first storage report for DS-5b553e7b-7672-4a45-9385-415722c5ae2a from datanode 4551252e-02fd-4a4f-af1f-94b7e0b17be8 2023-02-17 02:01:04,185 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xbebc0e857b28ebbd: from storage DS-5b553e7b-7672-4a45-9385-415722c5ae2a node DatanodeRegistration(127.0.0.1:39139, datanodeUuid=4551252e-02fd-4a4f-af1f-94b7e0b17be8, infoPort=37589, infoSecurePort=0, ipcPort=39237, storageInfo=lv=-57;cid=testClusterID;nsid=1491308107;c=1676599261545), blocks: 0, hasStaleStorage: true, processing time: 3 msecs, invalidatedBlocks: 0 2023-02-17 02:01:04,185 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x162dd3c9f8efa2fa: Processing first storage report for DS-49dec235-5df7-4b2a-bb64-1ac499932450 from datanode 3179bd2f-5480-4f6e-914b-5af32208deb3 2023-02-17 02:01:04,185 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x162dd3c9f8efa2fa: from storage DS-49dec235-5df7-4b2a-bb64-1ac499932450 node DatanodeRegistration(127.0.0.1:38021, datanodeUuid=3179bd2f-5480-4f6e-914b-5af32208deb3, infoPort=35537, infoSecurePort=0, ipcPort=38757, storageInfo=lv=-57;cid=testClusterID;nsid=1491308107;c=1676599261545), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-17 02:01:04,186 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xbebc0e857b28ebbd: Processing first storage report for DS-2877457d-b6d8-4d13-844a-5375e8e826b5 from datanode 4551252e-02fd-4a4f-af1f-94b7e0b17be8 2023-02-17 02:01:04,186 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xbebc0e857b28ebbd: from storage DS-2877457d-b6d8-4d13-844a-5375e8e826b5 node DatanodeRegistration(127.0.0.1:39139, datanodeUuid=4551252e-02fd-4a4f-af1f-94b7e0b17be8, infoPort=37589, infoSecurePort=0, ipcPort=39237, storageInfo=lv=-57;cid=testClusterID;nsid=1491308107;c=1676599261545), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-17 02:01:04,186 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x162dd3c9f8efa2fa: Processing first storage report for DS-be1bdd07-cbef-45ac-935c-3021b2c94e47 from datanode 3179bd2f-5480-4f6e-914b-5af32208deb3 2023-02-17 02:01:04,186 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x162dd3c9f8efa2fa: from storage DS-be1bdd07-cbef-45ac-935c-3021b2c94e47 node DatanodeRegistration(127.0.0.1:38021, datanodeUuid=3179bd2f-5480-4f6e-914b-5af32208deb3, infoPort=35537, infoSecurePort=0, ipcPort=38757, storageInfo=lv=-57;cid=testClusterID;nsid=1491308107;c=1676599261545), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-17 02:01:04,319 DEBUG [Listener at localhost/39237] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9fcbabae-fa27-eae4-5e88-a8a591b6719e 2023-02-17 02:01:04,425 INFO [Listener at localhost/39237] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9fcbabae-fa27-eae4-5e88-a8a591b6719e/cluster_8d6fc572-0034-0c6e-550f-84d1b147065c/zookeeper_0, clientPort=50037, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9fcbabae-fa27-eae4-5e88-a8a591b6719e/cluster_8d6fc572-0034-0c6e-550f-84d1b147065c/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9fcbabae-fa27-eae4-5e88-a8a591b6719e/cluster_8d6fc572-0034-0c6e-550f-84d1b147065c/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-17 02:01:04,444 INFO [Listener at localhost/39237] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=50037 2023-02-17 02:01:04,452 INFO [Listener at localhost/39237] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 02:01:04,455 INFO [Listener at localhost/39237] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 02:01:05,200 INFO [Listener at localhost/39237] util.FSUtils(479): Created version file at hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590 with version=8 2023-02-17 02:01:05,201 INFO [Listener at localhost/39237] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 02:01:05,202 INFO [Listener at localhost/39237] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 02:01:05,206 INFO [Listener at localhost/39237] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:44409/user/jenkins/test-data/e4a43e2c-5578-9e5b-3d88-cc8c20ec254e/hbase-staging 2023-02-17 02:01:05,545 INFO [Listener at localhost/39237] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-02-17 02:01:06,017 INFO [Listener at localhost/39237] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-17 02:01:06,051 INFO [Listener at localhost/39237] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 02:01:06,051 INFO [Listener at localhost/39237] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-17 02:01:06,052 INFO [Listener at localhost/39237] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-17 02:01:06,052 INFO [Listener at localhost/39237] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 02:01:06,052 INFO [Listener at localhost/39237] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-17 02:01:06,200 INFO [Listener at localhost/39237] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-17 02:01:06,276 DEBUG [Listener at localhost/39237] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-02-17 02:01:06,371 INFO [Listener at localhost/39237] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39477 2023-02-17 02:01:06,382 INFO [Listener at localhost/39237] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 02:01:06,385 INFO [Listener at localhost/39237] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 02:01:06,409 INFO [Listener at localhost/39237] zookeeper.RecoverableZooKeeper(93): Process identifier=master:39477 connecting to ZooKeeper ensemble=127.0.0.1:50037 2023-02-17 02:01:06,464 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): master:394770x0, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-17 02:01:06,467 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:39477-0x10060026e590000 connected 2023-02-17 02:01:06,500 DEBUG [Listener at localhost/39237] zookeeper.ZKUtil(164): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 02:01:06,501 DEBUG [Listener at localhost/39237] zookeeper.ZKUtil(164): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 02:01:06,505 DEBUG [Listener at localhost/39237] zookeeper.ZKUtil(164): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-17 02:01:06,513 DEBUG [Listener at localhost/39237] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39477 2023-02-17 02:01:06,514 DEBUG [Listener at localhost/39237] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39477 2023-02-17 02:01:06,514 DEBUG [Listener at localhost/39237] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39477 2023-02-17 02:01:06,515 DEBUG [Listener at localhost/39237] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39477 2023-02-17 02:01:06,515 DEBUG [Listener at localhost/39237] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39477 2023-02-17 02:01:06,522 INFO [Listener at localhost/39237] master.HMaster(444): hbase.rootdir=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590, hbase.cluster.distributed=false 2023-02-17 02:01:06,597 INFO [Listener at localhost/39237] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-17 02:01:06,597 INFO [Listener at localhost/39237] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 02:01:06,598 INFO [Listener at localhost/39237] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-17 02:01:06,598 INFO [Listener at localhost/39237] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-17 02:01:06,598 INFO [Listener at localhost/39237] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 02:01:06,598 INFO [Listener at localhost/39237] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-17 02:01:06,603 INFO [Listener at localhost/39237] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-17 02:01:06,606 INFO [Listener at localhost/39237] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37401 2023-02-17 02:01:06,609 INFO [Listener at localhost/39237] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-17 02:01:06,616 DEBUG [Listener at localhost/39237] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 02:01:06,617 INFO [Listener at localhost/39237] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 02:01:06,619 INFO [Listener at localhost/39237] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 02:01:06,621 INFO [Listener at localhost/39237] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:37401 connecting to ZooKeeper ensemble=127.0.0.1:50037 2023-02-17 02:01:06,627 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): regionserver:374010x0, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-17 02:01:06,628 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:37401-0x10060026e590001 connected 2023-02-17 02:01:06,629 DEBUG [Listener at localhost/39237] zookeeper.ZKUtil(164): regionserver:37401-0x10060026e590001, quorum=127.0.0.1:50037, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 02:01:06,630 DEBUG [Listener at localhost/39237] zookeeper.ZKUtil(164): regionserver:37401-0x10060026e590001, quorum=127.0.0.1:50037, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 02:01:06,631 DEBUG [Listener at localhost/39237] zookeeper.ZKUtil(164): regionserver:37401-0x10060026e590001, quorum=127.0.0.1:50037, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-17 02:01:06,632 DEBUG [Listener at localhost/39237] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37401 2023-02-17 02:01:06,635 DEBUG [Listener at localhost/39237] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37401 2023-02-17 02:01:06,636 DEBUG [Listener at localhost/39237] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37401 2023-02-17 02:01:06,637 DEBUG [Listener at localhost/39237] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37401 2023-02-17 02:01:06,639 DEBUG [Listener at localhost/39237] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37401 2023-02-17 02:01:06,652 INFO [Listener at localhost/39237] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-17 02:01:06,653 INFO [Listener at localhost/39237] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 02:01:06,653 INFO [Listener at localhost/39237] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-17 02:01:06,654 INFO [Listener at localhost/39237] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-17 02:01:06,654 INFO [Listener at localhost/39237] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 02:01:06,654 INFO [Listener at localhost/39237] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-17 02:01:06,654 INFO [Listener at localhost/39237] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-17 02:01:06,656 INFO [Listener at localhost/39237] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34495 2023-02-17 02:01:06,657 INFO [Listener at localhost/39237] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-17 02:01:06,660 DEBUG [Listener at localhost/39237] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 02:01:06,661 INFO [Listener at localhost/39237] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 02:01:06,664 INFO [Listener at localhost/39237] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 02:01:06,667 INFO [Listener at localhost/39237] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34495 connecting to ZooKeeper ensemble=127.0.0.1:50037 2023-02-17 02:01:06,671 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): regionserver:344950x0, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-17 02:01:06,672 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:34495-0x10060026e590002 connected 2023-02-17 02:01:06,672 DEBUG [Listener at localhost/39237] zookeeper.ZKUtil(164): regionserver:34495-0x10060026e590002, quorum=127.0.0.1:50037, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 02:01:06,673 DEBUG [Listener at localhost/39237] zookeeper.ZKUtil(164): regionserver:34495-0x10060026e590002, quorum=127.0.0.1:50037, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 02:01:06,674 DEBUG [Listener at localhost/39237] zookeeper.ZKUtil(164): regionserver:34495-0x10060026e590002, quorum=127.0.0.1:50037, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-17 02:01:06,679 DEBUG [Listener at localhost/39237] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34495 2023-02-17 02:01:06,679 DEBUG [Listener at localhost/39237] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34495 2023-02-17 02:01:06,683 DEBUG [Listener at localhost/39237] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34495 2023-02-17 02:01:06,685 DEBUG [Listener at localhost/39237] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34495 2023-02-17 02:01:06,685 DEBUG [Listener at localhost/39237] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34495 2023-02-17 02:01:06,687 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,39477,1676599265371 2023-02-17 02:01:06,696 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-17 02:01:06,698 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,39477,1676599265371 2023-02-17 02:01:06,719 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-17 02:01:06,719 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): regionserver:34495-0x10060026e590002, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-17 02:01:06,719 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 02:01:06,719 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): regionserver:37401-0x10060026e590001, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-17 02:01:06,721 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-17 02:01:06,722 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,39477,1676599265371 from backup master directory 2023-02-17 02:01:06,722 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-17 02:01:06,727 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,39477,1676599265371 2023-02-17 02:01:06,727 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-17 02:01:06,728 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-17 02:01:06,728 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,39477,1676599265371 2023-02-17 02:01:06,732 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-02-17 02:01:06,733 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-02-17 02:01:06,828 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/hbase.id with ID: 36e053bd-992b-4dfb-8116-a2c2d1d74c53 2023-02-17 02:01:06,872 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 02:01:06,893 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 02:01:06,962 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x21e1069f to 127.0.0.1:50037 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 02:01:07,008 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@12b622db, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 02:01:07,038 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-17 02:01:07,040 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-17 02:01:07,068 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-02-17 02:01:07,068 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-02-17 02:01:07,071 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-02-17 02:01:07,077 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-02-17 02:01:07,079 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 02:01:07,117 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/MasterData/data/master/store-tmp 2023-02-17 02:01:07,153 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:07,153 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-17 02:01:07,153 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 02:01:07,153 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 02:01:07,153 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-17 02:01:07,153 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 02:01:07,153 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 02:01:07,153 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-17 02:01:07,155 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/MasterData/WALs/jenkins-hbase4.apache.org,39477,1676599265371 2023-02-17 02:01:07,178 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39477%2C1676599265371, suffix=, logDir=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/MasterData/WALs/jenkins-hbase4.apache.org,39477,1676599265371, archiveDir=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/MasterData/oldWALs, maxLogs=10 2023-02-17 02:01:07,234 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39139,DS-5b553e7b-7672-4a45-9385-415722c5ae2a,DISK] 2023-02-17 02:01:07,234 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38021,DS-49dec235-5df7-4b2a-bb64-1ac499932450,DISK] 2023-02-17 02:01:07,242 DEBUG [RS-EventLoopGroup-4-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-02-17 02:01:07,307 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/MasterData/WALs/jenkins-hbase4.apache.org,39477,1676599265371/jenkins-hbase4.apache.org%2C39477%2C1676599265371.1676599267190 2023-02-17 02:01:07,307 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39139,DS-5b553e7b-7672-4a45-9385-415722c5ae2a,DISK], DatanodeInfoWithStorage[127.0.0.1:38021,DS-49dec235-5df7-4b2a-bb64-1ac499932450,DISK]] 2023-02-17 02:01:07,308 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-17 02:01:07,309 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:07,312 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-17 02:01:07,313 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-17 02:01:07,388 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-17 02:01:07,395 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-17 02:01:07,424 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-17 02:01:07,436 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:07,443 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-17 02:01:07,445 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-17 02:01:07,465 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-17 02:01:07,469 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 02:01:07,470 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71977434, jitterRate=0.07254734635353088}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-17 02:01:07,470 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-17 02:01:07,472 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-17 02:01:07,501 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-17 02:01:07,501 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-17 02:01:07,506 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-17 02:01:07,508 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-02-17 02:01:07,545 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 36 msec 2023-02-17 02:01:07,545 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-17 02:01:07,576 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-17 02:01:07,581 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-17 02:01:07,610 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-17 02:01:07,615 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-17 02:01:07,616 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-17 02:01:07,623 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-17 02:01:07,627 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-17 02:01:07,631 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 02:01:07,633 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-17 02:01:07,633 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-17 02:01:07,646 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-17 02:01:07,652 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): regionserver:37401-0x10060026e590001, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-17 02:01:07,652 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-17 02:01:07,652 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): regionserver:34495-0x10060026e590002, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-17 02:01:07,653 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 02:01:07,653 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,39477,1676599265371, sessionid=0x10060026e590000, setting cluster-up flag (Was=false) 2023-02-17 02:01:07,671 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 02:01:07,678 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-17 02:01:07,680 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,39477,1676599265371 2023-02-17 02:01:07,686 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 02:01:07,693 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-17 02:01:07,694 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,39477,1676599265371 2023-02-17 02:01:07,697 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.hbase-snapshot/.tmp 2023-02-17 02:01:07,790 INFO [RS:0;jenkins-hbase4:37401] regionserver.HRegionServer(952): ClusterId : 36e053bd-992b-4dfb-8116-a2c2d1d74c53 2023-02-17 02:01:07,790 INFO [RS:1;jenkins-hbase4:34495] regionserver.HRegionServer(952): ClusterId : 36e053bd-992b-4dfb-8116-a2c2d1d74c53 2023-02-17 02:01:07,796 DEBUG [RS:1;jenkins-hbase4:34495] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-17 02:01:07,796 DEBUG [RS:0;jenkins-hbase4:37401] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-17 02:01:07,804 DEBUG [RS:0;jenkins-hbase4:37401] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-17 02:01:07,804 DEBUG [RS:0;jenkins-hbase4:37401] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-17 02:01:07,804 DEBUG [RS:1;jenkins-hbase4:34495] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-17 02:01:07,805 DEBUG [RS:1;jenkins-hbase4:34495] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-17 02:01:07,809 DEBUG [RS:0;jenkins-hbase4:37401] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-17 02:01:07,809 DEBUG [RS:1;jenkins-hbase4:34495] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-17 02:01:07,810 DEBUG [RS:1;jenkins-hbase4:34495] zookeeper.ReadOnlyZKClient(139): Connect 0x51e5b4d4 to 127.0.0.1:50037 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 02:01:07,810 DEBUG [RS:0;jenkins-hbase4:37401] zookeeper.ReadOnlyZKClient(139): Connect 0x17a516e2 to 127.0.0.1:50037 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 02:01:07,824 DEBUG [RS:1;jenkins-hbase4:34495] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5f224098, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 02:01:07,825 DEBUG [RS:0;jenkins-hbase4:37401] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1962ea66, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 02:01:07,825 DEBUG [RS:1;jenkins-hbase4:34495] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5b1ddfa4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-17 02:01:07,825 DEBUG [RS:0;jenkins-hbase4:37401] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1d5d7d92, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-17 02:01:07,836 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-17 02:01:07,848 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-17 02:01:07,848 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-17 02:01:07,849 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-17 02:01:07,849 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-17 02:01:07,849 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-17 02:01:07,849 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:07,849 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-17 02:01:07,849 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:07,850 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676599297850 2023-02-17 02:01:07,854 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-17 02:01:07,854 DEBUG [RS:1;jenkins-hbase4:34495] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:34495 2023-02-17 02:01:07,854 DEBUG [RS:0;jenkins-hbase4:37401] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:37401 2023-02-17 02:01:07,858 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-17 02:01:07,858 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-17 02:01:07,860 INFO [RS:0;jenkins-hbase4:37401] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-17 02:01:07,860 INFO [RS:1;jenkins-hbase4:34495] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-17 02:01:07,860 INFO [RS:1;jenkins-hbase4:34495] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-17 02:01:07,860 INFO [RS:0;jenkins-hbase4:37401] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-17 02:01:07,860 DEBUG [RS:1;jenkins-hbase4:34495] regionserver.HRegionServer(1023): About to register with Master. 2023-02-17 02:01:07,860 DEBUG [RS:0;jenkins-hbase4:37401] regionserver.HRegionServer(1023): About to register with Master. 2023-02-17 02:01:07,864 INFO [RS:1;jenkins-hbase4:34495] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,39477,1676599265371 with isa=jenkins-hbase4.apache.org/172.31.14.131:34495, startcode=1676599266651 2023-02-17 02:01:07,864 INFO [RS:0;jenkins-hbase4:37401] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,39477,1676599265371 with isa=jenkins-hbase4.apache.org/172.31.14.131:37401, startcode=1676599266596 2023-02-17 02:01:07,864 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-17 02:01:07,868 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-17 02:01:07,878 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-17 02:01:07,879 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-17 02:01:07,880 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-17 02:01:07,880 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-17 02:01:07,881 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:07,883 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-17 02:01:07,885 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-17 02:01:07,885 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-17 02:01:07,886 DEBUG [RS:1;jenkins-hbase4:34495] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-17 02:01:07,886 DEBUG [RS:0;jenkins-hbase4:37401] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-17 02:01:07,890 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-17 02:01:07,891 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-17 02:01:07,904 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676599267901,5,FailOnTimeoutGroup] 2023-02-17 02:01:07,905 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676599267905,5,FailOnTimeoutGroup] 2023-02-17 02:01:07,905 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:07,906 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-17 02:01:07,908 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:07,908 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:07,910 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-17 02:01:07,912 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-17 02:01:07,912 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590 2023-02-17 02:01:07,954 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:07,957 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-17 02:01:07,960 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/hbase/meta/1588230740/info 2023-02-17 02:01:07,961 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-17 02:01:07,963 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:07,963 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-17 02:01:07,965 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/hbase/meta/1588230740/rep_barrier 2023-02-17 02:01:07,966 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-17 02:01:07,967 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:07,968 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-17 02:01:07,970 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/hbase/meta/1588230740/table 2023-02-17 02:01:07,971 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-17 02:01:07,972 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:07,974 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/hbase/meta/1588230740 2023-02-17 02:01:07,975 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/hbase/meta/1588230740 2023-02-17 02:01:07,977 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41661, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-02-17 02:01:07,977 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38051, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-02-17 02:01:07,981 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-17 02:01:07,984 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-17 02:01:07,989 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 02:01:07,991 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64073241, jitterRate=-0.045234307646751404}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-17 02:01:07,991 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-17 02:01:07,991 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-17 02:01:07,991 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-17 02:01:07,991 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-17 02:01:07,991 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-17 02:01:07,991 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-17 02:01:07,992 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39477] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,34495,1676599266651 2023-02-17 02:01:07,992 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39477] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,37401,1676599266596 2023-02-17 02:01:07,992 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-17 02:01:07,993 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-17 02:01:07,999 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-17 02:01:07,999 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-17 02:01:08,011 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-17 02:01:08,014 DEBUG [RS:0;jenkins-hbase4:37401] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590 2023-02-17 02:01:08,014 DEBUG [RS:1;jenkins-hbase4:34495] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590 2023-02-17 02:01:08,014 DEBUG [RS:0;jenkins-hbase4:37401] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:44409 2023-02-17 02:01:08,014 DEBUG [RS:1;jenkins-hbase4:34495] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:44409 2023-02-17 02:01:08,014 DEBUG [RS:0;jenkins-hbase4:37401] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-17 02:01:08,015 DEBUG [RS:1;jenkins-hbase4:34495] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-17 02:01:08,021 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 02:01:08,030 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-17 02:01:08,031 DEBUG [RS:1;jenkins-hbase4:34495] zookeeper.ZKUtil(162): regionserver:34495-0x10060026e590002, quorum=127.0.0.1:50037, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34495,1676599266651 2023-02-17 02:01:08,031 WARN [RS:1;jenkins-hbase4:34495] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-17 02:01:08,031 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,34495,1676599266651] 2023-02-17 02:01:08,031 INFO [RS:1;jenkins-hbase4:34495] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 02:01:08,031 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,37401,1676599266596] 2023-02-17 02:01:08,031 DEBUG [RS:1;jenkins-hbase4:34495] regionserver.HRegionServer(1947): logDir=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/WALs/jenkins-hbase4.apache.org,34495,1676599266651 2023-02-17 02:01:08,035 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-17 02:01:08,036 DEBUG [RS:0;jenkins-hbase4:37401] zookeeper.ZKUtil(162): regionserver:37401-0x10060026e590001, quorum=127.0.0.1:50037, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37401,1676599266596 2023-02-17 02:01:08,037 WARN [RS:0;jenkins-hbase4:37401] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-17 02:01:08,040 INFO [RS:0;jenkins-hbase4:37401] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 02:01:08,040 DEBUG [RS:0;jenkins-hbase4:37401] regionserver.HRegionServer(1947): logDir=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/WALs/jenkins-hbase4.apache.org,37401,1676599266596 2023-02-17 02:01:08,052 DEBUG [RS:1;jenkins-hbase4:34495] zookeeper.ZKUtil(162): regionserver:34495-0x10060026e590002, quorum=127.0.0.1:50037, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34495,1676599266651 2023-02-17 02:01:08,052 DEBUG [RS:0;jenkins-hbase4:37401] zookeeper.ZKUtil(162): regionserver:37401-0x10060026e590001, quorum=127.0.0.1:50037, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34495,1676599266651 2023-02-17 02:01:08,053 DEBUG [RS:1;jenkins-hbase4:34495] zookeeper.ZKUtil(162): regionserver:34495-0x10060026e590002, quorum=127.0.0.1:50037, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37401,1676599266596 2023-02-17 02:01:08,053 DEBUG [RS:0;jenkins-hbase4:37401] zookeeper.ZKUtil(162): regionserver:37401-0x10060026e590001, quorum=127.0.0.1:50037, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37401,1676599266596 2023-02-17 02:01:08,065 DEBUG [RS:1;jenkins-hbase4:34495] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-17 02:01:08,065 DEBUG [RS:0;jenkins-hbase4:37401] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-17 02:01:08,075 INFO [RS:1;jenkins-hbase4:34495] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-17 02:01:08,075 INFO [RS:0;jenkins-hbase4:37401] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-17 02:01:08,096 INFO [RS:1;jenkins-hbase4:34495] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-17 02:01:08,096 INFO [RS:0;jenkins-hbase4:37401] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-17 02:01:08,101 INFO [RS:1;jenkins-hbase4:34495] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-17 02:01:08,101 INFO [RS:0;jenkins-hbase4:37401] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-17 02:01:08,102 INFO [RS:1;jenkins-hbase4:34495] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:08,102 INFO [RS:0;jenkins-hbase4:37401] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:08,103 INFO [RS:1;jenkins-hbase4:34495] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-17 02:01:08,103 INFO [RS:0;jenkins-hbase4:37401] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-17 02:01:08,112 INFO [RS:1;jenkins-hbase4:34495] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:08,112 INFO [RS:0;jenkins-hbase4:37401] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:08,112 DEBUG [RS:1;jenkins-hbase4:34495] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:08,112 DEBUG [RS:0;jenkins-hbase4:37401] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:08,113 DEBUG [RS:1;jenkins-hbase4:34495] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:08,113 DEBUG [RS:0;jenkins-hbase4:37401] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:08,113 DEBUG [RS:1;jenkins-hbase4:34495] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:08,113 DEBUG [RS:0;jenkins-hbase4:37401] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:08,113 DEBUG [RS:1;jenkins-hbase4:34495] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:08,113 DEBUG [RS:0;jenkins-hbase4:37401] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:08,113 DEBUG [RS:1;jenkins-hbase4:34495] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:08,113 DEBUG [RS:0;jenkins-hbase4:37401] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:08,113 DEBUG [RS:1;jenkins-hbase4:34495] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-17 02:01:08,113 DEBUG [RS:0;jenkins-hbase4:37401] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-17 02:01:08,113 DEBUG [RS:1;jenkins-hbase4:34495] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:08,113 DEBUG [RS:0;jenkins-hbase4:37401] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:08,113 DEBUG [RS:1;jenkins-hbase4:34495] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:08,113 DEBUG [RS:0;jenkins-hbase4:37401] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:08,114 DEBUG [RS:1;jenkins-hbase4:34495] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:08,114 DEBUG [RS:0;jenkins-hbase4:37401] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:08,114 DEBUG [RS:1;jenkins-hbase4:34495] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:08,114 DEBUG [RS:0;jenkins-hbase4:37401] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:08,115 INFO [RS:0;jenkins-hbase4:37401] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:08,115 INFO [RS:0;jenkins-hbase4:37401] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:08,115 INFO [RS:0;jenkins-hbase4:37401] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:08,116 INFO [RS:1;jenkins-hbase4:34495] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:08,116 INFO [RS:1;jenkins-hbase4:34495] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:08,116 INFO [RS:1;jenkins-hbase4:34495] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:08,133 INFO [RS:0;jenkins-hbase4:37401] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-17 02:01:08,133 INFO [RS:1;jenkins-hbase4:34495] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-17 02:01:08,136 INFO [RS:0;jenkins-hbase4:37401] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37401,1676599266596-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:08,136 INFO [RS:1;jenkins-hbase4:34495] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34495,1676599266651-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:08,155 INFO [RS:1;jenkins-hbase4:34495] regionserver.Replication(203): jenkins-hbase4.apache.org,34495,1676599266651 started 2023-02-17 02:01:08,155 INFO [RS:0;jenkins-hbase4:37401] regionserver.Replication(203): jenkins-hbase4.apache.org,37401,1676599266596 started 2023-02-17 02:01:08,156 INFO [RS:1;jenkins-hbase4:34495] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,34495,1676599266651, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:34495, sessionid=0x10060026e590002 2023-02-17 02:01:08,156 INFO [RS:0;jenkins-hbase4:37401] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,37401,1676599266596, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:37401, sessionid=0x10060026e590001 2023-02-17 02:01:08,156 DEBUG [RS:1;jenkins-hbase4:34495] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-17 02:01:08,156 DEBUG [RS:0;jenkins-hbase4:37401] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-17 02:01:08,156 DEBUG [RS:1;jenkins-hbase4:34495] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,34495,1676599266651 2023-02-17 02:01:08,156 DEBUG [RS:0;jenkins-hbase4:37401] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,37401,1676599266596 2023-02-17 02:01:08,157 DEBUG [RS:1;jenkins-hbase4:34495] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34495,1676599266651' 2023-02-17 02:01:08,157 DEBUG [RS:0;jenkins-hbase4:37401] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37401,1676599266596' 2023-02-17 02:01:08,158 DEBUG [RS:0;jenkins-hbase4:37401] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 02:01:08,158 DEBUG [RS:1;jenkins-hbase4:34495] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 02:01:08,158 DEBUG [RS:1;jenkins-hbase4:34495] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 02:01:08,158 DEBUG [RS:0;jenkins-hbase4:37401] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 02:01:08,159 DEBUG [RS:1;jenkins-hbase4:34495] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-17 02:01:08,159 DEBUG [RS:1;jenkins-hbase4:34495] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-17 02:01:08,159 DEBUG [RS:0;jenkins-hbase4:37401] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-17 02:01:08,159 DEBUG [RS:1;jenkins-hbase4:34495] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,34495,1676599266651 2023-02-17 02:01:08,159 DEBUG [RS:0;jenkins-hbase4:37401] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-17 02:01:08,159 DEBUG [RS:1;jenkins-hbase4:34495] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34495,1676599266651' 2023-02-17 02:01:08,159 DEBUG [RS:0;jenkins-hbase4:37401] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,37401,1676599266596 2023-02-17 02:01:08,160 DEBUG [RS:1;jenkins-hbase4:34495] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 02:01:08,160 DEBUG [RS:0;jenkins-hbase4:37401] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37401,1676599266596' 2023-02-17 02:01:08,160 DEBUG [RS:0;jenkins-hbase4:37401] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 02:01:08,161 DEBUG [RS:1;jenkins-hbase4:34495] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 02:01:08,161 DEBUG [RS:0;jenkins-hbase4:37401] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 02:01:08,161 DEBUG [RS:1;jenkins-hbase4:34495] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-17 02:01:08,161 DEBUG [RS:0;jenkins-hbase4:37401] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-17 02:01:08,162 INFO [RS:1;jenkins-hbase4:34495] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-17 02:01:08,162 INFO [RS:0;jenkins-hbase4:37401] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-17 02:01:08,162 INFO [RS:1;jenkins-hbase4:34495] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-17 02:01:08,162 INFO [RS:0;jenkins-hbase4:37401] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-17 02:01:08,188 DEBUG [jenkins-hbase4:39477] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-17 02:01:08,192 DEBUG [jenkins-hbase4:39477] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-17 02:01:08,199 DEBUG [jenkins-hbase4:39477] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-17 02:01:08,199 DEBUG [jenkins-hbase4:39477] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-17 02:01:08,199 DEBUG [jenkins-hbase4:39477] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-17 02:01:08,202 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,37401,1676599266596, state=OPENING 2023-02-17 02:01:08,211 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-17 02:01:08,213 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 02:01:08,214 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-17 02:01:08,218 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,37401,1676599266596}] 2023-02-17 02:01:08,407 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,37401,1676599266596 2023-02-17 02:01:08,410 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-17 02:01:08,414 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39568, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-17 02:01:08,430 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-17 02:01:08,430 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 02:01:08,433 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37401%2C1676599266596.meta, suffix=.meta, logDir=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/WALs/jenkins-hbase4.apache.org,37401,1676599266596, archiveDir=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/oldWALs, maxLogs=32 2023-02-17 02:01:08,455 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38021,DS-49dec235-5df7-4b2a-bb64-1ac499932450,DISK] 2023-02-17 02:01:08,456 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39139,DS-5b553e7b-7672-4a45-9385-415722c5ae2a,DISK] 2023-02-17 02:01:08,462 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/WALs/jenkins-hbase4.apache.org,37401,1676599266596/jenkins-hbase4.apache.org%2C37401%2C1676599266596.meta.1676599268437.meta 2023-02-17 02:01:08,462 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38021,DS-49dec235-5df7-4b2a-bb64-1ac499932450,DISK], DatanodeInfoWithStorage[127.0.0.1:39139,DS-5b553e7b-7672-4a45-9385-415722c5ae2a,DISK]] 2023-02-17 02:01:08,463 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-17 02:01:08,465 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-17 02:01:08,486 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-17 02:01:08,492 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-17 02:01:08,498 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-17 02:01:08,498 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:08,498 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-17 02:01:08,499 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-17 02:01:08,502 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-17 02:01:08,504 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/hbase/meta/1588230740/info 2023-02-17 02:01:08,504 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/hbase/meta/1588230740/info 2023-02-17 02:01:08,505 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-17 02:01:08,506 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:08,506 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-17 02:01:08,508 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/hbase/meta/1588230740/rep_barrier 2023-02-17 02:01:08,508 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/hbase/meta/1588230740/rep_barrier 2023-02-17 02:01:08,508 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-17 02:01:08,509 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:08,510 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-17 02:01:08,511 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/hbase/meta/1588230740/table 2023-02-17 02:01:08,511 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/hbase/meta/1588230740/table 2023-02-17 02:01:08,512 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-17 02:01:08,513 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:08,515 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/hbase/meta/1588230740 2023-02-17 02:01:08,518 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/hbase/meta/1588230740 2023-02-17 02:01:08,523 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-17 02:01:08,526 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-17 02:01:08,527 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60019240, jitterRate=-0.105643630027771}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-17 02:01:08,528 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-17 02:01:08,538 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676599268398 2023-02-17 02:01:08,557 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-17 02:01:08,558 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-17 02:01:08,559 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,37401,1676599266596, state=OPEN 2023-02-17 02:01:08,562 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-17 02:01:08,562 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-17 02:01:08,567 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-17 02:01:08,567 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,37401,1676599266596 in 344 msec 2023-02-17 02:01:08,572 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-17 02:01:08,573 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 558 msec 2023-02-17 02:01:08,579 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 820 msec 2023-02-17 02:01:08,579 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676599268579, completionTime=-1 2023-02-17 02:01:08,579 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-17 02:01:08,579 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-17 02:01:08,681 DEBUG [hconnection-0x13759749-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 02:01:08,702 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39574, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 02:01:08,745 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-17 02:01:08,745 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676599328745 2023-02-17 02:01:08,745 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676599388745 2023-02-17 02:01:08,745 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 165 msec 2023-02-17 02:01:08,793 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39477,1676599265371-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:08,793 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39477,1676599265371-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:08,793 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39477,1676599265371-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:08,795 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:39477, period=300000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:08,796 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:08,805 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-17 02:01:08,813 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-17 02:01:08,815 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-17 02:01:08,826 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-17 02:01:08,829 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-17 02:01:08,832 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-17 02:01:08,861 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/hbase/namespace/a4798e0c958d05023433fed00aa11afa 2023-02-17 02:01:08,864 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/hbase/namespace/a4798e0c958d05023433fed00aa11afa empty. 2023-02-17 02:01:08,865 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/hbase/namespace/a4798e0c958d05023433fed00aa11afa 2023-02-17 02:01:08,865 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-17 02:01:08,894 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-17 02:01:08,896 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => a4798e0c958d05023433fed00aa11afa, NAME => 'hbase:namespace,,1676599268814.a4798e0c958d05023433fed00aa11afa.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp 2023-02-17 02:01:08,916 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676599268814.a4798e0c958d05023433fed00aa11afa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:08,916 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing a4798e0c958d05023433fed00aa11afa, disabling compactions & flushes 2023-02-17 02:01:08,916 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676599268814.a4798e0c958d05023433fed00aa11afa. 2023-02-17 02:01:08,916 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676599268814.a4798e0c958d05023433fed00aa11afa. 2023-02-17 02:01:08,916 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676599268814.a4798e0c958d05023433fed00aa11afa. after waiting 0 ms 2023-02-17 02:01:08,917 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676599268814.a4798e0c958d05023433fed00aa11afa. 2023-02-17 02:01:08,917 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676599268814.a4798e0c958d05023433fed00aa11afa. 2023-02-17 02:01:08,917 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for a4798e0c958d05023433fed00aa11afa: 2023-02-17 02:01:08,922 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-17 02:01:08,939 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676599268814.a4798e0c958d05023433fed00aa11afa.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676599268925"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676599268925"}]},"ts":"1676599268925"} 2023-02-17 02:01:08,968 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-17 02:01:08,970 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-17 02:01:08,975 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676599268971"}]},"ts":"1676599268971"} 2023-02-17 02:01:08,981 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-17 02:01:08,985 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-17 02:01:08,987 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-17 02:01:08,987 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-17 02:01:08,987 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-17 02:01:08,990 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=a4798e0c958d05023433fed00aa11afa, ASSIGN}] 2023-02-17 02:01:08,993 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=a4798e0c958d05023433fed00aa11afa, ASSIGN 2023-02-17 02:01:08,996 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=a4798e0c958d05023433fed00aa11afa, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37401,1676599266596; forceNewPlan=false, retain=false 2023-02-17 02:01:09,149 INFO [jenkins-hbase4:39477] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-17 02:01:09,150 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=a4798e0c958d05023433fed00aa11afa, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37401,1676599266596 2023-02-17 02:01:09,150 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676599268814.a4798e0c958d05023433fed00aa11afa.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676599269150"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676599269150"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676599269150"}]},"ts":"1676599269150"} 2023-02-17 02:01:09,157 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure a4798e0c958d05023433fed00aa11afa, server=jenkins-hbase4.apache.org,37401,1676599266596}] 2023-02-17 02:01:09,173 INFO [RS:1;jenkins-hbase4:34495] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34495%2C1676599266651, suffix=, logDir=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/WALs/jenkins-hbase4.apache.org,34495,1676599266651, archiveDir=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/oldWALs, maxLogs=32 2023-02-17 02:01:09,173 INFO [RS:0;jenkins-hbase4:37401] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37401%2C1676599266596, suffix=, logDir=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/WALs/jenkins-hbase4.apache.org,37401,1676599266596, archiveDir=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/oldWALs, maxLogs=32 2023-02-17 02:01:09,202 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39139,DS-5b553e7b-7672-4a45-9385-415722c5ae2a,DISK] 2023-02-17 02:01:09,207 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38021,DS-49dec235-5df7-4b2a-bb64-1ac499932450,DISK] 2023-02-17 02:01:09,221 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39139,DS-5b553e7b-7672-4a45-9385-415722c5ae2a,DISK] 2023-02-17 02:01:09,222 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38021,DS-49dec235-5df7-4b2a-bb64-1ac499932450,DISK] 2023-02-17 02:01:09,230 INFO [RS:0;jenkins-hbase4:37401] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/WALs/jenkins-hbase4.apache.org,37401,1676599266596/jenkins-hbase4.apache.org%2C37401%2C1676599266596.1676599269176 2023-02-17 02:01:09,231 DEBUG [RS:0;jenkins-hbase4:37401] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38021,DS-49dec235-5df7-4b2a-bb64-1ac499932450,DISK], DatanodeInfoWithStorage[127.0.0.1:39139,DS-5b553e7b-7672-4a45-9385-415722c5ae2a,DISK]] 2023-02-17 02:01:09,237 INFO [RS:1;jenkins-hbase4:34495] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/WALs/jenkins-hbase4.apache.org,34495,1676599266651/jenkins-hbase4.apache.org%2C34495%2C1676599266651.1676599269176 2023-02-17 02:01:09,237 DEBUG [RS:1;jenkins-hbase4:34495] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39139,DS-5b553e7b-7672-4a45-9385-415722c5ae2a,DISK], DatanodeInfoWithStorage[127.0.0.1:38021,DS-49dec235-5df7-4b2a-bb64-1ac499932450,DISK]] 2023-02-17 02:01:09,318 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676599268814.a4798e0c958d05023433fed00aa11afa. 2023-02-17 02:01:09,319 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => a4798e0c958d05023433fed00aa11afa, NAME => 'hbase:namespace,,1676599268814.a4798e0c958d05023433fed00aa11afa.', STARTKEY => '', ENDKEY => ''} 2023-02-17 02:01:09,320 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace a4798e0c958d05023433fed00aa11afa 2023-02-17 02:01:09,320 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676599268814.a4798e0c958d05023433fed00aa11afa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:09,320 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for a4798e0c958d05023433fed00aa11afa 2023-02-17 02:01:09,320 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for a4798e0c958d05023433fed00aa11afa 2023-02-17 02:01:09,352 INFO [StoreOpener-a4798e0c958d05023433fed00aa11afa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region a4798e0c958d05023433fed00aa11afa 2023-02-17 02:01:09,355 DEBUG [StoreOpener-a4798e0c958d05023433fed00aa11afa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/hbase/namespace/a4798e0c958d05023433fed00aa11afa/info 2023-02-17 02:01:09,355 DEBUG [StoreOpener-a4798e0c958d05023433fed00aa11afa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/hbase/namespace/a4798e0c958d05023433fed00aa11afa/info 2023-02-17 02:01:09,356 INFO [StoreOpener-a4798e0c958d05023433fed00aa11afa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a4798e0c958d05023433fed00aa11afa columnFamilyName info 2023-02-17 02:01:09,357 INFO [StoreOpener-a4798e0c958d05023433fed00aa11afa-1] regionserver.HStore(310): Store=a4798e0c958d05023433fed00aa11afa/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:09,359 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/hbase/namespace/a4798e0c958d05023433fed00aa11afa 2023-02-17 02:01:09,360 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/hbase/namespace/a4798e0c958d05023433fed00aa11afa 2023-02-17 02:01:09,365 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for a4798e0c958d05023433fed00aa11afa 2023-02-17 02:01:09,369 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/hbase/namespace/a4798e0c958d05023433fed00aa11afa/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 02:01:09,370 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened a4798e0c958d05023433fed00aa11afa; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63781536, jitterRate=-0.049581050872802734}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-17 02:01:09,370 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for a4798e0c958d05023433fed00aa11afa: 2023-02-17 02:01:09,376 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676599268814.a4798e0c958d05023433fed00aa11afa., pid=6, masterSystemTime=1676599269311 2023-02-17 02:01:09,382 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676599268814.a4798e0c958d05023433fed00aa11afa. 2023-02-17 02:01:09,382 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676599268814.a4798e0c958d05023433fed00aa11afa. 2023-02-17 02:01:09,383 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=a4798e0c958d05023433fed00aa11afa, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37401,1676599266596 2023-02-17 02:01:09,384 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676599268814.a4798e0c958d05023433fed00aa11afa.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676599269383"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676599269383"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676599269383"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676599269383"}]},"ts":"1676599269383"} 2023-02-17 02:01:09,393 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-17 02:01:09,393 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure a4798e0c958d05023433fed00aa11afa, server=jenkins-hbase4.apache.org,37401,1676599266596 in 232 msec 2023-02-17 02:01:09,397 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-17 02:01:09,398 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=a4798e0c958d05023433fed00aa11afa, ASSIGN in 403 msec 2023-02-17 02:01:09,399 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-17 02:01:09,399 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676599269399"}]},"ts":"1676599269399"} 2023-02-17 02:01:09,403 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-17 02:01:09,406 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-17 02:01:09,409 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 591 msec 2023-02-17 02:01:09,449 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-17 02:01:09,451 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-17 02:01:09,451 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 02:01:09,490 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-17 02:01:09,514 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-17 02:01:09,519 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 37 msec 2023-02-17 02:01:09,525 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-17 02:01:09,537 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-17 02:01:09,543 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 18 msec 2023-02-17 02:01:09,551 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-17 02:01:09,555 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-17 02:01:09,555 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.827sec 2023-02-17 02:01:09,559 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-17 02:01:09,561 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-17 02:01:09,561 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-17 02:01:09,563 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39477,1676599265371-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-17 02:01:09,565 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39477,1676599265371-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-17 02:01:09,576 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-17 02:01:09,601 DEBUG [Listener at localhost/39237] zookeeper.ReadOnlyZKClient(139): Connect 0x2d710525 to 127.0.0.1:50037 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 02:01:09,606 DEBUG [Listener at localhost/39237] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5258bbcc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 02:01:09,656 DEBUG [hconnection-0x7e6caff2-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 02:01:09,669 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39588, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 02:01:09,680 INFO [Listener at localhost/39237] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,39477,1676599265371 2023-02-17 02:01:09,681 DEBUG [Listener at localhost/39237] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-17 02:01:09,690 DEBUG [Listener at localhost/39237] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-17 02:01:09,693 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49734, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-17 02:01:09,698 INFO [Listener at localhost/39237] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-17 02:01:09,703 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39477] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-17 02:01:09,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39477] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-17 02:01:09,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39477] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 77 connection: 172.31.14.131:49734 deadline: 1676599329702, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-17 02:01:09,724 INFO [Listener at localhost/39237] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-17 02:01:09,738 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39477] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-17 02:01:09,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39477] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-17 02:01:09,744 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-17 02:01:09,747 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-17 02:01:09,749 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39477] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-17 02:01:09,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 02:01:09,773 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/60da012c2f8c7fe0ec391ffacffa21f0 2023-02-17 02:01:09,773 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/70f7ef12da22dd3ef39c2af364b54ddd 2023-02-17 02:01:09,773 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/a8930d4446cbfaf62e358646d1db5a41 2023-02-17 02:01:09,773 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/b3da13e5dcdc5200c5067deebd89a3b4 2023-02-17 02:01:09,774 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/3c50622abf2210dda1717f4c123254eb 2023-02-17 02:01:09,774 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/4d5096d14486c6ef9123841c928ad2ea 2023-02-17 02:01:09,774 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/6a46e9ed5ad2c334585050f964998e61 2023-02-17 02:01:09,774 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/60da012c2f8c7fe0ec391ffacffa21f0 empty. 2023-02-17 02:01:09,774 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/b213250f6e3c76397fc5267bf5934c3e 2023-02-17 02:01:09,775 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/b3da13e5dcdc5200c5067deebd89a3b4 empty. 2023-02-17 02:01:09,775 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/a8930d4446cbfaf62e358646d1db5a41 empty. 2023-02-17 02:01:09,775 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/b213250f6e3c76397fc5267bf5934c3e empty. 2023-02-17 02:01:09,776 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/70f7ef12da22dd3ef39c2af364b54ddd empty. 2023-02-17 02:01:09,778 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/b3da13e5dcdc5200c5067deebd89a3b4 2023-02-17 02:01:09,778 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/a8930d4446cbfaf62e358646d1db5a41 2023-02-17 02:01:09,778 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/4ed625a5af4623dec3e6c74a1f7180c6 2023-02-17 02:01:09,778 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/b213250f6e3c76397fc5267bf5934c3e 2023-02-17 02:01:09,778 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/6a46e9ed5ad2c334585050f964998e61 empty. 2023-02-17 02:01:09,778 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/4fb7511bdaa2707fcc86962500b3c078 2023-02-17 02:01:09,779 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/60da012c2f8c7fe0ec391ffacffa21f0 2023-02-17 02:01:09,779 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/4d5096d14486c6ef9123841c928ad2ea empty. 2023-02-17 02:01:09,779 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/6a46e9ed5ad2c334585050f964998e61 2023-02-17 02:01:09,779 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/4fb7511bdaa2707fcc86962500b3c078 empty. 2023-02-17 02:01:09,780 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/70f7ef12da22dd3ef39c2af364b54ddd 2023-02-17 02:01:09,779 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/4ed625a5af4623dec3e6c74a1f7180c6 empty. 2023-02-17 02:01:09,780 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/4d5096d14486c6ef9123841c928ad2ea 2023-02-17 02:01:09,780 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/3c50622abf2210dda1717f4c123254eb empty. 2023-02-17 02:01:09,780 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/4fb7511bdaa2707fcc86962500b3c078 2023-02-17 02:01:09,780 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/4ed625a5af4623dec3e6c74a1f7180c6 2023-02-17 02:01:09,781 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/3c50622abf2210dda1717f4c123254eb 2023-02-17 02:01:09,781 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-17 02:01:09,800 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-17 02:01:09,802 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => a8930d4446cbfaf62e358646d1db5a41, NAME => 'testWithMapReduce,d\x84\x84,1676599269734.a8930d4446cbfaf62e358646d1db5a41.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp 2023-02-17 02:01:09,803 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 60da012c2f8c7fe0ec391ffacffa21f0, NAME => 'testWithMapReduce,,1676599269734.60da012c2f8c7fe0ec391ffacffa21f0.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp 2023-02-17 02:01:09,803 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 70f7ef12da22dd3ef39c2af364b54ddd, NAME => 'testWithMapReduce,aaa,1676599269734.70f7ef12da22dd3ef39c2af364b54ddd.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp 2023-02-17 02:01:09,851 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676599269734.a8930d4446cbfaf62e358646d1db5a41.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:09,852 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing a8930d4446cbfaf62e358646d1db5a41, disabling compactions & flushes 2023-02-17 02:01:09,852 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676599269734.a8930d4446cbfaf62e358646d1db5a41. 2023-02-17 02:01:09,852 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676599269734.a8930d4446cbfaf62e358646d1db5a41. 2023-02-17 02:01:09,852 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676599269734.a8930d4446cbfaf62e358646d1db5a41. after waiting 0 ms 2023-02-17 02:01:09,852 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676599269734.a8930d4446cbfaf62e358646d1db5a41. 2023-02-17 02:01:09,853 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676599269734.a8930d4446cbfaf62e358646d1db5a41. 2023-02-17 02:01:09,853 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for a8930d4446cbfaf62e358646d1db5a41: 2023-02-17 02:01:09,854 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => b3da13e5dcdc5200c5067deebd89a3b4, NAME => 'testWithMapReduce,g\xA7\xA7,1676599269734.b3da13e5dcdc5200c5067deebd89a3b4.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp 2023-02-17 02:01:09,854 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676599269734.60da012c2f8c7fe0ec391ffacffa21f0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:09,855 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 60da012c2f8c7fe0ec391ffacffa21f0, disabling compactions & flushes 2023-02-17 02:01:09,855 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676599269734.60da012c2f8c7fe0ec391ffacffa21f0. 2023-02-17 02:01:09,855 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676599269734.60da012c2f8c7fe0ec391ffacffa21f0. 2023-02-17 02:01:09,855 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676599269734.60da012c2f8c7fe0ec391ffacffa21f0. after waiting 0 ms 2023-02-17 02:01:09,855 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676599269734.60da012c2f8c7fe0ec391ffacffa21f0. 2023-02-17 02:01:09,855 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676599269734.60da012c2f8c7fe0ec391ffacffa21f0. 2023-02-17 02:01:09,855 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 60da012c2f8c7fe0ec391ffacffa21f0: 2023-02-17 02:01:09,856 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 3c50622abf2210dda1717f4c123254eb, NAME => 'testWithMapReduce,j\xCA\xCA,1676599269734.3c50622abf2210dda1717f4c123254eb.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp 2023-02-17 02:01:09,856 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676599269734.70f7ef12da22dd3ef39c2af364b54ddd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:09,856 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 70f7ef12da22dd3ef39c2af364b54ddd, disabling compactions & flushes 2023-02-17 02:01:09,856 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676599269734.70f7ef12da22dd3ef39c2af364b54ddd. 2023-02-17 02:01:09,857 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676599269734.70f7ef12da22dd3ef39c2af364b54ddd. 2023-02-17 02:01:09,857 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676599269734.70f7ef12da22dd3ef39c2af364b54ddd. after waiting 0 ms 2023-02-17 02:01:09,857 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676599269734.70f7ef12da22dd3ef39c2af364b54ddd. 2023-02-17 02:01:09,857 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676599269734.70f7ef12da22dd3ef39c2af364b54ddd. 2023-02-17 02:01:09,857 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 70f7ef12da22dd3ef39c2af364b54ddd: 2023-02-17 02:01:09,857 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 4d5096d14486c6ef9123841c928ad2ea, NAME => 'testWithMapReduce,m\xED\xED,1676599269734.4d5096d14486c6ef9123841c928ad2ea.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp 2023-02-17 02:01:09,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 02:01:09,894 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676599269734.b3da13e5dcdc5200c5067deebd89a3b4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:09,894 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing b3da13e5dcdc5200c5067deebd89a3b4, disabling compactions & flushes 2023-02-17 02:01:09,894 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676599269734.b3da13e5dcdc5200c5067deebd89a3b4. 2023-02-17 02:01:09,895 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676599269734.3c50622abf2210dda1717f4c123254eb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:09,895 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676599269734.b3da13e5dcdc5200c5067deebd89a3b4. 2023-02-17 02:01:09,895 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 3c50622abf2210dda1717f4c123254eb, disabling compactions & flushes 2023-02-17 02:01:09,895 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676599269734.b3da13e5dcdc5200c5067deebd89a3b4. after waiting 0 ms 2023-02-17 02:01:09,895 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676599269734.3c50622abf2210dda1717f4c123254eb. 2023-02-17 02:01:09,895 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676599269734.b3da13e5dcdc5200c5067deebd89a3b4. 2023-02-17 02:01:09,895 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676599269734.3c50622abf2210dda1717f4c123254eb. 2023-02-17 02:01:09,895 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676599269734.b3da13e5dcdc5200c5067deebd89a3b4. 2023-02-17 02:01:09,895 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676599269734.3c50622abf2210dda1717f4c123254eb. after waiting 0 ms 2023-02-17 02:01:09,895 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for b3da13e5dcdc5200c5067deebd89a3b4: 2023-02-17 02:01:09,895 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676599269734.3c50622abf2210dda1717f4c123254eb. 2023-02-17 02:01:09,896 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676599269734.3c50622abf2210dda1717f4c123254eb. 2023-02-17 02:01:09,896 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 3c50622abf2210dda1717f4c123254eb: 2023-02-17 02:01:09,896 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 6a46e9ed5ad2c334585050f964998e61, NAME => 'testWithMapReduce,q\x11\x10,1676599269734.6a46e9ed5ad2c334585050f964998e61.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp 2023-02-17 02:01:09,896 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => b213250f6e3c76397fc5267bf5934c3e, NAME => 'testWithMapReduce,t43,1676599269734.b213250f6e3c76397fc5267bf5934c3e.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp 2023-02-17 02:01:09,896 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676599269734.4d5096d14486c6ef9123841c928ad2ea.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:09,902 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 4d5096d14486c6ef9123841c928ad2ea, disabling compactions & flushes 2023-02-17 02:01:09,902 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676599269734.4d5096d14486c6ef9123841c928ad2ea. 2023-02-17 02:01:09,902 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676599269734.4d5096d14486c6ef9123841c928ad2ea. 2023-02-17 02:01:09,902 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676599269734.4d5096d14486c6ef9123841c928ad2ea. after waiting 0 ms 2023-02-17 02:01:09,902 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676599269734.4d5096d14486c6ef9123841c928ad2ea. 2023-02-17 02:01:09,902 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676599269734.4d5096d14486c6ef9123841c928ad2ea. 2023-02-17 02:01:09,902 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 4d5096d14486c6ef9123841c928ad2ea: 2023-02-17 02:01:09,903 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 4ed625a5af4623dec3e6c74a1f7180c6, NAME => 'testWithMapReduce,wWV,1676599269734.4ed625a5af4623dec3e6c74a1f7180c6.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp 2023-02-17 02:01:09,919 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676599269734.b213250f6e3c76397fc5267bf5934c3e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:09,921 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing b213250f6e3c76397fc5267bf5934c3e, disabling compactions & flushes 2023-02-17 02:01:09,921 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676599269734.b213250f6e3c76397fc5267bf5934c3e. 2023-02-17 02:01:09,921 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676599269734.b213250f6e3c76397fc5267bf5934c3e. 2023-02-17 02:01:09,921 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676599269734.b213250f6e3c76397fc5267bf5934c3e. after waiting 0 ms 2023-02-17 02:01:09,921 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676599269734.b213250f6e3c76397fc5267bf5934c3e. 2023-02-17 02:01:09,922 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676599269734.b213250f6e3c76397fc5267bf5934c3e. 2023-02-17 02:01:09,922 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for b213250f6e3c76397fc5267bf5934c3e: 2023-02-17 02:01:09,922 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 4fb7511bdaa2707fcc86962500b3c078, NAME => 'testWithMapReduce,zz{,1676599269734.4fb7511bdaa2707fcc86962500b3c078.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp 2023-02-17 02:01:09,925 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676599269734.6a46e9ed5ad2c334585050f964998e61.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:09,927 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 6a46e9ed5ad2c334585050f964998e61, disabling compactions & flushes 2023-02-17 02:01:09,927 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676599269734.6a46e9ed5ad2c334585050f964998e61. 2023-02-17 02:01:09,927 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676599269734.6a46e9ed5ad2c334585050f964998e61. 2023-02-17 02:01:09,928 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676599269734.6a46e9ed5ad2c334585050f964998e61. after waiting 0 ms 2023-02-17 02:01:09,928 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676599269734.6a46e9ed5ad2c334585050f964998e61. 2023-02-17 02:01:09,928 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676599269734.6a46e9ed5ad2c334585050f964998e61. 2023-02-17 02:01:09,928 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 6a46e9ed5ad2c334585050f964998e61: 2023-02-17 02:01:09,932 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676599269734.4ed625a5af4623dec3e6c74a1f7180c6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:09,933 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 4ed625a5af4623dec3e6c74a1f7180c6, disabling compactions & flushes 2023-02-17 02:01:09,933 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676599269734.4ed625a5af4623dec3e6c74a1f7180c6. 2023-02-17 02:01:09,933 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676599269734.4ed625a5af4623dec3e6c74a1f7180c6. 2023-02-17 02:01:09,933 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676599269734.4ed625a5af4623dec3e6c74a1f7180c6. after waiting 0 ms 2023-02-17 02:01:09,933 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676599269734.4ed625a5af4623dec3e6c74a1f7180c6. 2023-02-17 02:01:09,933 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676599269734.4ed625a5af4623dec3e6c74a1f7180c6. 2023-02-17 02:01:09,934 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 4ed625a5af4623dec3e6c74a1f7180c6: 2023-02-17 02:01:09,956 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676599269734.4fb7511bdaa2707fcc86962500b3c078.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:09,956 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 4fb7511bdaa2707fcc86962500b3c078, disabling compactions & flushes 2023-02-17 02:01:09,956 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676599269734.4fb7511bdaa2707fcc86962500b3c078. 2023-02-17 02:01:09,956 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676599269734.4fb7511bdaa2707fcc86962500b3c078. 2023-02-17 02:01:09,956 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676599269734.4fb7511bdaa2707fcc86962500b3c078. after waiting 0 ms 2023-02-17 02:01:09,956 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676599269734.4fb7511bdaa2707fcc86962500b3c078. 2023-02-17 02:01:09,956 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676599269734.4fb7511bdaa2707fcc86962500b3c078. 2023-02-17 02:01:09,956 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 4fb7511bdaa2707fcc86962500b3c078: 2023-02-17 02:01:09,962 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-17 02:01:09,964 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676599269734.a8930d4446cbfaf62e358646d1db5a41.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676599269964"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676599269964"}]},"ts":"1676599269964"} 2023-02-17 02:01:09,965 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676599269734.60da012c2f8c7fe0ec391ffacffa21f0.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676599269964"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676599269964"}]},"ts":"1676599269964"} 2023-02-17 02:01:09,965 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676599269734.70f7ef12da22dd3ef39c2af364b54ddd.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676599269964"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676599269964"}]},"ts":"1676599269964"} 2023-02-17 02:01:09,965 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676599269734.b3da13e5dcdc5200c5067deebd89a3b4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676599269964"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676599269964"}]},"ts":"1676599269964"} 2023-02-17 02:01:09,965 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676599269734.3c50622abf2210dda1717f4c123254eb.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676599269964"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676599269964"}]},"ts":"1676599269964"} 2023-02-17 02:01:09,966 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676599269734.4d5096d14486c6ef9123841c928ad2ea.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676599269964"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676599269964"}]},"ts":"1676599269964"} 2023-02-17 02:01:09,966 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676599269734.b213250f6e3c76397fc5267bf5934c3e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676599269964"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676599269964"}]},"ts":"1676599269964"} 2023-02-17 02:01:09,966 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676599269734.6a46e9ed5ad2c334585050f964998e61.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676599269964"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676599269964"}]},"ts":"1676599269964"} 2023-02-17 02:01:09,966 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676599269734.4ed625a5af4623dec3e6c74a1f7180c6.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676599269964"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676599269964"}]},"ts":"1676599269964"} 2023-02-17 02:01:09,966 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676599269734.4fb7511bdaa2707fcc86962500b3c078.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676599269964"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676599269964"}]},"ts":"1676599269964"} 2023-02-17 02:01:10,019 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-17 02:01:10,021 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-17 02:01:10,022 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676599270022"}]},"ts":"1676599270022"} 2023-02-17 02:01:10,026 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-17 02:01:10,031 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-17 02:01:10,048 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-17 02:01:10,048 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-17 02:01:10,048 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-17 02:01:10,049 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=60da012c2f8c7fe0ec391ffacffa21f0, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=70f7ef12da22dd3ef39c2af364b54ddd, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=a8930d4446cbfaf62e358646d1db5a41, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=b3da13e5dcdc5200c5067deebd89a3b4, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=3c50622abf2210dda1717f4c123254eb, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=4d5096d14486c6ef9123841c928ad2ea, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=6a46e9ed5ad2c334585050f964998e61, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=b213250f6e3c76397fc5267bf5934c3e, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=4ed625a5af4623dec3e6c74a1f7180c6, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=4fb7511bdaa2707fcc86962500b3c078, ASSIGN}] 2023-02-17 02:01:10,054 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=a8930d4446cbfaf62e358646d1db5a41, ASSIGN 2023-02-17 02:01:10,054 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=3c50622abf2210dda1717f4c123254eb, ASSIGN 2023-02-17 02:01:10,055 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=70f7ef12da22dd3ef39c2af364b54ddd, ASSIGN 2023-02-17 02:01:10,056 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=60da012c2f8c7fe0ec391ffacffa21f0, ASSIGN 2023-02-17 02:01:10,057 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=60da012c2f8c7fe0ec391ffacffa21f0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34495,1676599266651; forceNewPlan=false, retain=false 2023-02-17 02:01:10,057 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=a8930d4446cbfaf62e358646d1db5a41, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37401,1676599266596; forceNewPlan=false, retain=false 2023-02-17 02:01:10,057 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=70f7ef12da22dd3ef39c2af364b54ddd, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37401,1676599266596; forceNewPlan=false, retain=false 2023-02-17 02:01:10,057 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=3c50622abf2210dda1717f4c123254eb, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37401,1676599266596; forceNewPlan=false, retain=false 2023-02-17 02:01:10,060 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=4fb7511bdaa2707fcc86962500b3c078, ASSIGN 2023-02-17 02:01:10,060 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=4ed625a5af4623dec3e6c74a1f7180c6, ASSIGN 2023-02-17 02:01:10,060 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=b213250f6e3c76397fc5267bf5934c3e, ASSIGN 2023-02-17 02:01:10,061 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=6a46e9ed5ad2c334585050f964998e61, ASSIGN 2023-02-17 02:01:10,062 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=4fb7511bdaa2707fcc86962500b3c078, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34495,1676599266651; forceNewPlan=false, retain=false 2023-02-17 02:01:10,062 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=b213250f6e3c76397fc5267bf5934c3e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37401,1676599266596; forceNewPlan=false, retain=false 2023-02-17 02:01:10,062 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=6a46e9ed5ad2c334585050f964998e61, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34495,1676599266651; forceNewPlan=false, retain=false 2023-02-17 02:01:10,062 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=4ed625a5af4623dec3e6c74a1f7180c6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37401,1676599266596; forceNewPlan=false, retain=false 2023-02-17 02:01:10,063 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=4d5096d14486c6ef9123841c928ad2ea, ASSIGN 2023-02-17 02:01:10,065 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=b3da13e5dcdc5200c5067deebd89a3b4, ASSIGN 2023-02-17 02:01:10,065 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=4d5096d14486c6ef9123841c928ad2ea, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34495,1676599266651; forceNewPlan=false, retain=false 2023-02-17 02:01:10,066 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=b3da13e5dcdc5200c5067deebd89a3b4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34495,1676599266651; forceNewPlan=false, retain=false 2023-02-17 02:01:10,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 02:01:10,208 INFO [jenkins-hbase4:39477] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-17 02:01:10,213 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=4ed625a5af4623dec3e6c74a1f7180c6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37401,1676599266596 2023-02-17 02:01:10,213 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=b213250f6e3c76397fc5267bf5934c3e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37401,1676599266596 2023-02-17 02:01:10,213 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=3c50622abf2210dda1717f4c123254eb, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37401,1676599266596 2023-02-17 02:01:10,213 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676599269734.4ed625a5af4623dec3e6c74a1f7180c6.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676599270212"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676599270212"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676599270212"}]},"ts":"1676599270212"} 2023-02-17 02:01:10,213 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676599269734.b213250f6e3c76397fc5267bf5934c3e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676599270212"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676599270212"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676599270212"}]},"ts":"1676599270212"} 2023-02-17 02:01:10,213 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676599269734.3c50622abf2210dda1717f4c123254eb.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676599270212"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676599270212"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676599270212"}]},"ts":"1676599270212"} 2023-02-17 02:01:10,214 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=70f7ef12da22dd3ef39c2af364b54ddd, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37401,1676599266596 2023-02-17 02:01:10,214 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676599269734.70f7ef12da22dd3ef39c2af364b54ddd.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676599270214"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676599270214"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676599270214"}]},"ts":"1676599270214"} 2023-02-17 02:01:10,216 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=a8930d4446cbfaf62e358646d1db5a41, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37401,1676599266596 2023-02-17 02:01:10,216 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676599269734.a8930d4446cbfaf62e358646d1db5a41.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676599270216"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676599270216"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676599270216"}]},"ts":"1676599270216"} 2023-02-17 02:01:10,218 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=19, state=RUNNABLE; OpenRegionProcedure 4ed625a5af4623dec3e6c74a1f7180c6, server=jenkins-hbase4.apache.org,37401,1676599266596}] 2023-02-17 02:01:10,222 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=18, state=RUNNABLE; OpenRegionProcedure b213250f6e3c76397fc5267bf5934c3e, server=jenkins-hbase4.apache.org,37401,1676599266596}] 2023-02-17 02:01:10,224 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=15, state=RUNNABLE; OpenRegionProcedure 3c50622abf2210dda1717f4c123254eb, server=jenkins-hbase4.apache.org,37401,1676599266596}] 2023-02-17 02:01:10,227 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=12, state=RUNNABLE; OpenRegionProcedure 70f7ef12da22dd3ef39c2af364b54ddd, server=jenkins-hbase4.apache.org,37401,1676599266596}] 2023-02-17 02:01:10,228 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=4d5096d14486c6ef9123841c928ad2ea, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34495,1676599266651 2023-02-17 02:01:10,229 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676599269734.4d5096d14486c6ef9123841c928ad2ea.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676599270228"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676599270228"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676599270228"}]},"ts":"1676599270228"} 2023-02-17 02:01:10,230 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=13, state=RUNNABLE; OpenRegionProcedure a8930d4446cbfaf62e358646d1db5a41, server=jenkins-hbase4.apache.org,37401,1676599266596}] 2023-02-17 02:01:10,232 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=16, state=RUNNABLE; OpenRegionProcedure 4d5096d14486c6ef9123841c928ad2ea, server=jenkins-hbase4.apache.org,34495,1676599266651}] 2023-02-17 02:01:10,234 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=b3da13e5dcdc5200c5067deebd89a3b4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34495,1676599266651 2023-02-17 02:01:10,234 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676599269734.b3da13e5dcdc5200c5067deebd89a3b4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676599270234"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676599270234"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676599270234"}]},"ts":"1676599270234"} 2023-02-17 02:01:10,234 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=6a46e9ed5ad2c334585050f964998e61, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34495,1676599266651 2023-02-17 02:01:10,235 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676599269734.6a46e9ed5ad2c334585050f964998e61.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676599270234"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676599270234"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676599270234"}]},"ts":"1676599270234"} 2023-02-17 02:01:10,238 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=60da012c2f8c7fe0ec391ffacffa21f0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34495,1676599266651 2023-02-17 02:01:10,238 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676599269734.60da012c2f8c7fe0ec391ffacffa21f0.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676599270238"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676599270238"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676599270238"}]},"ts":"1676599270238"} 2023-02-17 02:01:10,239 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=14, state=RUNNABLE; OpenRegionProcedure b3da13e5dcdc5200c5067deebd89a3b4, server=jenkins-hbase4.apache.org,34495,1676599266651}] 2023-02-17 02:01:10,242 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=17, state=RUNNABLE; OpenRegionProcedure 6a46e9ed5ad2c334585050f964998e61, server=jenkins-hbase4.apache.org,34495,1676599266651}] 2023-02-17 02:01:10,242 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=4fb7511bdaa2707fcc86962500b3c078, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34495,1676599266651 2023-02-17 02:01:10,242 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676599269734.4fb7511bdaa2707fcc86962500b3c078.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676599270242"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676599270242"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676599270242"}]},"ts":"1676599270242"} 2023-02-17 02:01:10,244 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=11, state=RUNNABLE; OpenRegionProcedure 60da012c2f8c7fe0ec391ffacffa21f0, server=jenkins-hbase4.apache.org,34495,1676599266651}] 2023-02-17 02:01:10,250 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=20, state=RUNNABLE; OpenRegionProcedure 4fb7511bdaa2707fcc86962500b3c078, server=jenkins-hbase4.apache.org,34495,1676599266651}] 2023-02-17 02:01:10,382 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1676599269734.3c50622abf2210dda1717f4c123254eb. 2023-02-17 02:01:10,382 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3c50622abf2210dda1717f4c123254eb, NAME => 'testWithMapReduce,j\xCA\xCA,1676599269734.3c50622abf2210dda1717f4c123254eb.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-17 02:01:10,382 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 3c50622abf2210dda1717f4c123254eb 2023-02-17 02:01:10,383 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676599269734.3c50622abf2210dda1717f4c123254eb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:10,383 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 3c50622abf2210dda1717f4c123254eb 2023-02-17 02:01:10,383 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 3c50622abf2210dda1717f4c123254eb 2023-02-17 02:01:10,385 INFO [StoreOpener-3c50622abf2210dda1717f4c123254eb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3c50622abf2210dda1717f4c123254eb 2023-02-17 02:01:10,387 DEBUG [StoreOpener-3c50622abf2210dda1717f4c123254eb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/3c50622abf2210dda1717f4c123254eb/f1 2023-02-17 02:01:10,387 DEBUG [StoreOpener-3c50622abf2210dda1717f4c123254eb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/3c50622abf2210dda1717f4c123254eb/f1 2023-02-17 02:01:10,388 INFO [StoreOpener-3c50622abf2210dda1717f4c123254eb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3c50622abf2210dda1717f4c123254eb columnFamilyName f1 2023-02-17 02:01:10,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 02:01:10,389 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,34495,1676599266651 2023-02-17 02:01:10,391 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-17 02:01:10,392 INFO [StoreOpener-3c50622abf2210dda1717f4c123254eb-1] regionserver.HStore(310): Store=3c50622abf2210dda1717f4c123254eb/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:10,392 INFO [StoreOpener-3c50622abf2210dda1717f4c123254eb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3c50622abf2210dda1717f4c123254eb 2023-02-17 02:01:10,394 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38984, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-17 02:01:10,397 DEBUG [StoreOpener-3c50622abf2210dda1717f4c123254eb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/3c50622abf2210dda1717f4c123254eb/f2 2023-02-17 02:01:10,397 DEBUG [StoreOpener-3c50622abf2210dda1717f4c123254eb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/3c50622abf2210dda1717f4c123254eb/f2 2023-02-17 02:01:10,397 INFO [StoreOpener-3c50622abf2210dda1717f4c123254eb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3c50622abf2210dda1717f4c123254eb columnFamilyName f2 2023-02-17 02:01:10,398 INFO [StoreOpener-3c50622abf2210dda1717f4c123254eb-1] regionserver.HStore(310): Store=3c50622abf2210dda1717f4c123254eb/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:10,406 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1676599269734.4fb7511bdaa2707fcc86962500b3c078. 2023-02-17 02:01:10,407 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4fb7511bdaa2707fcc86962500b3c078, NAME => 'testWithMapReduce,zz{,1676599269734.4fb7511bdaa2707fcc86962500b3c078.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-17 02:01:10,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/3c50622abf2210dda1717f4c123254eb 2023-02-17 02:01:10,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 4fb7511bdaa2707fcc86962500b3c078 2023-02-17 02:01:10,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676599269734.4fb7511bdaa2707fcc86962500b3c078.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:10,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 4fb7511bdaa2707fcc86962500b3c078 2023-02-17 02:01:10,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 4fb7511bdaa2707fcc86962500b3c078 2023-02-17 02:01:10,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/3c50622abf2210dda1717f4c123254eb 2023-02-17 02:01:10,410 INFO [StoreOpener-4fb7511bdaa2707fcc86962500b3c078-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4fb7511bdaa2707fcc86962500b3c078 2023-02-17 02:01:10,413 DEBUG [StoreOpener-4fb7511bdaa2707fcc86962500b3c078-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/4fb7511bdaa2707fcc86962500b3c078/f1 2023-02-17 02:01:10,413 DEBUG [StoreOpener-4fb7511bdaa2707fcc86962500b3c078-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/4fb7511bdaa2707fcc86962500b3c078/f1 2023-02-17 02:01:10,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 02:01:10,413 INFO [StoreOpener-4fb7511bdaa2707fcc86962500b3c078-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4fb7511bdaa2707fcc86962500b3c078 columnFamilyName f1 2023-02-17 02:01:10,414 INFO [StoreOpener-4fb7511bdaa2707fcc86962500b3c078-1] regionserver.HStore(310): Store=4fb7511bdaa2707fcc86962500b3c078/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:10,414 INFO [StoreOpener-4fb7511bdaa2707fcc86962500b3c078-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4fb7511bdaa2707fcc86962500b3c078 2023-02-17 02:01:10,416 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 3c50622abf2210dda1717f4c123254eb 2023-02-17 02:01:10,417 DEBUG [StoreOpener-4fb7511bdaa2707fcc86962500b3c078-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/4fb7511bdaa2707fcc86962500b3c078/f2 2023-02-17 02:01:10,417 DEBUG [StoreOpener-4fb7511bdaa2707fcc86962500b3c078-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/4fb7511bdaa2707fcc86962500b3c078/f2 2023-02-17 02:01:10,418 INFO [StoreOpener-4fb7511bdaa2707fcc86962500b3c078-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4fb7511bdaa2707fcc86962500b3c078 columnFamilyName f2 2023-02-17 02:01:10,419 INFO [StoreOpener-4fb7511bdaa2707fcc86962500b3c078-1] regionserver.HStore(310): Store=4fb7511bdaa2707fcc86962500b3c078/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:10,420 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/3c50622abf2210dda1717f4c123254eb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 02:01:10,422 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 3c50622abf2210dda1717f4c123254eb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68927176, jitterRate=0.02709496021270752}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 02:01:10,422 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 3c50622abf2210dda1717f4c123254eb: 2023-02-17 02:01:10,422 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/4fb7511bdaa2707fcc86962500b3c078 2023-02-17 02:01:10,423 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1676599269734.3c50622abf2210dda1717f4c123254eb., pid=23, masterSystemTime=1676599270373 2023-02-17 02:01:10,424 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/4fb7511bdaa2707fcc86962500b3c078 2023-02-17 02:01:10,427 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1676599269734.3c50622abf2210dda1717f4c123254eb. 2023-02-17 02:01:10,427 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1676599269734.3c50622abf2210dda1717f4c123254eb. 2023-02-17 02:01:10,427 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1676599269734.b213250f6e3c76397fc5267bf5934c3e. 2023-02-17 02:01:10,428 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => b213250f6e3c76397fc5267bf5934c3e, NAME => 'testWithMapReduce,t43,1676599269734.b213250f6e3c76397fc5267bf5934c3e.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-17 02:01:10,428 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce b213250f6e3c76397fc5267bf5934c3e 2023-02-17 02:01:10,428 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676599269734.b213250f6e3c76397fc5267bf5934c3e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:10,428 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for b213250f6e3c76397fc5267bf5934c3e 2023-02-17 02:01:10,428 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for b213250f6e3c76397fc5267bf5934c3e 2023-02-17 02:01:10,433 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 02:01:10,438 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 4fb7511bdaa2707fcc86962500b3c078 2023-02-17 02:01:10,441 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=3c50622abf2210dda1717f4c123254eb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37401,1676599266596 2023-02-17 02:01:10,442 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1676599269734.3c50622abf2210dda1717f4c123254eb.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676599270441"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676599270441"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676599270441"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676599270441"}]},"ts":"1676599270441"} 2023-02-17 02:01:10,446 INFO [StoreOpener-b213250f6e3c76397fc5267bf5934c3e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b213250f6e3c76397fc5267bf5934c3e 2023-02-17 02:01:10,447 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/4fb7511bdaa2707fcc86962500b3c078/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 02:01:10,451 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 4fb7511bdaa2707fcc86962500b3c078; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67167642, jitterRate=8.758604526519775E-4}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 02:01:10,451 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 4fb7511bdaa2707fcc86962500b3c078: 2023-02-17 02:01:10,452 DEBUG [StoreOpener-b213250f6e3c76397fc5267bf5934c3e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/b213250f6e3c76397fc5267bf5934c3e/f1 2023-02-17 02:01:10,454 DEBUG [StoreOpener-b213250f6e3c76397fc5267bf5934c3e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/b213250f6e3c76397fc5267bf5934c3e/f1 2023-02-17 02:01:10,453 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=15 2023-02-17 02:01:10,455 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=15, state=SUCCESS; OpenRegionProcedure 3c50622abf2210dda1717f4c123254eb, server=jenkins-hbase4.apache.org,37401,1676599266596 in 223 msec 2023-02-17 02:01:10,453 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1676599269734.4fb7511bdaa2707fcc86962500b3c078., pid=30, masterSystemTime=1676599270389 2023-02-17 02:01:10,457 INFO [StoreOpener-b213250f6e3c76397fc5267bf5934c3e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b213250f6e3c76397fc5267bf5934c3e columnFamilyName f1 2023-02-17 02:01:10,458 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=3c50622abf2210dda1717f4c123254eb, ASSIGN in 406 msec 2023-02-17 02:01:10,460 INFO [StoreOpener-b213250f6e3c76397fc5267bf5934c3e-1] regionserver.HStore(310): Store=b213250f6e3c76397fc5267bf5934c3e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:10,461 INFO [StoreOpener-b213250f6e3c76397fc5267bf5934c3e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b213250f6e3c76397fc5267bf5934c3e 2023-02-17 02:01:10,463 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1676599269734.4fb7511bdaa2707fcc86962500b3c078. 2023-02-17 02:01:10,464 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1676599269734.4fb7511bdaa2707fcc86962500b3c078. 2023-02-17 02:01:10,464 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676599269734.60da012c2f8c7fe0ec391ffacffa21f0. 2023-02-17 02:01:10,465 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 60da012c2f8c7fe0ec391ffacffa21f0, NAME => 'testWithMapReduce,,1676599269734.60da012c2f8c7fe0ec391ffacffa21f0.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-17 02:01:10,465 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=4fb7511bdaa2707fcc86962500b3c078, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34495,1676599266651 2023-02-17 02:01:10,465 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 60da012c2f8c7fe0ec391ffacffa21f0 2023-02-17 02:01:10,465 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1676599269734.4fb7511bdaa2707fcc86962500b3c078.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676599270464"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676599270464"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676599270464"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676599270464"}]},"ts":"1676599270464"} 2023-02-17 02:01:10,465 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676599269734.60da012c2f8c7fe0ec391ffacffa21f0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:10,465 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 60da012c2f8c7fe0ec391ffacffa21f0 2023-02-17 02:01:10,465 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 60da012c2f8c7fe0ec391ffacffa21f0 2023-02-17 02:01:10,466 DEBUG [StoreOpener-b213250f6e3c76397fc5267bf5934c3e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/b213250f6e3c76397fc5267bf5934c3e/f2 2023-02-17 02:01:10,467 DEBUG [StoreOpener-b213250f6e3c76397fc5267bf5934c3e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/b213250f6e3c76397fc5267bf5934c3e/f2 2023-02-17 02:01:10,468 INFO [StoreOpener-b213250f6e3c76397fc5267bf5934c3e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b213250f6e3c76397fc5267bf5934c3e columnFamilyName f2 2023-02-17 02:01:10,471 INFO [StoreOpener-60da012c2f8c7fe0ec391ffacffa21f0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 60da012c2f8c7fe0ec391ffacffa21f0 2023-02-17 02:01:10,472 INFO [StoreOpener-b213250f6e3c76397fc5267bf5934c3e-1] regionserver.HStore(310): Store=b213250f6e3c76397fc5267bf5934c3e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:10,474 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=20 2023-02-17 02:01:10,474 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=20, state=SUCCESS; OpenRegionProcedure 4fb7511bdaa2707fcc86962500b3c078, server=jenkins-hbase4.apache.org,34495,1676599266651 in 219 msec 2023-02-17 02:01:10,475 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/b213250f6e3c76397fc5267bf5934c3e 2023-02-17 02:01:10,476 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/b213250f6e3c76397fc5267bf5934c3e 2023-02-17 02:01:10,476 DEBUG [StoreOpener-60da012c2f8c7fe0ec391ffacffa21f0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/60da012c2f8c7fe0ec391ffacffa21f0/f1 2023-02-17 02:01:10,476 DEBUG [StoreOpener-60da012c2f8c7fe0ec391ffacffa21f0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/60da012c2f8c7fe0ec391ffacffa21f0/f1 2023-02-17 02:01:10,478 INFO [StoreOpener-60da012c2f8c7fe0ec391ffacffa21f0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 60da012c2f8c7fe0ec391ffacffa21f0 columnFamilyName f1 2023-02-17 02:01:10,479 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=4fb7511bdaa2707fcc86962500b3c078, ASSIGN in 426 msec 2023-02-17 02:01:10,480 INFO [StoreOpener-60da012c2f8c7fe0ec391ffacffa21f0-1] regionserver.HStore(310): Store=60da012c2f8c7fe0ec391ffacffa21f0/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:10,480 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 02:01:10,480 INFO [StoreOpener-60da012c2f8c7fe0ec391ffacffa21f0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 60da012c2f8c7fe0ec391ffacffa21f0 2023-02-17 02:01:10,483 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for b213250f6e3c76397fc5267bf5934c3e 2023-02-17 02:01:10,489 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/b213250f6e3c76397fc5267bf5934c3e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 02:01:10,490 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened b213250f6e3c76397fc5267bf5934c3e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70285168, jitterRate=0.047330617904663086}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 02:01:10,490 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for b213250f6e3c76397fc5267bf5934c3e: 2023-02-17 02:01:10,491 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1676599269734.b213250f6e3c76397fc5267bf5934c3e., pid=22, masterSystemTime=1676599270373 2023-02-17 02:01:10,495 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1676599269734.b213250f6e3c76397fc5267bf5934c3e. 2023-02-17 02:01:10,495 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1676599269734.b213250f6e3c76397fc5267bf5934c3e. 2023-02-17 02:01:10,495 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1676599269734.4ed625a5af4623dec3e6c74a1f7180c6. 2023-02-17 02:01:10,495 DEBUG [StoreOpener-60da012c2f8c7fe0ec391ffacffa21f0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/60da012c2f8c7fe0ec391ffacffa21f0/f2 2023-02-17 02:01:10,495 DEBUG [StoreOpener-60da012c2f8c7fe0ec391ffacffa21f0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/60da012c2f8c7fe0ec391ffacffa21f0/f2 2023-02-17 02:01:10,495 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4ed625a5af4623dec3e6c74a1f7180c6, NAME => 'testWithMapReduce,wWV,1676599269734.4ed625a5af4623dec3e6c74a1f7180c6.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-17 02:01:10,496 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 4ed625a5af4623dec3e6c74a1f7180c6 2023-02-17 02:01:10,496 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676599269734.4ed625a5af4623dec3e6c74a1f7180c6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:10,496 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 4ed625a5af4623dec3e6c74a1f7180c6 2023-02-17 02:01:10,496 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 4ed625a5af4623dec3e6c74a1f7180c6 2023-02-17 02:01:10,497 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=b213250f6e3c76397fc5267bf5934c3e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37401,1676599266596 2023-02-17 02:01:10,497 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1676599269734.b213250f6e3c76397fc5267bf5934c3e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676599270497"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676599270497"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676599270497"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676599270497"}]},"ts":"1676599270497"} 2023-02-17 02:01:10,497 INFO [StoreOpener-60da012c2f8c7fe0ec391ffacffa21f0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 60da012c2f8c7fe0ec391ffacffa21f0 columnFamilyName f2 2023-02-17 02:01:10,498 INFO [StoreOpener-60da012c2f8c7fe0ec391ffacffa21f0-1] regionserver.HStore(310): Store=60da012c2f8c7fe0ec391ffacffa21f0/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:10,500 INFO [StoreOpener-4ed625a5af4623dec3e6c74a1f7180c6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4ed625a5af4623dec3e6c74a1f7180c6 2023-02-17 02:01:10,502 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/60da012c2f8c7fe0ec391ffacffa21f0 2023-02-17 02:01:10,503 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/60da012c2f8c7fe0ec391ffacffa21f0 2023-02-17 02:01:10,507 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=18 2023-02-17 02:01:10,507 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=18, state=SUCCESS; OpenRegionProcedure b213250f6e3c76397fc5267bf5934c3e, server=jenkins-hbase4.apache.org,37401,1676599266596 in 278 msec 2023-02-17 02:01:10,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 02:01:10,510 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=b213250f6e3c76397fc5267bf5934c3e, ASSIGN in 459 msec 2023-02-17 02:01:10,511 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 60da012c2f8c7fe0ec391ffacffa21f0 2023-02-17 02:01:10,512 DEBUG [StoreOpener-4ed625a5af4623dec3e6c74a1f7180c6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/4ed625a5af4623dec3e6c74a1f7180c6/f1 2023-02-17 02:01:10,512 DEBUG [StoreOpener-4ed625a5af4623dec3e6c74a1f7180c6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/4ed625a5af4623dec3e6c74a1f7180c6/f1 2023-02-17 02:01:10,513 INFO [StoreOpener-4ed625a5af4623dec3e6c74a1f7180c6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4ed625a5af4623dec3e6c74a1f7180c6 columnFamilyName f1 2023-02-17 02:01:10,514 INFO [StoreOpener-4ed625a5af4623dec3e6c74a1f7180c6-1] regionserver.HStore(310): Store=4ed625a5af4623dec3e6c74a1f7180c6/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:10,514 INFO [StoreOpener-4ed625a5af4623dec3e6c74a1f7180c6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4ed625a5af4623dec3e6c74a1f7180c6 2023-02-17 02:01:10,515 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/60da012c2f8c7fe0ec391ffacffa21f0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 02:01:10,516 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 60da012c2f8c7fe0ec391ffacffa21f0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67225170, jitterRate=0.0017330944538116455}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 02:01:10,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 60da012c2f8c7fe0ec391ffacffa21f0: 2023-02-17 02:01:10,517 DEBUG [StoreOpener-4ed625a5af4623dec3e6c74a1f7180c6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/4ed625a5af4623dec3e6c74a1f7180c6/f2 2023-02-17 02:01:10,517 DEBUG [StoreOpener-4ed625a5af4623dec3e6c74a1f7180c6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/4ed625a5af4623dec3e6c74a1f7180c6/f2 2023-02-17 02:01:10,517 INFO [StoreOpener-4ed625a5af4623dec3e6c74a1f7180c6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4ed625a5af4623dec3e6c74a1f7180c6 columnFamilyName f2 2023-02-17 02:01:10,518 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676599269734.60da012c2f8c7fe0ec391ffacffa21f0., pid=29, masterSystemTime=1676599270389 2023-02-17 02:01:10,518 INFO [StoreOpener-4ed625a5af4623dec3e6c74a1f7180c6-1] regionserver.HStore(310): Store=4ed625a5af4623dec3e6c74a1f7180c6/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:10,520 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/4ed625a5af4623dec3e6c74a1f7180c6 2023-02-17 02:01:10,521 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/4ed625a5af4623dec3e6c74a1f7180c6 2023-02-17 02:01:10,522 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676599269734.60da012c2f8c7fe0ec391ffacffa21f0. 2023-02-17 02:01:10,522 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676599269734.60da012c2f8c7fe0ec391ffacffa21f0. 2023-02-17 02:01:10,522 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1676599269734.4d5096d14486c6ef9123841c928ad2ea. 2023-02-17 02:01:10,522 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4d5096d14486c6ef9123841c928ad2ea, NAME => 'testWithMapReduce,m\xED\xED,1676599269734.4d5096d14486c6ef9123841c928ad2ea.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-17 02:01:10,522 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 4d5096d14486c6ef9123841c928ad2ea 2023-02-17 02:01:10,522 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676599269734.4d5096d14486c6ef9123841c928ad2ea.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:10,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 4d5096d14486c6ef9123841c928ad2ea 2023-02-17 02:01:10,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 4d5096d14486c6ef9123841c928ad2ea 2023-02-17 02:01:10,523 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=60da012c2f8c7fe0ec391ffacffa21f0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34495,1676599266651 2023-02-17 02:01:10,523 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676599269734.60da012c2f8c7fe0ec391ffacffa21f0.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676599270523"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676599270523"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676599270523"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676599270523"}]},"ts":"1676599270523"} 2023-02-17 02:01:10,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 02:01:10,526 INFO [StoreOpener-4d5096d14486c6ef9123841c928ad2ea-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4d5096d14486c6ef9123841c928ad2ea 2023-02-17 02:01:10,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 4ed625a5af4623dec3e6c74a1f7180c6 2023-02-17 02:01:10,532 DEBUG [StoreOpener-4d5096d14486c6ef9123841c928ad2ea-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/4d5096d14486c6ef9123841c928ad2ea/f1 2023-02-17 02:01:10,532 DEBUG [StoreOpener-4d5096d14486c6ef9123841c928ad2ea-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/4d5096d14486c6ef9123841c928ad2ea/f1 2023-02-17 02:01:10,532 INFO [StoreOpener-4d5096d14486c6ef9123841c928ad2ea-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4d5096d14486c6ef9123841c928ad2ea columnFamilyName f1 2023-02-17 02:01:10,532 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/4ed625a5af4623dec3e6c74a1f7180c6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 02:01:10,533 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=11 2023-02-17 02:01:10,533 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=11, state=SUCCESS; OpenRegionProcedure 60da012c2f8c7fe0ec391ffacffa21f0, server=jenkins-hbase4.apache.org,34495,1676599266651 in 284 msec 2023-02-17 02:01:10,534 INFO [StoreOpener-4d5096d14486c6ef9123841c928ad2ea-1] regionserver.HStore(310): Store=4d5096d14486c6ef9123841c928ad2ea/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:10,534 INFO [StoreOpener-4d5096d14486c6ef9123841c928ad2ea-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4d5096d14486c6ef9123841c928ad2ea 2023-02-17 02:01:10,534 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 4ed625a5af4623dec3e6c74a1f7180c6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73847325, jitterRate=0.10041089355945587}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 02:01:10,534 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 4ed625a5af4623dec3e6c74a1f7180c6: 2023-02-17 02:01:10,536 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=60da012c2f8c7fe0ec391ffacffa21f0, ASSIGN in 485 msec 2023-02-17 02:01:10,536 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1676599269734.4ed625a5af4623dec3e6c74a1f7180c6., pid=21, masterSystemTime=1676599270373 2023-02-17 02:01:10,538 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1676599269734.4ed625a5af4623dec3e6c74a1f7180c6. 2023-02-17 02:01:10,539 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1676599269734.4ed625a5af4623dec3e6c74a1f7180c6. 2023-02-17 02:01:10,539 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1676599269734.a8930d4446cbfaf62e358646d1db5a41. 2023-02-17 02:01:10,539 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=4ed625a5af4623dec3e6c74a1f7180c6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37401,1676599266596 2023-02-17 02:01:10,539 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1676599269734.4ed625a5af4623dec3e6c74a1f7180c6.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676599270539"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676599270539"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676599270539"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676599270539"}]},"ts":"1676599270539"} 2023-02-17 02:01:10,540 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => a8930d4446cbfaf62e358646d1db5a41, NAME => 'testWithMapReduce,d\x84\x84,1676599269734.a8930d4446cbfaf62e358646d1db5a41.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-17 02:01:10,540 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce a8930d4446cbfaf62e358646d1db5a41 2023-02-17 02:01:10,540 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676599269734.a8930d4446cbfaf62e358646d1db5a41.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:10,540 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for a8930d4446cbfaf62e358646d1db5a41 2023-02-17 02:01:10,540 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for a8930d4446cbfaf62e358646d1db5a41 2023-02-17 02:01:10,543 INFO [StoreOpener-a8930d4446cbfaf62e358646d1db5a41-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a8930d4446cbfaf62e358646d1db5a41 2023-02-17 02:01:10,545 DEBUG [StoreOpener-4d5096d14486c6ef9123841c928ad2ea-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/4d5096d14486c6ef9123841c928ad2ea/f2 2023-02-17 02:01:10,545 DEBUG [StoreOpener-4d5096d14486c6ef9123841c928ad2ea-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/4d5096d14486c6ef9123841c928ad2ea/f2 2023-02-17 02:01:10,546 DEBUG [StoreOpener-a8930d4446cbfaf62e358646d1db5a41-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/a8930d4446cbfaf62e358646d1db5a41/f1 2023-02-17 02:01:10,546 DEBUG [StoreOpener-a8930d4446cbfaf62e358646d1db5a41-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/a8930d4446cbfaf62e358646d1db5a41/f1 2023-02-17 02:01:10,546 INFO [StoreOpener-4d5096d14486c6ef9123841c928ad2ea-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4d5096d14486c6ef9123841c928ad2ea columnFamilyName f2 2023-02-17 02:01:10,546 INFO [StoreOpener-a8930d4446cbfaf62e358646d1db5a41-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a8930d4446cbfaf62e358646d1db5a41 columnFamilyName f1 2023-02-17 02:01:10,547 INFO [StoreOpener-4d5096d14486c6ef9123841c928ad2ea-1] regionserver.HStore(310): Store=4d5096d14486c6ef9123841c928ad2ea/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:10,550 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/4d5096d14486c6ef9123841c928ad2ea 2023-02-17 02:01:10,551 INFO [StoreOpener-a8930d4446cbfaf62e358646d1db5a41-1] regionserver.HStore(310): Store=a8930d4446cbfaf62e358646d1db5a41/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:10,551 INFO [StoreOpener-a8930d4446cbfaf62e358646d1db5a41-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a8930d4446cbfaf62e358646d1db5a41 2023-02-17 02:01:10,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/4d5096d14486c6ef9123841c928ad2ea 2023-02-17 02:01:10,554 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=19 2023-02-17 02:01:10,554 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=19, state=SUCCESS; OpenRegionProcedure 4ed625a5af4623dec3e6c74a1f7180c6, server=jenkins-hbase4.apache.org,37401,1676599266596 in 324 msec 2023-02-17 02:01:10,555 DEBUG [StoreOpener-a8930d4446cbfaf62e358646d1db5a41-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/a8930d4446cbfaf62e358646d1db5a41/f2 2023-02-17 02:01:10,555 DEBUG [StoreOpener-a8930d4446cbfaf62e358646d1db5a41-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/a8930d4446cbfaf62e358646d1db5a41/f2 2023-02-17 02:01:10,556 INFO [StoreOpener-a8930d4446cbfaf62e358646d1db5a41-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a8930d4446cbfaf62e358646d1db5a41 columnFamilyName f2 2023-02-17 02:01:10,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 02:01:10,556 INFO [StoreOpener-a8930d4446cbfaf62e358646d1db5a41-1] regionserver.HStore(310): Store=a8930d4446cbfaf62e358646d1db5a41/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:10,560 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 4d5096d14486c6ef9123841c928ad2ea 2023-02-17 02:01:10,561 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=4ed625a5af4623dec3e6c74a1f7180c6, ASSIGN in 506 msec 2023-02-17 02:01:10,563 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/4d5096d14486c6ef9123841c928ad2ea/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 02:01:10,564 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 4d5096d14486c6ef9123841c928ad2ea; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71314577, jitterRate=0.06267000734806061}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 02:01:10,564 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 4d5096d14486c6ef9123841c928ad2ea: 2023-02-17 02:01:10,565 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/a8930d4446cbfaf62e358646d1db5a41 2023-02-17 02:01:10,565 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1676599269734.4d5096d14486c6ef9123841c928ad2ea., pid=26, masterSystemTime=1676599270389 2023-02-17 02:01:10,565 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/a8930d4446cbfaf62e358646d1db5a41 2023-02-17 02:01:10,569 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1676599269734.4d5096d14486c6ef9123841c928ad2ea. 2023-02-17 02:01:10,569 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1676599269734.4d5096d14486c6ef9123841c928ad2ea. 2023-02-17 02:01:10,569 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1676599269734.b3da13e5dcdc5200c5067deebd89a3b4. 2023-02-17 02:01:10,569 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 02:01:10,569 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => b3da13e5dcdc5200c5067deebd89a3b4, NAME => 'testWithMapReduce,g\xA7\xA7,1676599269734.b3da13e5dcdc5200c5067deebd89a3b4.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-17 02:01:10,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce b3da13e5dcdc5200c5067deebd89a3b4 2023-02-17 02:01:10,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676599269734.b3da13e5dcdc5200c5067deebd89a3b4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:10,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for b3da13e5dcdc5200c5067deebd89a3b4 2023-02-17 02:01:10,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for b3da13e5dcdc5200c5067deebd89a3b4 2023-02-17 02:01:10,570 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=4d5096d14486c6ef9123841c928ad2ea, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34495,1676599266651 2023-02-17 02:01:10,570 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1676599269734.4d5096d14486c6ef9123841c928ad2ea.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676599270570"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676599270570"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676599270570"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676599270570"}]},"ts":"1676599270570"} 2023-02-17 02:01:10,573 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for a8930d4446cbfaf62e358646d1db5a41 2023-02-17 02:01:10,576 INFO [StoreOpener-b3da13e5dcdc5200c5067deebd89a3b4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b3da13e5dcdc5200c5067deebd89a3b4 2023-02-17 02:01:10,580 DEBUG [StoreOpener-b3da13e5dcdc5200c5067deebd89a3b4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/b3da13e5dcdc5200c5067deebd89a3b4/f1 2023-02-17 02:01:10,580 DEBUG [StoreOpener-b3da13e5dcdc5200c5067deebd89a3b4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/b3da13e5dcdc5200c5067deebd89a3b4/f1 2023-02-17 02:01:10,581 INFO [StoreOpener-b3da13e5dcdc5200c5067deebd89a3b4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b3da13e5dcdc5200c5067deebd89a3b4 columnFamilyName f1 2023-02-17 02:01:10,582 INFO [StoreOpener-b3da13e5dcdc5200c5067deebd89a3b4-1] regionserver.HStore(310): Store=b3da13e5dcdc5200c5067deebd89a3b4/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:10,582 INFO [StoreOpener-b3da13e5dcdc5200c5067deebd89a3b4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b3da13e5dcdc5200c5067deebd89a3b4 2023-02-17 02:01:10,585 DEBUG [StoreOpener-b3da13e5dcdc5200c5067deebd89a3b4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/b3da13e5dcdc5200c5067deebd89a3b4/f2 2023-02-17 02:01:10,585 DEBUG [StoreOpener-b3da13e5dcdc5200c5067deebd89a3b4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/b3da13e5dcdc5200c5067deebd89a3b4/f2 2023-02-17 02:01:10,585 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=16 2023-02-17 02:01:10,585 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=16, state=SUCCESS; OpenRegionProcedure 4d5096d14486c6ef9123841c928ad2ea, server=jenkins-hbase4.apache.org,34495,1676599266651 in 348 msec 2023-02-17 02:01:10,586 INFO [StoreOpener-b3da13e5dcdc5200c5067deebd89a3b4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b3da13e5dcdc5200c5067deebd89a3b4 columnFamilyName f2 2023-02-17 02:01:10,586 INFO [StoreOpener-b3da13e5dcdc5200c5067deebd89a3b4-1] regionserver.HStore(310): Store=b3da13e5dcdc5200c5067deebd89a3b4/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:10,588 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=4d5096d14486c6ef9123841c928ad2ea, ASSIGN in 538 msec 2023-02-17 02:01:10,594 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/a8930d4446cbfaf62e358646d1db5a41/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 02:01:10,594 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/b3da13e5dcdc5200c5067deebd89a3b4 2023-02-17 02:01:10,594 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened a8930d4446cbfaf62e358646d1db5a41; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64204785, jitterRate=-0.04327414929866791}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 02:01:10,594 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/b3da13e5dcdc5200c5067deebd89a3b4 2023-02-17 02:01:10,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for a8930d4446cbfaf62e358646d1db5a41: 2023-02-17 02:01:10,601 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 02:01:10,602 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1676599269734.a8930d4446cbfaf62e358646d1db5a41., pid=25, masterSystemTime=1676599270373 2023-02-17 02:01:10,604 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for b3da13e5dcdc5200c5067deebd89a3b4 2023-02-17 02:01:10,606 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=a8930d4446cbfaf62e358646d1db5a41, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37401,1676599266596 2023-02-17 02:01:10,607 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1676599269734.a8930d4446cbfaf62e358646d1db5a41.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676599270606"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676599270606"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676599270606"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676599270606"}]},"ts":"1676599270606"} 2023-02-17 02:01:10,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1676599269734.a8930d4446cbfaf62e358646d1db5a41. 2023-02-17 02:01:10,607 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1676599269734.a8930d4446cbfaf62e358646d1db5a41. 2023-02-17 02:01:10,607 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1676599269734.70f7ef12da22dd3ef39c2af364b54ddd. 2023-02-17 02:01:10,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 70f7ef12da22dd3ef39c2af364b54ddd, NAME => 'testWithMapReduce,aaa,1676599269734.70f7ef12da22dd3ef39c2af364b54ddd.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-17 02:01:10,609 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 70f7ef12da22dd3ef39c2af364b54ddd 2023-02-17 02:01:10,609 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676599269734.70f7ef12da22dd3ef39c2af364b54ddd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:10,609 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 70f7ef12da22dd3ef39c2af364b54ddd 2023-02-17 02:01:10,609 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 70f7ef12da22dd3ef39c2af364b54ddd 2023-02-17 02:01:10,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/b3da13e5dcdc5200c5067deebd89a3b4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 02:01:10,612 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened b3da13e5dcdc5200c5067deebd89a3b4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62895387, jitterRate=-0.06278569996356964}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 02:01:10,612 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for b3da13e5dcdc5200c5067deebd89a3b4: 2023-02-17 02:01:10,613 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1676599269734.b3da13e5dcdc5200c5067deebd89a3b4., pid=27, masterSystemTime=1676599270389 2023-02-17 02:01:10,614 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=13 2023-02-17 02:01:10,615 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=13, state=SUCCESS; OpenRegionProcedure a8930d4446cbfaf62e358646d1db5a41, server=jenkins-hbase4.apache.org,37401,1676599266596 in 380 msec 2023-02-17 02:01:10,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1676599269734.b3da13e5dcdc5200c5067deebd89a3b4. 2023-02-17 02:01:10,616 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1676599269734.b3da13e5dcdc5200c5067deebd89a3b4. 2023-02-17 02:01:10,617 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1676599269734.6a46e9ed5ad2c334585050f964998e61. 2023-02-17 02:01:10,617 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 6a46e9ed5ad2c334585050f964998e61, NAME => 'testWithMapReduce,q\x11\x10,1676599269734.6a46e9ed5ad2c334585050f964998e61.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-17 02:01:10,617 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 6a46e9ed5ad2c334585050f964998e61 2023-02-17 02:01:10,617 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676599269734.6a46e9ed5ad2c334585050f964998e61.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:10,618 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 6a46e9ed5ad2c334585050f964998e61 2023-02-17 02:01:10,618 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 6a46e9ed5ad2c334585050f964998e61 2023-02-17 02:01:10,619 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=a8930d4446cbfaf62e358646d1db5a41, ASSIGN in 567 msec 2023-02-17 02:01:10,620 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=b3da13e5dcdc5200c5067deebd89a3b4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34495,1676599266651 2023-02-17 02:01:10,620 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1676599269734.b3da13e5dcdc5200c5067deebd89a3b4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676599270619"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676599270619"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676599270619"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676599270619"}]},"ts":"1676599270619"} 2023-02-17 02:01:10,627 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=14 2023-02-17 02:01:10,627 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=14, state=SUCCESS; OpenRegionProcedure b3da13e5dcdc5200c5067deebd89a3b4, server=jenkins-hbase4.apache.org,34495,1676599266651 in 384 msec 2023-02-17 02:01:10,629 INFO [StoreOpener-6a46e9ed5ad2c334585050f964998e61-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 6a46e9ed5ad2c334585050f964998e61 2023-02-17 02:01:10,629 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=b3da13e5dcdc5200c5067deebd89a3b4, ASSIGN in 579 msec 2023-02-17 02:01:10,632 DEBUG [StoreOpener-6a46e9ed5ad2c334585050f964998e61-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/6a46e9ed5ad2c334585050f964998e61/f1 2023-02-17 02:01:10,632 DEBUG [StoreOpener-6a46e9ed5ad2c334585050f964998e61-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/6a46e9ed5ad2c334585050f964998e61/f1 2023-02-17 02:01:10,632 INFO [StoreOpener-70f7ef12da22dd3ef39c2af364b54ddd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 70f7ef12da22dd3ef39c2af364b54ddd 2023-02-17 02:01:10,633 INFO [StoreOpener-6a46e9ed5ad2c334585050f964998e61-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6a46e9ed5ad2c334585050f964998e61 columnFamilyName f1 2023-02-17 02:01:10,634 DEBUG [StoreOpener-70f7ef12da22dd3ef39c2af364b54ddd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/70f7ef12da22dd3ef39c2af364b54ddd/f1 2023-02-17 02:01:10,634 INFO [StoreOpener-6a46e9ed5ad2c334585050f964998e61-1] regionserver.HStore(310): Store=6a46e9ed5ad2c334585050f964998e61/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:10,634 DEBUG [StoreOpener-70f7ef12da22dd3ef39c2af364b54ddd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/70f7ef12da22dd3ef39c2af364b54ddd/f1 2023-02-17 02:01:10,635 INFO [StoreOpener-6a46e9ed5ad2c334585050f964998e61-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 6a46e9ed5ad2c334585050f964998e61 2023-02-17 02:01:10,635 INFO [StoreOpener-70f7ef12da22dd3ef39c2af364b54ddd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 70f7ef12da22dd3ef39c2af364b54ddd columnFamilyName f1 2023-02-17 02:01:10,636 INFO [StoreOpener-70f7ef12da22dd3ef39c2af364b54ddd-1] regionserver.HStore(310): Store=70f7ef12da22dd3ef39c2af364b54ddd/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:10,636 INFO [StoreOpener-70f7ef12da22dd3ef39c2af364b54ddd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 70f7ef12da22dd3ef39c2af364b54ddd 2023-02-17 02:01:10,638 DEBUG [StoreOpener-6a46e9ed5ad2c334585050f964998e61-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/6a46e9ed5ad2c334585050f964998e61/f2 2023-02-17 02:01:10,638 DEBUG [StoreOpener-6a46e9ed5ad2c334585050f964998e61-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/6a46e9ed5ad2c334585050f964998e61/f2 2023-02-17 02:01:10,639 DEBUG [StoreOpener-70f7ef12da22dd3ef39c2af364b54ddd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/70f7ef12da22dd3ef39c2af364b54ddd/f2 2023-02-17 02:01:10,639 INFO [StoreOpener-6a46e9ed5ad2c334585050f964998e61-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6a46e9ed5ad2c334585050f964998e61 columnFamilyName f2 2023-02-17 02:01:10,639 DEBUG [StoreOpener-70f7ef12da22dd3ef39c2af364b54ddd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/70f7ef12da22dd3ef39c2af364b54ddd/f2 2023-02-17 02:01:10,639 INFO [StoreOpener-70f7ef12da22dd3ef39c2af364b54ddd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 70f7ef12da22dd3ef39c2af364b54ddd columnFamilyName f2 2023-02-17 02:01:10,640 INFO [StoreOpener-6a46e9ed5ad2c334585050f964998e61-1] regionserver.HStore(310): Store=6a46e9ed5ad2c334585050f964998e61/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:10,640 INFO [StoreOpener-70f7ef12da22dd3ef39c2af364b54ddd-1] regionserver.HStore(310): Store=70f7ef12da22dd3ef39c2af364b54ddd/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:10,643 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/70f7ef12da22dd3ef39c2af364b54ddd 2023-02-17 02:01:10,643 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/6a46e9ed5ad2c334585050f964998e61 2023-02-17 02:01:10,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/70f7ef12da22dd3ef39c2af364b54ddd 2023-02-17 02:01:10,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/6a46e9ed5ad2c334585050f964998e61 2023-02-17 02:01:10,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 02:01:10,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 02:01:10,651 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 70f7ef12da22dd3ef39c2af364b54ddd 2023-02-17 02:01:10,651 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 6a46e9ed5ad2c334585050f964998e61 2023-02-17 02:01:10,655 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/70f7ef12da22dd3ef39c2af364b54ddd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 02:01:10,656 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 70f7ef12da22dd3ef39c2af364b54ddd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61853928, jitterRate=-0.07830464839935303}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 02:01:10,656 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 70f7ef12da22dd3ef39c2af364b54ddd: 2023-02-17 02:01:10,656 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/6a46e9ed5ad2c334585050f964998e61/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 02:01:10,657 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1676599269734.70f7ef12da22dd3ef39c2af364b54ddd., pid=24, masterSystemTime=1676599270373 2023-02-17 02:01:10,657 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 6a46e9ed5ad2c334585050f964998e61; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73473911, jitterRate=0.09484659135341644}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 02:01:10,657 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 6a46e9ed5ad2c334585050f964998e61: 2023-02-17 02:01:10,659 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1676599269734.6a46e9ed5ad2c334585050f964998e61., pid=28, masterSystemTime=1676599270389 2023-02-17 02:01:10,660 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1676599269734.70f7ef12da22dd3ef39c2af364b54ddd. 2023-02-17 02:01:10,660 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1676599269734.70f7ef12da22dd3ef39c2af364b54ddd. 2023-02-17 02:01:10,661 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=70f7ef12da22dd3ef39c2af364b54ddd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37401,1676599266596 2023-02-17 02:01:10,661 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1676599269734.70f7ef12da22dd3ef39c2af364b54ddd.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676599270661"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676599270661"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676599270661"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676599270661"}]},"ts":"1676599270661"} 2023-02-17 02:01:10,661 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1676599269734.6a46e9ed5ad2c334585050f964998e61. 2023-02-17 02:01:10,661 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1676599269734.6a46e9ed5ad2c334585050f964998e61. 2023-02-17 02:01:10,662 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=6a46e9ed5ad2c334585050f964998e61, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34495,1676599266651 2023-02-17 02:01:10,662 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1676599269734.6a46e9ed5ad2c334585050f964998e61.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676599270662"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676599270662"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676599270662"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676599270662"}]},"ts":"1676599270662"} 2023-02-17 02:01:10,667 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=12 2023-02-17 02:01:10,667 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=12, state=SUCCESS; OpenRegionProcedure 70f7ef12da22dd3ef39c2af364b54ddd, server=jenkins-hbase4.apache.org,37401,1676599266596 in 437 msec 2023-02-17 02:01:10,669 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=17 2023-02-17 02:01:10,669 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=17, state=SUCCESS; OpenRegionProcedure 6a46e9ed5ad2c334585050f964998e61, server=jenkins-hbase4.apache.org,34495,1676599266651 in 423 msec 2023-02-17 02:01:10,670 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=70f7ef12da22dd3ef39c2af364b54ddd, ASSIGN in 619 msec 2023-02-17 02:01:10,673 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=10 2023-02-17 02:01:10,673 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=6a46e9ed5ad2c334585050f964998e61, ASSIGN in 621 msec 2023-02-17 02:01:10,674 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-17 02:01:10,675 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676599270675"}]},"ts":"1676599270675"} 2023-02-17 02:01:10,677 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-17 02:01:10,686 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-17 02:01:10,690 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 947 msec 2023-02-17 02:01:10,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 02:01:10,893 INFO [Listener at localhost/39237] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-17 02:01:10,894 DEBUG [Listener at localhost/39237] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-17 02:01:10,896 INFO [Listener at localhost/39237] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-17 02:01:10,906 INFO [Listener at localhost/39237] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-17 02:01:10,907 INFO [Listener at localhost/39237] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-17 02:01:10,907 INFO [Listener at localhost/39237] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-17 02:01:10,907 INFO [Listener at localhost/39237] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-17 02:01:11,080 DEBUG [hconnection-0x7e6caff2-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 02:01:11,118 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38998, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 02:01:11,144 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34495] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6084 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,g\xA7\xA7,1676599269734.b3da13e5dcdc5200c5067deebd89a3b4. 2023-02-17 02:01:11,156 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37401] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 11492 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676599269734.70f7ef12da22dd3ef39c2af364b54ddd. 2023-02-17 02:01:11,489 INFO [Listener at localhost/39237] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-17 02:01:11,494 INFO [Listener at localhost/39237] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-17 02:01:11,509 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39477] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-17 02:01:11,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39477] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676599271509 (current time:1676599271509). 2023-02-17 02:01:11,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39477] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-17 02:01:11,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39477] zookeeper.ReadOnlyZKClient(139): Connect 0x72eb0750 to 127.0.0.1:50037 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 02:01:11,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39477] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@ef34a51, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 02:01:11,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39477] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 02:01:11,532 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39594, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 02:01:11,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39477] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x72eb0750 to 127.0.0.1:50037 2023-02-17 02:01:11,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39477] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 02:01:11,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39477] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-17 02:01:11,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39477] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-17 02:01:11,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39477] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-17 02:01:11,562 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-17 02:01:11,563 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676599871563 2023-02-17 02:01:11,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39477] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-17 02:01:11,564 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-17 02:01:11,566 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-17 02:01:11,569 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-17 02:01:11,569 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 15 msec 2023-02-17 02:01:11,569 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-17 02:01:11,570 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676599871570 2023-02-17 02:01:11,573 DEBUG [Listener at localhost/39237] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-17 02:01:11,573 DEBUG [Listener at localhost/39237] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-17 02:01:11,612 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceMultiRegion 2023-02-17 02:01:11,613 INFO [(jenkins-hbase4.apache.org,39477,1676599265371)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceMultiRegion' 2023-02-17 02:01:11,613 DEBUG [(jenkins-hbase4.apache.org,39477,1676599265371)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-17 02:01:11,614 DEBUG [(jenkins-hbase4.apache.org,39477,1676599265371)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceMultiRegion' starting 'acquire' 2023-02-17 02:01:11,614 DEBUG [(jenkins-hbase4.apache.org,39477,1676599265371)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-17 02:01:11,615 DEBUG [(jenkins-hbase4.apache.org,39477,1676599265371)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-17 02:01:11,615 DEBUG [(jenkins-hbase4.apache.org,39477,1676599265371)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-17 02:01:11,616 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): regionserver:34495-0x10060026e590002, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 02:01:11,616 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): regionserver:37401-0x10060026e590001, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 02:01:11,616 DEBUG [(jenkins-hbase4.apache.org,39477,1676599265371)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,34495,1676599266651 2023-02-17 02:01:11,617 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 02:01:11,617 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 02:01:11,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 02:01:11,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 02:01:11,617 DEBUG [(jenkins-hbase4.apache.org,39477,1676599265371)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,34495,1676599266651 2023-02-17 02:01:11,617 DEBUG [(jenkins-hbase4.apache.org,39477,1676599265371)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,37401,1676599266596 2023-02-17 02:01:11,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-17 02:01:11,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-17 02:01:11,618 DEBUG [(jenkins-hbase4.apache.org,39477,1676599265371)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,37401,1676599266596 2023-02-17 02:01:11,618 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37401-0x10060026e590001, quorum=127.0.0.1:50037, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-17 02:01:11,618 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34495-0x10060026e590002, quorum=127.0.0.1:50037, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-17 02:01:11,618 DEBUG [(jenkins-hbase4.apache.org,39477,1676599265371)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-17 02:01:11,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-17 02:01:11,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-17 02:01:11,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-17 02:01:11,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-17 02:01:11,619 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-17 02:01:11,619 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-17 02:01:11,626 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-17 02:01:11,626 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-17 02:01:11,626 DEBUG [member: 'jenkins-hbase4.apache.org,34495,1676599266651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-17 02:01:11,626 DEBUG [member: 'jenkins-hbase4.apache.org,37401,1676599266596' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-17 02:01:11,626 DEBUG [member: 'jenkins-hbase4.apache.org,37401,1676599266596' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-17 02:01:11,626 DEBUG [member: 'jenkins-hbase4.apache.org,34495,1676599266651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-17 02:01:11,627 DEBUG [member: 'jenkins-hbase4.apache.org,37401,1676599266596' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-17 02:01:11,628 DEBUG [member: 'jenkins-hbase4.apache.org,34495,1676599266651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-17 02:01:11,628 DEBUG [member: 'jenkins-hbase4.apache.org,34495,1676599266651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-17 02:01:11,628 DEBUG [member: 'jenkins-hbase4.apache.org,37401,1676599266596' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-17 02:01:11,628 DEBUG [member: 'jenkins-hbase4.apache.org,37401,1676599266596' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37401,1676599266596' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-17 02:01:11,628 DEBUG [member: 'jenkins-hbase4.apache.org,34495,1676599266651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34495,1676599266651' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-17 02:01:11,633 DEBUG [member: 'jenkins-hbase4.apache.org,37401,1676599266596' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-17 02:01:11,633 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,34495,1676599266651 2023-02-17 02:01:11,633 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,37401,1676599266596 2023-02-17 02:01:11,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,34495,1676599266651 2023-02-17 02:01:11,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 02:01:11,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-17 02:01:11,633 DEBUG [member: 'jenkins-hbase4.apache.org,37401,1676599266596' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37401-0x10060026e590001, quorum=127.0.0.1:50037, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-17 02:01:11,633 DEBUG [member: 'jenkins-hbase4.apache.org,37401,1676599266596' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 02:01:11,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 02:01:11,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 02:01:11,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-17 02:01:11,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34495,1676599266651 2023-02-17 02:01:11,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37401,1676599266596 2023-02-17 02:01:11,636 DEBUG [member: 'jenkins-hbase4.apache.org,34495,1676599266651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-17 02:01:11,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 02:01:11,636 DEBUG [member: 'jenkins-hbase4.apache.org,34495,1676599266651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34495-0x10060026e590002, quorum=127.0.0.1:50037, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-17 02:01:11,636 DEBUG [member: 'jenkins-hbase4.apache.org,34495,1676599266651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 02:01:11,636 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34495,1676599266651' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-17 02:01:11,636 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2b0d47cf[Count = 1] remaining members to acquire global barrier 2023-02-17 02:01:11,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,37401,1676599266596 2023-02-17 02:01:11,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 02:01:11,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-17 02:01:11,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 02:01:11,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 02:01:11,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-17 02:01:11,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34495,1676599266651 2023-02-17 02:01:11,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37401,1676599266596 2023-02-17 02:01:11,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 02:01:11,639 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37401,1676599266596' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-17 02:01:11,639 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2b0d47cf[Count = 0] remaining members to acquire global barrier 2023-02-17 02:01:11,639 DEBUG [(jenkins-hbase4.apache.org,39477,1676599265371)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-17 02:01:11,640 DEBUG [(jenkins-hbase4.apache.org,39477,1676599265371)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-17 02:01:11,644 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): regionserver:37401-0x10060026e590001, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-17 02:01:11,644 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): regionserver:34495-0x10060026e590002, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-17 02:01:11,644 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-17 02:01:11,644 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-17 02:01:11,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-17 02:01:11,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-17 02:01:11,644 DEBUG [member: 'jenkins-hbase4.apache.org,34495,1676599266651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-17 02:01:11,644 DEBUG [member: 'jenkins-hbase4.apache.org,37401,1676599266596' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-17 02:01:11,647 DEBUG [(jenkins-hbase4.apache.org,39477,1676599265371)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,34495,1676599266651 2023-02-17 02:01:11,648 DEBUG [(jenkins-hbase4.apache.org,39477,1676599265371)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,37401,1676599266596 2023-02-17 02:01:11,648 DEBUG [(jenkins-hbase4.apache.org,39477,1676599265371)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-17 02:01:11,648 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1676599269734.4fb7511bdaa2707fcc86962500b3c078. 2023-02-17 02:01:11,648 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1676599269734.b213250f6e3c76397fc5267bf5934c3e. 2023-02-17 02:01:11,649 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1676599269734.4fb7511bdaa2707fcc86962500b3c078. started... 2023-02-17 02:01:11,649 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1676599269734.b213250f6e3c76397fc5267bf5934c3e. started... 2023-02-17 02:01:11,651 INFO [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-0] regionserver.HRegion(2744): Flushing b213250f6e3c76397fc5267bf5934c3e 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-17 02:01:11,652 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 4fb7511bdaa2707fcc86962500b3c078: 2023-02-17 02:01:11,653 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1676599269734.4fb7511bdaa2707fcc86962500b3c078.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-17 02:01:11,654 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1676599269734.6a46e9ed5ad2c334585050f964998e61. 2023-02-17 02:01:11,655 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1676599269734.6a46e9ed5ad2c334585050f964998e61. started... 2023-02-17 02:01:11,659 INFO [rs(jenkins-hbase4.apache.org,34495,1676599266651)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 6a46e9ed5ad2c334585050f964998e61 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-17 02:01:11,660 DEBUG [member: 'jenkins-hbase4.apache.org,37401,1676599266596' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-17 02:01:11,660 DEBUG [member: 'jenkins-hbase4.apache.org,34495,1676599266651' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-17 02:01:11,660 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1676599269734.a8930d4446cbfaf62e358646d1db5a41. 2023-02-17 02:01:11,660 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676599269734.60da012c2f8c7fe0ec391ffacffa21f0. 2023-02-17 02:01:11,660 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676599269734.60da012c2f8c7fe0ec391ffacffa21f0. started... 2023-02-17 02:01:11,660 DEBUG [member: 'jenkins-hbase4.apache.org,34495,1676599266651' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-17 02:01:11,661 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 60da012c2f8c7fe0ec391ffacffa21f0: 2023-02-17 02:01:11,660 DEBUG [member: 'jenkins-hbase4.apache.org,37401,1676599266596' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-17 02:01:11,661 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676599269734.60da012c2f8c7fe0ec391ffacffa21f0.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-17 02:01:11,661 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1676599269734.4ed625a5af4623dec3e6c74a1f7180c6. 2023-02-17 02:01:11,660 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1676599269734.a8930d4446cbfaf62e358646d1db5a41. started... 2023-02-17 02:01:11,663 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1676599269734.4ed625a5af4623dec3e6c74a1f7180c6. started... 2023-02-17 02:01:11,664 INFO [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-1] regionserver.HRegion(2744): Flushing a8930d4446cbfaf62e358646d1db5a41 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-17 02:01:11,666 INFO [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 4ed625a5af4623dec3e6c74a1f7180c6 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-17 02:01:11,669 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 02:01:11,670 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 02:01:11,673 DEBUG [Listener at localhost/39237] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-17 02:01:11,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39477] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-17 02:01:11,677 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-17 02:01:11,678 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-17 02:01:11,678 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-17 02:01:11,678 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-17 02:01:11,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39477] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-17 02:01:11,685 DEBUG [Listener at localhost/39237] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-17 02:01:11,758 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1676599269734.4fb7511bdaa2707fcc86962500b3c078. completed. 2023-02-17 02:01:11,758 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1676599269734.4fb7511bdaa2707fcc86962500b3c078. 2023-02-17 02:01:11,759 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1676599269734.4d5096d14486c6ef9123841c928ad2ea. 2023-02-17 02:01:11,759 DEBUG [member: 'jenkins-hbase4.apache.org,34495,1676599266651' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-17 02:01:11,759 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1676599269734.4d5096d14486c6ef9123841c928ad2ea. started... 2023-02-17 02:01:11,760 INFO [rs(jenkins-hbase4.apache.org,34495,1676599266651)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 4d5096d14486c6ef9123841c928ad2ea 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-17 02:01:11,766 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676599269734.60da012c2f8c7fe0ec391ffacffa21f0. completed. 2023-02-17 02:01:11,766 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676599269734.60da012c2f8c7fe0ec391ffacffa21f0. 2023-02-17 02:01:11,767 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1676599269734.b3da13e5dcdc5200c5067deebd89a3b4. 2023-02-17 02:01:11,767 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676599269734.b3da13e5dcdc5200c5067deebd89a3b4. started... 2023-02-17 02:01:11,767 DEBUG [member: 'jenkins-hbase4.apache.org,34495,1676599266651' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-17 02:01:11,769 INFO [rs(jenkins-hbase4.apache.org,34495,1676599266651)-snapshot-pool-2] regionserver.HRegion(2744): Flushing b3da13e5dcdc5200c5067deebd89a3b4 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-17 02:01:11,885 DEBUG [Listener at localhost/39237] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-17 02:01:11,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39477] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-17 02:01:11,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39477] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-17 02:01:11,888 DEBUG [Listener at localhost/39237] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-17 02:01:11,930 INFO [rs(jenkins-hbase4.apache.org,34495,1676599266651)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/6a46e9ed5ad2c334585050f964998e61/.tmp/f1/9a482387f4d54932b01672de529d047e 2023-02-17 02:01:11,962 INFO [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/b213250f6e3c76397fc5267bf5934c3e/.tmp/f1/8255554c1457463aa80c1123e8ca9419 2023-02-17 02:01:11,967 INFO [rs(jenkins-hbase4.apache.org,34495,1676599266651)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/4d5096d14486c6ef9123841c928ad2ea/.tmp/f1/beb1f4a5373f4eebbb7749c3296e875c 2023-02-17 02:01:12,096 INFO [rs(jenkins-hbase4.apache.org,34495,1676599266651)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/4d5096d14486c6ef9123841c928ad2ea/.tmp/f2/d6ea514e04f34b8db33ceb5ebfe7c4d2 2023-02-17 02:01:12,097 INFO [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/b213250f6e3c76397fc5267bf5934c3e/.tmp/f2/54f45e683ff04d808eca260001f90782 2023-02-17 02:01:12,106 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/4d5096d14486c6ef9123841c928ad2ea/.tmp/f1/beb1f4a5373f4eebbb7749c3296e875c as hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/4d5096d14486c6ef9123841c928ad2ea/f1/beb1f4a5373f4eebbb7749c3296e875c 2023-02-17 02:01:12,107 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/b213250f6e3c76397fc5267bf5934c3e/.tmp/f1/8255554c1457463aa80c1123e8ca9419 as hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/b213250f6e3c76397fc5267bf5934c3e/f1/8255554c1457463aa80c1123e8ca9419 2023-02-17 02:01:12,118 INFO [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/b213250f6e3c76397fc5267bf5934c3e/f1/8255554c1457463aa80c1123e8ca9419, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 02:01:12,119 INFO [rs(jenkins-hbase4.apache.org,34495,1676599266651)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/4d5096d14486c6ef9123841c928ad2ea/f1/beb1f4a5373f4eebbb7749c3296e875c, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 02:01:12,121 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/b213250f6e3c76397fc5267bf5934c3e/.tmp/f2/54f45e683ff04d808eca260001f90782 as hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/b213250f6e3c76397fc5267bf5934c3e/f2/54f45e683ff04d808eca260001f90782 2023-02-17 02:01:12,121 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/4d5096d14486c6ef9123841c928ad2ea/.tmp/f2/d6ea514e04f34b8db33ceb5ebfe7c4d2 as hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/4d5096d14486c6ef9123841c928ad2ea/f2/d6ea514e04f34b8db33ceb5ebfe7c4d2 2023-02-17 02:01:12,134 INFO [rs(jenkins-hbase4.apache.org,34495,1676599266651)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/4d5096d14486c6ef9123841c928ad2ea/f2/d6ea514e04f34b8db33ceb5ebfe7c4d2, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 02:01:12,135 INFO [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/b213250f6e3c76397fc5267bf5934c3e/f2/54f45e683ff04d808eca260001f90782, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 02:01:12,135 INFO [rs(jenkins-hbase4.apache.org,34495,1676599266651)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 4d5096d14486c6ef9123841c928ad2ea in 375ms, sequenceid=5, compaction requested=false 2023-02-17 02:01:12,136 INFO [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for b213250f6e3c76397fc5267bf5934c3e in 485ms, sequenceid=5, compaction requested=false 2023-02-17 02:01:12,138 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-17 02:01:12,138 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-17 02:01:12,140 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 4d5096d14486c6ef9123841c928ad2ea: 2023-02-17 02:01:12,141 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for b213250f6e3c76397fc5267bf5934c3e: 2023-02-17 02:01:12,141 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1676599269734.4d5096d14486c6ef9123841c928ad2ea.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-17 02:01:12,141 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 02:01:12,141 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/4d5096d14486c6ef9123841c928ad2ea/f1/beb1f4a5373f4eebbb7749c3296e875c] hfiles 2023-02-17 02:01:12,141 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/4d5096d14486c6ef9123841c928ad2ea/f1/beb1f4a5373f4eebbb7749c3296e875c for snapshot=testWithMapReduceMultiRegion 2023-02-17 02:01:12,141 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1676599269734.b213250f6e3c76397fc5267bf5934c3e.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-17 02:01:12,141 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 02:01:12,141 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/b213250f6e3c76397fc5267bf5934c3e/f1/8255554c1457463aa80c1123e8ca9419] hfiles 2023-02-17 02:01:12,142 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/b213250f6e3c76397fc5267bf5934c3e/f1/8255554c1457463aa80c1123e8ca9419 for snapshot=testWithMapReduceMultiRegion 2023-02-17 02:01:12,146 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/b213250f6e3c76397fc5267bf5934c3e/f2/54f45e683ff04d808eca260001f90782] hfiles 2023-02-17 02:01:12,146 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/4d5096d14486c6ef9123841c928ad2ea/f2/d6ea514e04f34b8db33ceb5ebfe7c4d2] hfiles 2023-02-17 02:01:12,146 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/4d5096d14486c6ef9123841c928ad2ea/f2/d6ea514e04f34b8db33ceb5ebfe7c4d2 for snapshot=testWithMapReduceMultiRegion 2023-02-17 02:01:12,146 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/b213250f6e3c76397fc5267bf5934c3e/f2/54f45e683ff04d808eca260001f90782 for snapshot=testWithMapReduceMultiRegion 2023-02-17 02:01:12,168 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1676599269734.4d5096d14486c6ef9123841c928ad2ea. completed. 2023-02-17 02:01:12,168 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1676599269734.4d5096d14486c6ef9123841c928ad2ea. 2023-02-17 02:01:12,168 DEBUG [member: 'jenkins-hbase4.apache.org,34495,1676599266651' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-17 02:01:12,175 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1676599269734.b213250f6e3c76397fc5267bf5934c3e. completed. 2023-02-17 02:01:12,175 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1676599269734.b213250f6e3c76397fc5267bf5934c3e. 2023-02-17 02:01:12,175 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1676599269734.70f7ef12da22dd3ef39c2af364b54ddd. 2023-02-17 02:01:12,175 DEBUG [member: 'jenkins-hbase4.apache.org,37401,1676599266596' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-17 02:01:12,175 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1676599269734.70f7ef12da22dd3ef39c2af364b54ddd. started... 2023-02-17 02:01:12,176 INFO [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 70f7ef12da22dd3ef39c2af364b54ddd 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-17 02:01:12,188 DEBUG [Listener at localhost/39237] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-17 02:01:12,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39477] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-17 02:01:12,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39477] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-17 02:01:12,190 DEBUG [Listener at localhost/39237] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-17 02:01:12,371 INFO [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/4ed625a5af4623dec3e6c74a1f7180c6/.tmp/f1/d382863b46a94de7aadcd5b897c03972 2023-02-17 02:01:12,372 INFO [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/a8930d4446cbfaf62e358646d1db5a41/.tmp/f1/28c40938bb9f49259c9121f3f76cd0bc 2023-02-17 02:01:12,374 INFO [rs(jenkins-hbase4.apache.org,34495,1676599266651)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/b3da13e5dcdc5200c5067deebd89a3b4/.tmp/f1/752df72c44764942b6997c097d06a55c 2023-02-17 02:01:12,422 INFO [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/a8930d4446cbfaf62e358646d1db5a41/.tmp/f2/e6640ccd453f4906b0ed3f8cf3b07e80 2023-02-17 02:01:12,434 INFO [rs(jenkins-hbase4.apache.org,34495,1676599266651)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/b3da13e5dcdc5200c5067deebd89a3b4/.tmp/f2/a9ce531f77fa4c8d9ba8e9c61e3c7c71 2023-02-17 02:01:12,434 INFO [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/4ed625a5af4623dec3e6c74a1f7180c6/.tmp/f2/2cb6ec9838de40e393466e31305dff9d 2023-02-17 02:01:12,434 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/a8930d4446cbfaf62e358646d1db5a41/.tmp/f1/28c40938bb9f49259c9121f3f76cd0bc as hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/a8930d4446cbfaf62e358646d1db5a41/f1/28c40938bb9f49259c9121f3f76cd0bc 2023-02-17 02:01:12,444 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/b3da13e5dcdc5200c5067deebd89a3b4/.tmp/f1/752df72c44764942b6997c097d06a55c as hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/b3da13e5dcdc5200c5067deebd89a3b4/f1/752df72c44764942b6997c097d06a55c 2023-02-17 02:01:12,445 INFO [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/a8930d4446cbfaf62e358646d1db5a41/f1/28c40938bb9f49259c9121f3f76cd0bc, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 02:01:12,445 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/4ed625a5af4623dec3e6c74a1f7180c6/.tmp/f1/d382863b46a94de7aadcd5b897c03972 as hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/4ed625a5af4623dec3e6c74a1f7180c6/f1/d382863b46a94de7aadcd5b897c03972 2023-02-17 02:01:12,447 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/a8930d4446cbfaf62e358646d1db5a41/.tmp/f2/e6640ccd453f4906b0ed3f8cf3b07e80 as hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/a8930d4446cbfaf62e358646d1db5a41/f2/e6640ccd453f4906b0ed3f8cf3b07e80 2023-02-17 02:01:12,454 INFO [rs(jenkins-hbase4.apache.org,34495,1676599266651)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/b3da13e5dcdc5200c5067deebd89a3b4/f1/752df72c44764942b6997c097d06a55c, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 02:01:12,456 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/b3da13e5dcdc5200c5067deebd89a3b4/.tmp/f2/a9ce531f77fa4c8d9ba8e9c61e3c7c71 as hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/b3da13e5dcdc5200c5067deebd89a3b4/f2/a9ce531f77fa4c8d9ba8e9c61e3c7c71 2023-02-17 02:01:12,457 INFO [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/4ed625a5af4623dec3e6c74a1f7180c6/f1/d382863b46a94de7aadcd5b897c03972, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-17 02:01:12,457 INFO [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/a8930d4446cbfaf62e358646d1db5a41/f2/e6640ccd453f4906b0ed3f8cf3b07e80, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 02:01:12,458 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/4ed625a5af4623dec3e6c74a1f7180c6/.tmp/f2/2cb6ec9838de40e393466e31305dff9d as hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/4ed625a5af4623dec3e6c74a1f7180c6/f2/2cb6ec9838de40e393466e31305dff9d 2023-02-17 02:01:12,459 INFO [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for a8930d4446cbfaf62e358646d1db5a41 in 796ms, sequenceid=5, compaction requested=false 2023-02-17 02:01:12,459 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for a8930d4446cbfaf62e358646d1db5a41: 2023-02-17 02:01:12,459 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1676599269734.a8930d4446cbfaf62e358646d1db5a41.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-17 02:01:12,459 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 02:01:12,459 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/a8930d4446cbfaf62e358646d1db5a41/f1/28c40938bb9f49259c9121f3f76cd0bc] hfiles 2023-02-17 02:01:12,459 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/a8930d4446cbfaf62e358646d1db5a41/f1/28c40938bb9f49259c9121f3f76cd0bc for snapshot=testWithMapReduceMultiRegion 2023-02-17 02:01:12,459 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/a8930d4446cbfaf62e358646d1db5a41/f2/e6640ccd453f4906b0ed3f8cf3b07e80] hfiles 2023-02-17 02:01:12,459 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/a8930d4446cbfaf62e358646d1db5a41/f2/e6640ccd453f4906b0ed3f8cf3b07e80 for snapshot=testWithMapReduceMultiRegion 2023-02-17 02:01:12,465 INFO [rs(jenkins-hbase4.apache.org,34495,1676599266651)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/b3da13e5dcdc5200c5067deebd89a3b4/f2/a9ce531f77fa4c8d9ba8e9c61e3c7c71, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 02:01:12,467 INFO [rs(jenkins-hbase4.apache.org,34495,1676599266651)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for b3da13e5dcdc5200c5067deebd89a3b4 in 698ms, sequenceid=5, compaction requested=false 2023-02-17 02:01:12,467 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for b3da13e5dcdc5200c5067deebd89a3b4: 2023-02-17 02:01:12,467 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1676599269734.b3da13e5dcdc5200c5067deebd89a3b4.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-17 02:01:12,467 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 02:01:12,467 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/b3da13e5dcdc5200c5067deebd89a3b4/f1/752df72c44764942b6997c097d06a55c] hfiles 2023-02-17 02:01:12,467 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/b3da13e5dcdc5200c5067deebd89a3b4/f1/752df72c44764942b6997c097d06a55c for snapshot=testWithMapReduceMultiRegion 2023-02-17 02:01:12,467 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/b3da13e5dcdc5200c5067deebd89a3b4/f2/a9ce531f77fa4c8d9ba8e9c61e3c7c71] hfiles 2023-02-17 02:01:12,467 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/b3da13e5dcdc5200c5067deebd89a3b4/f2/a9ce531f77fa4c8d9ba8e9c61e3c7c71 for snapshot=testWithMapReduceMultiRegion 2023-02-17 02:01:12,476 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1676599269734.a8930d4446cbfaf62e358646d1db5a41. completed. 2023-02-17 02:01:12,476 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1676599269734.a8930d4446cbfaf62e358646d1db5a41. 2023-02-17 02:01:12,476 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1676599269734.3c50622abf2210dda1717f4c123254eb. 2023-02-17 02:01:12,476 DEBUG [member: 'jenkins-hbase4.apache.org,37401,1676599266596' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-17 02:01:12,476 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676599269734.3c50622abf2210dda1717f4c123254eb. started... 2023-02-17 02:01:12,476 INFO [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/4ed625a5af4623dec3e6c74a1f7180c6/f2/2cb6ec9838de40e393466e31305dff9d, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-17 02:01:12,477 INFO [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 3c50622abf2210dda1717f4c123254eb 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-17 02:01:12,478 INFO [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 4ed625a5af4623dec3e6c74a1f7180c6 in 812ms, sequenceid=5, compaction requested=false 2023-02-17 02:01:12,478 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 4ed625a5af4623dec3e6c74a1f7180c6: 2023-02-17 02:01:12,479 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1676599269734.4ed625a5af4623dec3e6c74a1f7180c6.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-17 02:01:12,479 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 02:01:12,479 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/4ed625a5af4623dec3e6c74a1f7180c6/f1/d382863b46a94de7aadcd5b897c03972] hfiles 2023-02-17 02:01:12,479 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/4ed625a5af4623dec3e6c74a1f7180c6/f1/d382863b46a94de7aadcd5b897c03972 for snapshot=testWithMapReduceMultiRegion 2023-02-17 02:01:12,479 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/4ed625a5af4623dec3e6c74a1f7180c6/f2/2cb6ec9838de40e393466e31305dff9d] hfiles 2023-02-17 02:01:12,479 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/4ed625a5af4623dec3e6c74a1f7180c6/f2/2cb6ec9838de40e393466e31305dff9d for snapshot=testWithMapReduceMultiRegion 2023-02-17 02:01:12,492 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676599269734.b3da13e5dcdc5200c5067deebd89a3b4. completed. 2023-02-17 02:01:12,493 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1676599269734.b3da13e5dcdc5200c5067deebd89a3b4. 2023-02-17 02:01:12,493 DEBUG [member: 'jenkins-hbase4.apache.org,34495,1676599266651' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-17 02:01:12,496 INFO [rs(jenkins-hbase4.apache.org,34495,1676599266651)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/6a46e9ed5ad2c334585050f964998e61/.tmp/f2/f0be2190b3f24020a450bb06e832105e 2023-02-17 02:01:12,512 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1676599269734.4ed625a5af4623dec3e6c74a1f7180c6. completed. 2023-02-17 02:01:12,512 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1676599269734.4ed625a5af4623dec3e6c74a1f7180c6. 2023-02-17 02:01:12,512 DEBUG [member: 'jenkins-hbase4.apache.org,37401,1676599266596' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-17 02:01:12,535 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/6a46e9ed5ad2c334585050f964998e61/.tmp/f1/9a482387f4d54932b01672de529d047e as hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/6a46e9ed5ad2c334585050f964998e61/f1/9a482387f4d54932b01672de529d047e 2023-02-17 02:01:12,544 INFO [rs(jenkins-hbase4.apache.org,34495,1676599266651)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/6a46e9ed5ad2c334585050f964998e61/f1/9a482387f4d54932b01672de529d047e, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 02:01:12,546 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/6a46e9ed5ad2c334585050f964998e61/.tmp/f2/f0be2190b3f24020a450bb06e832105e as hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/6a46e9ed5ad2c334585050f964998e61/f2/f0be2190b3f24020a450bb06e832105e 2023-02-17 02:01:12,548 INFO [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/3c50622abf2210dda1717f4c123254eb/.tmp/f1/2b0f34e3077e4c0d938384d2c1bc133c 2023-02-17 02:01:12,565 INFO [rs(jenkins-hbase4.apache.org,34495,1676599266651)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/6a46e9ed5ad2c334585050f964998e61/f2/f0be2190b3f24020a450bb06e832105e, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 02:01:12,566 INFO [rs(jenkins-hbase4.apache.org,34495,1676599266651)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 6a46e9ed5ad2c334585050f964998e61 in 907ms, sequenceid=5, compaction requested=false 2023-02-17 02:01:12,566 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 6a46e9ed5ad2c334585050f964998e61: 2023-02-17 02:01:12,567 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1676599269734.6a46e9ed5ad2c334585050f964998e61.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-17 02:01:12,567 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 02:01:12,567 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/6a46e9ed5ad2c334585050f964998e61/f1/9a482387f4d54932b01672de529d047e] hfiles 2023-02-17 02:01:12,567 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/6a46e9ed5ad2c334585050f964998e61/f1/9a482387f4d54932b01672de529d047e for snapshot=testWithMapReduceMultiRegion 2023-02-17 02:01:12,567 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/6a46e9ed5ad2c334585050f964998e61/f2/f0be2190b3f24020a450bb06e832105e] hfiles 2023-02-17 02:01:12,567 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/6a46e9ed5ad2c334585050f964998e61/f2/f0be2190b3f24020a450bb06e832105e for snapshot=testWithMapReduceMultiRegion 2023-02-17 02:01:12,593 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1676599269734.6a46e9ed5ad2c334585050f964998e61. completed. 2023-02-17 02:01:12,593 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1676599269734.6a46e9ed5ad2c334585050f964998e61. 2023-02-17 02:01:12,594 DEBUG [member: 'jenkins-hbase4.apache.org,34495,1676599266651' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-17 02:01:12,594 DEBUG [member: 'jenkins-hbase4.apache.org,34495,1676599266651' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-17 02:01:12,594 DEBUG [member: 'jenkins-hbase4.apache.org,34495,1676599266651' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34495,1676599266651 2023-02-17 02:01:12,594 DEBUG [member: 'jenkins-hbase4.apache.org,34495,1676599266651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-17 02:01:12,594 DEBUG [member: 'jenkins-hbase4.apache.org,34495,1676599266651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,34495,1676599266651' in zk 2023-02-17 02:01:12,595 INFO [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/3c50622abf2210dda1717f4c123254eb/.tmp/f2/9fca64ea11194963aa97df2f93a29181 2023-02-17 02:01:12,598 DEBUG [member: 'jenkins-hbase4.apache.org,34495,1676599266651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-17 02:01:12,598 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,34495,1676599266651 2023-02-17 02:01:12,598 DEBUG [member: 'jenkins-hbase4.apache.org,34495,1676599266651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 02:01:12,598 INFO [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/70f7ef12da22dd3ef39c2af364b54ddd/.tmp/f1/4dd4450e129c43ad952024fe42c1222f 2023-02-17 02:01:12,598 DEBUG [member: 'jenkins-hbase4.apache.org,34495,1676599266651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-17 02:01:12,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,34495,1676599266651 2023-02-17 02:01:12,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 02:01:12,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-17 02:01:12,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 02:01:12,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 02:01:12,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-17 02:01:12,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34495,1676599266651 2023-02-17 02:01:12,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37401,1676599266596 2023-02-17 02:01:12,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 02:01:12,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-17 02:01:12,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34495,1676599266651 2023-02-17 02:01:12,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,34495,1676599266651': 2023-02-17 02:01:12,606 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34495,1676599266651' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-17 02:01:12,609 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/3c50622abf2210dda1717f4c123254eb/.tmp/f1/2b0f34e3077e4c0d938384d2c1bc133c as hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/3c50622abf2210dda1717f4c123254eb/f1/2b0f34e3077e4c0d938384d2c1bc133c 2023-02-17 02:01:12,617 INFO [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/3c50622abf2210dda1717f4c123254eb/f1/2b0f34e3077e4c0d938384d2c1bc133c, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 02:01:12,620 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/3c50622abf2210dda1717f4c123254eb/.tmp/f2/9fca64ea11194963aa97df2f93a29181 as hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/3c50622abf2210dda1717f4c123254eb/f2/9fca64ea11194963aa97df2f93a29181 2023-02-17 02:01:12,647 INFO [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/3c50622abf2210dda1717f4c123254eb/f2/9fca64ea11194963aa97df2f93a29181, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 02:01:12,650 INFO [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 3c50622abf2210dda1717f4c123254eb in 172ms, sequenceid=5, compaction requested=false 2023-02-17 02:01:12,657 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 3c50622abf2210dda1717f4c123254eb: 2023-02-17 02:01:12,657 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1676599269734.3c50622abf2210dda1717f4c123254eb.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-17 02:01:12,658 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 02:01:12,658 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/3c50622abf2210dda1717f4c123254eb/f1/2b0f34e3077e4c0d938384d2c1bc133c] hfiles 2023-02-17 02:01:12,658 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/3c50622abf2210dda1717f4c123254eb/f1/2b0f34e3077e4c0d938384d2c1bc133c for snapshot=testWithMapReduceMultiRegion 2023-02-17 02:01:12,658 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/3c50622abf2210dda1717f4c123254eb/f2/9fca64ea11194963aa97df2f93a29181] hfiles 2023-02-17 02:01:12,658 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/3c50622abf2210dda1717f4c123254eb/f2/9fca64ea11194963aa97df2f93a29181 for snapshot=testWithMapReduceMultiRegion 2023-02-17 02:01:12,661 INFO [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/70f7ef12da22dd3ef39c2af364b54ddd/.tmp/f2/1e07143b10a84aa3b2ec38cfb922dda3 2023-02-17 02:01:12,669 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676599269734.3c50622abf2210dda1717f4c123254eb. completed. 2023-02-17 02:01:12,669 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1676599269734.3c50622abf2210dda1717f4c123254eb. 2023-02-17 02:01:12,669 DEBUG [member: 'jenkins-hbase4.apache.org,37401,1676599266596' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-17 02:01:12,670 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/70f7ef12da22dd3ef39c2af364b54ddd/.tmp/f1/4dd4450e129c43ad952024fe42c1222f as hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/70f7ef12da22dd3ef39c2af364b54ddd/f1/4dd4450e129c43ad952024fe42c1222f 2023-02-17 02:01:12,677 INFO [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/70f7ef12da22dd3ef39c2af364b54ddd/f1/4dd4450e129c43ad952024fe42c1222f, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-17 02:01:12,678 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/70f7ef12da22dd3ef39c2af364b54ddd/.tmp/f2/1e07143b10a84aa3b2ec38cfb922dda3 as hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/70f7ef12da22dd3ef39c2af364b54ddd/f2/1e07143b10a84aa3b2ec38cfb922dda3 2023-02-17 02:01:12,685 INFO [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/70f7ef12da22dd3ef39c2af364b54ddd/f2/1e07143b10a84aa3b2ec38cfb922dda3, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-17 02:01:12,686 INFO [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 70f7ef12da22dd3ef39c2af364b54ddd in 510ms, sequenceid=5, compaction requested=false 2023-02-17 02:01:12,687 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 70f7ef12da22dd3ef39c2af364b54ddd: 2023-02-17 02:01:12,687 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1676599269734.70f7ef12da22dd3ef39c2af364b54ddd.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-17 02:01:12,687 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 02:01:12,687 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/70f7ef12da22dd3ef39c2af364b54ddd/f1/4dd4450e129c43ad952024fe42c1222f] hfiles 2023-02-17 02:01:12,687 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/70f7ef12da22dd3ef39c2af364b54ddd/f1/4dd4450e129c43ad952024fe42c1222f for snapshot=testWithMapReduceMultiRegion 2023-02-17 02:01:12,687 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/70f7ef12da22dd3ef39c2af364b54ddd/f2/1e07143b10a84aa3b2ec38cfb922dda3] hfiles 2023-02-17 02:01:12,687 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/70f7ef12da22dd3ef39c2af364b54ddd/f2/1e07143b10a84aa3b2ec38cfb922dda3 for snapshot=testWithMapReduceMultiRegion 2023-02-17 02:01:12,690 DEBUG [Listener at localhost/39237] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-17 02:01:12,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39477] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-17 02:01:12,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39477] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-17 02:01:12,693 DEBUG [Listener at localhost/39237] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-17 02:01:12,699 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1676599269734.70f7ef12da22dd3ef39c2af364b54ddd. completed. 2023-02-17 02:01:12,699 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1676599269734.70f7ef12da22dd3ef39c2af364b54ddd. 2023-02-17 02:01:12,699 DEBUG [member: 'jenkins-hbase4.apache.org,37401,1676599266596' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-17 02:01:12,699 DEBUG [member: 'jenkins-hbase4.apache.org,37401,1676599266596' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-17 02:01:12,699 DEBUG [member: 'jenkins-hbase4.apache.org,37401,1676599266596' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37401,1676599266596 2023-02-17 02:01:12,699 DEBUG [member: 'jenkins-hbase4.apache.org,37401,1676599266596' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-17 02:01:12,699 DEBUG [member: 'jenkins-hbase4.apache.org,37401,1676599266596' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,37401,1676599266596' in zk 2023-02-17 02:01:12,703 DEBUG [member: 'jenkins-hbase4.apache.org,37401,1676599266596' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-17 02:01:12,703 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,37401,1676599266596 2023-02-17 02:01:12,703 DEBUG [member: 'jenkins-hbase4.apache.org,37401,1676599266596' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 02:01:12,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,37401,1676599266596 2023-02-17 02:01:12,703 DEBUG [member: 'jenkins-hbase4.apache.org,37401,1676599266596' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-17 02:01:12,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 02:01:12,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-17 02:01:12,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 02:01:12,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 02:01:12,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-17 02:01:12,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34495,1676599266651 2023-02-17 02:01:12,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37401,1676599266596 2023-02-17 02:01:12,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 02:01:12,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-17 02:01:12,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34495,1676599266651 2023-02-17 02:01:12,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37401,1676599266596 2023-02-17 02:01:12,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,37401,1676599266596': 2023-02-17 02:01:12,709 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37401,1676599266596' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-17 02:01:12,709 INFO [(jenkins-hbase4.apache.org,39477,1676599265371)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceMultiRegion' execution completed 2023-02-17 02:01:12,709 DEBUG [(jenkins-hbase4.apache.org,39477,1676599265371)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-17 02:01:12,709 DEBUG [(jenkins-hbase4.apache.org,39477,1676599265371)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-17 02:01:12,709 DEBUG [(jenkins-hbase4.apache.org,39477,1676599265371)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceMultiRegion 2023-02-17 02:01:12,709 INFO [(jenkins-hbase4.apache.org,39477,1676599265371)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-17 02:01:12,713 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-17 02:01:12,713 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): regionserver:37401-0x10060026e590001, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-17 02:01:12,713 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): regionserver:34495-0x10060026e590002, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-17 02:01:12,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-17 02:01:12,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-17 02:01:12,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 02:01:12,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-17 02:01:12,714 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): regionserver:34495-0x10060026e590002, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 02:01:12,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-17 02:01:12,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-17 02:01:12,714 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): regionserver:37401-0x10060026e590001, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 02:01:12,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-17 02:01:12,714 DEBUG [(jenkins-hbase4.apache.org,39477,1676599265371)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,34495,1676599266651 2023-02-17 02:01:12,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 02:01:12,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 02:01:12,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 02:01:12,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 02:01:12,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 02:01:12,715 DEBUG [(jenkins-hbase4.apache.org,39477,1676599265371)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,37401,1676599266596 2023-02-17 02:01:12,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-17 02:01:12,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-17 02:01:12,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-17 02:01:12,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 02:01:12,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-17 02:01:12,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34495,1676599266651 2023-02-17 02:01:12,717 DEBUG [(jenkins-hbase4.apache.org,39477,1676599265371)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,34495,1676599266651 2023-02-17 02:01:12,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37401,1676599266596 2023-02-17 02:01:12,718 DEBUG [(jenkins-hbase4.apache.org,39477,1676599265371)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,37401,1676599266596 2023-02-17 02:01:12,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 02:01:12,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-17 02:01:12,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34495,1676599266651 2023-02-17 02:01:12,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37401,1676599266596 2023-02-17 02:01:12,732 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): regionserver:34495-0x10060026e590002, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 02:01:12,732 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): regionserver:37401-0x10060026e590001, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 02:01:12,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 02:01:12,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 02:01:12,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 02:01:12,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 02:01:12,733 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,37401,1676599266596 2023-02-17 02:01:12,732 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): regionserver:37401-0x10060026e590001, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 02:01:12,733 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-17 02:01:12,739 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,34495,1676599266651 2023-02-17 02:01:12,739 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-17 02:01:12,733 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): regionserver:34495-0x10060026e590002, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 02:01:12,739 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,37401,1676599266596 2023-02-17 02:01:12,733 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 02:01:12,739 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-17 02:01:12,733 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceMultiRegion 2023-02-17 02:01:12,733 DEBUG [(jenkins-hbase4.apache.org,39477,1676599265371)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 02:01:12,740 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,34495,1676599266651 2023-02-17 02:01:12,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 02:01:12,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 02:01:12,741 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-17 02:01:12,741 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceMultiRegion 2023-02-17 02:01:12,741 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-17 02:01:12,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 02:01:12,744 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-17 02:01:12,842 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion to hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.hbase-snapshot/testWithMapReduceMultiRegion 2023-02-17 02:01:13,275 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed 2023-02-17 02:01:13,275 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-17 02:01:13,276 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-17 02:01:13,276 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676599271564Consolidate snapshot: testWithMapReduceMultiRegion at 1676599272740 (+1176 ms)Loading Region manifests for testWithMapReduceMultiRegion at 1676599272741 (+1 ms)Writing data manifest for testWithMapReduceMultiRegion at 1676599272769 (+28 ms)Verifying snapshot: testWithMapReduceMultiRegion at 1676599272802 (+33 ms)Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed at 1676599273275 (+473 ms) 2023-02-17 02:01:13,277 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-17 02:01:13,280 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 1.7100 sec 2023-02-17 02:01:13,693 DEBUG [Listener at localhost/39237] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-17 02:01:13,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39477] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-17 02:01:13,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39477] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-17 02:01:13,696 INFO [Listener at localhost/39237] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-17 02:01:13,711 INFO [Listener at localhost/39237] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-17 02:01:13,724 INFO [Listener at localhost/39237] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-17 02:01:13,782 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34495] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6084 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,g\xA7\xA7,1676599269734.b3da13e5dcdc5200c5067deebd89a3b4. 2023-02-17 02:01:13,809 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37401] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 11492 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676599269734.70f7ef12da22dd3ef39c2af364b54ddd. 2023-02-17 02:01:13,971 INFO [Listener at localhost/39237] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-17 02:01:13,990 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39477] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-17 02:01:13,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39477] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-17 02:01:13,996 INFO [(jenkins-hbase4.apache.org,39477,1676599265371)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-17 02:01:13,996 DEBUG [(jenkins-hbase4.apache.org,39477,1676599265371)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-17 02:01:13,997 DEBUG [(jenkins-hbase4.apache.org,39477,1676599265371)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-17 02:01:13,997 DEBUG [(jenkins-hbase4.apache.org,39477,1676599265371)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-17 02:01:13,998 DEBUG [(jenkins-hbase4.apache.org,39477,1676599265371)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 02:01:13,998 DEBUG [(jenkins-hbase4.apache.org,39477,1676599265371)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-17 02:01:14,000 DEBUG [(jenkins-hbase4.apache.org,39477,1676599265371)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,34495,1676599266651 2023-02-17 02:01:14,000 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): regionserver:37401-0x10060026e590001, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 02:01:14,000 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): regionserver:34495-0x10060026e590002, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 02:01:14,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 02:01:14,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 02:01:14,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 02:01:14,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 02:01:14,000 DEBUG [(jenkins-hbase4.apache.org,39477,1676599265371)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,34495,1676599266651 2023-02-17 02:01:14,000 DEBUG [(jenkins-hbase4.apache.org,39477,1676599265371)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,37401,1676599266596 2023-02-17 02:01:14,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-17 02:01:14,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-17 02:01:14,001 DEBUG [(jenkins-hbase4.apache.org,39477,1676599265371)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,37401,1676599266596 2023-02-17 02:01:14,001 DEBUG [(jenkins-hbase4.apache.org,39477,1676599265371)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-17 02:01:14,001 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37401-0x10060026e590001, quorum=127.0.0.1:50037, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 02:01:14,001 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34495-0x10060026e590002, quorum=127.0.0.1:50037, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 02:01:14,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-17 02:01:14,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-17 02:01:14,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-17 02:01:14,002 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-17 02:01:14,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-17 02:01:14,002 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-17 02:01:14,003 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-17 02:01:14,003 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-17 02:01:14,003 DEBUG [member: 'jenkins-hbase4.apache.org,34495,1676599266651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-17 02:01:14,004 DEBUG [member: 'jenkins-hbase4.apache.org,34495,1676599266651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-17 02:01:14,004 DEBUG [member: 'jenkins-hbase4.apache.org,37401,1676599266596' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-17 02:01:14,004 DEBUG [member: 'jenkins-hbase4.apache.org,34495,1676599266651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-17 02:01:14,004 DEBUG [member: 'jenkins-hbase4.apache.org,37401,1676599266596' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-17 02:01:14,008 DEBUG [member: 'jenkins-hbase4.apache.org,37401,1676599266596' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-17 02:01:14,009 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1676599269734.b213250f6e3c76397fc5267bf5934c3e. 2023-02-17 02:01:14,009 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1676599269734.b213250f6e3c76397fc5267bf5934c3e. started... 2023-02-17 02:01:14,010 INFO [rs(jenkins-hbase4.apache.org,37401,1676599266596)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing b213250f6e3c76397fc5267bf5934c3e 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-17 02:01:14,011 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1676599269734.4fb7511bdaa2707fcc86962500b3c078. 2023-02-17 02:01:14,011 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1676599269734.a8930d4446cbfaf62e358646d1db5a41. 2023-02-17 02:01:14,011 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1676599269734.a8930d4446cbfaf62e358646d1db5a41. started... 2023-02-17 02:01:14,011 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1676599269734.4fb7511bdaa2707fcc86962500b3c078. started... 2023-02-17 02:01:14,014 INFO [rs(jenkins-hbase4.apache.org,37401,1676599266596)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing a8930d4446cbfaf62e358646d1db5a41 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-17 02:01:14,014 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676599269734.60da012c2f8c7fe0ec391ffacffa21f0. 2023-02-17 02:01:14,014 DEBUG [member: 'jenkins-hbase4.apache.org,34495,1676599266651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-17 02:01:14,014 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676599269734.60da012c2f8c7fe0ec391ffacffa21f0. started... 2023-02-17 02:01:14,014 DEBUG [member: 'jenkins-hbase4.apache.org,37401,1676599266596' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-17 02:01:14,014 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 60da012c2f8c7fe0ec391ffacffa21f0: 2023-02-17 02:01:14,014 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1676599269734.6a46e9ed5ad2c334585050f964998e61. 2023-02-17 02:01:14,014 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 4fb7511bdaa2707fcc86962500b3c078: 2023-02-17 02:01:14,014 DEBUG [member: 'jenkins-hbase4.apache.org,34495,1676599266651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-17 02:01:14,014 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1676599269734.4fb7511bdaa2707fcc86962500b3c078. 2023-02-17 02:01:14,014 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1676599269734.6a46e9ed5ad2c334585050f964998e61. started... 2023-02-17 02:01:14,014 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676599269734.60da012c2f8c7fe0ec391ffacffa21f0. 2023-02-17 02:01:14,015 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1676599269734.b3da13e5dcdc5200c5067deebd89a3b4. 2023-02-17 02:01:14,015 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1676599269734.b3da13e5dcdc5200c5067deebd89a3b4. started... 2023-02-17 02:01:14,015 INFO [rs(jenkins-hbase4.apache.org,34495,1676599266651)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 6a46e9ed5ad2c334585050f964998e61 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-17 02:01:14,015 INFO [rs(jenkins-hbase4.apache.org,34495,1676599266651)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing b3da13e5dcdc5200c5067deebd89a3b4 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-17 02:01:14,014 DEBUG [member: 'jenkins-hbase4.apache.org,37401,1676599266596' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-17 02:01:14,015 DEBUG [member: 'jenkins-hbase4.apache.org,34495,1676599266651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-17 02:01:14,015 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1676599269734.4d5096d14486c6ef9123841c928ad2ea. 2023-02-17 02:01:14,017 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1676599269734.4d5096d14486c6ef9123841c928ad2ea. started... 2023-02-17 02:01:14,017 INFO [rs(jenkins-hbase4.apache.org,34495,1676599266651)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 4d5096d14486c6ef9123841c928ad2ea 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-17 02:01:14,017 DEBUG [member: 'jenkins-hbase4.apache.org,34495,1676599266651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-17 02:01:14,016 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1676599269734.4ed625a5af4623dec3e6c74a1f7180c6. 2023-02-17 02:01:14,020 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1676599269734.4ed625a5af4623dec3e6c74a1f7180c6. started... 2023-02-17 02:01:14,020 INFO [rs(jenkins-hbase4.apache.org,37401,1676599266596)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 4ed625a5af4623dec3e6c74a1f7180c6 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-17 02:01:14,052 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-17 02:01:14,087 INFO [rs(jenkins-hbase4.apache.org,34495,1676599266651)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/4d5096d14486c6ef9123841c928ad2ea/.tmp/f1/0f623e170a8544df993946f6a66737fd 2023-02-17 02:01:14,094 INFO [rs(jenkins-hbase4.apache.org,37401,1676599266596)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/b213250f6e3c76397fc5267bf5934c3e/.tmp/f1/b764110361ab45439fc2a4fe3e733f41 2023-02-17 02:01:14,102 INFO [rs(jenkins-hbase4.apache.org,34495,1676599266651)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/b3da13e5dcdc5200c5067deebd89a3b4/.tmp/f1/36a60ab05e1c4dd48461e0681235cdd8 2023-02-17 02:01:14,102 INFO [rs(jenkins-hbase4.apache.org,37401,1676599266596)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/4ed625a5af4623dec3e6c74a1f7180c6/.tmp/f1/82b52401df184524ad58392cebf98a2e 2023-02-17 02:01:14,111 INFO [rs(jenkins-hbase4.apache.org,37401,1676599266596)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/a8930d4446cbfaf62e358646d1db5a41/.tmp/f1/bb46fd5d51b64ef4aa69b2fc9f382113 2023-02-17 02:01:14,193 INFO [rs(jenkins-hbase4.apache.org,37401,1676599266596)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/b213250f6e3c76397fc5267bf5934c3e/.tmp/f2/db4a9c73b7274ef4ada26fa9b8d4952b 2023-02-17 02:01:14,202 INFO [rs(jenkins-hbase4.apache.org,34495,1676599266651)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/4d5096d14486c6ef9123841c928ad2ea/.tmp/f2/5a507af0de4d46b782398dc36f4fdcbd 2023-02-17 02:01:14,205 INFO [rs(jenkins-hbase4.apache.org,37401,1676599266596)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/4ed625a5af4623dec3e6c74a1f7180c6/.tmp/f2/4e0ba91d3ae04d2b85277ea88ef2374d 2023-02-17 02:01:14,207 INFO [rs(jenkins-hbase4.apache.org,37401,1676599266596)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/a8930d4446cbfaf62e358646d1db5a41/.tmp/f2/9e400d90f7364c2f9245fb17f5d046f1 2023-02-17 02:01:14,211 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/b213250f6e3c76397fc5267bf5934c3e/.tmp/f1/b764110361ab45439fc2a4fe3e733f41 as hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/b213250f6e3c76397fc5267bf5934c3e/f1/b764110361ab45439fc2a4fe3e733f41 2023-02-17 02:01:14,212 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/4d5096d14486c6ef9123841c928ad2ea/.tmp/f1/0f623e170a8544df993946f6a66737fd as hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/4d5096d14486c6ef9123841c928ad2ea/f1/0f623e170a8544df993946f6a66737fd 2023-02-17 02:01:14,218 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/a8930d4446cbfaf62e358646d1db5a41/.tmp/f1/bb46fd5d51b64ef4aa69b2fc9f382113 as hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/a8930d4446cbfaf62e358646d1db5a41/f1/bb46fd5d51b64ef4aa69b2fc9f382113 2023-02-17 02:01:14,218 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/4ed625a5af4623dec3e6c74a1f7180c6/.tmp/f1/82b52401df184524ad58392cebf98a2e as hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/4ed625a5af4623dec3e6c74a1f7180c6/f1/82b52401df184524ad58392cebf98a2e 2023-02-17 02:01:14,220 INFO [rs(jenkins-hbase4.apache.org,37401,1676599266596)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/b213250f6e3c76397fc5267bf5934c3e/f1/b764110361ab45439fc2a4fe3e733f41, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 02:01:14,223 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/b213250f6e3c76397fc5267bf5934c3e/.tmp/f2/db4a9c73b7274ef4ada26fa9b8d4952b as hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/b213250f6e3c76397fc5267bf5934c3e/f2/db4a9c73b7274ef4ada26fa9b8d4952b 2023-02-17 02:01:14,224 INFO [rs(jenkins-hbase4.apache.org,34495,1676599266651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/4d5096d14486c6ef9123841c928ad2ea/f1/0f623e170a8544df993946f6a66737fd, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 02:01:14,227 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/4d5096d14486c6ef9123841c928ad2ea/.tmp/f2/5a507af0de4d46b782398dc36f4fdcbd as hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/4d5096d14486c6ef9123841c928ad2ea/f2/5a507af0de4d46b782398dc36f4fdcbd 2023-02-17 02:01:14,230 INFO [rs(jenkins-hbase4.apache.org,37401,1676599266596)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/a8930d4446cbfaf62e358646d1db5a41/f1/bb46fd5d51b64ef4aa69b2fc9f382113, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 02:01:14,233 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/a8930d4446cbfaf62e358646d1db5a41/.tmp/f2/9e400d90f7364c2f9245fb17f5d046f1 as hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/a8930d4446cbfaf62e358646d1db5a41/f2/9e400d90f7364c2f9245fb17f5d046f1 2023-02-17 02:01:14,235 INFO [rs(jenkins-hbase4.apache.org,37401,1676599266596)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/4ed625a5af4623dec3e6c74a1f7180c6/f1/82b52401df184524ad58392cebf98a2e, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-17 02:01:14,238 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/4ed625a5af4623dec3e6c74a1f7180c6/.tmp/f2/4e0ba91d3ae04d2b85277ea88ef2374d as hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/4ed625a5af4623dec3e6c74a1f7180c6/f2/4e0ba91d3ae04d2b85277ea88ef2374d 2023-02-17 02:01:14,240 INFO [rs(jenkins-hbase4.apache.org,37401,1676599266596)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/b213250f6e3c76397fc5267bf5934c3e/f2/db4a9c73b7274ef4ada26fa9b8d4952b, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 02:01:14,240 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-17 02:01:14,241 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-17 02:01:14,241 INFO [rs(jenkins-hbase4.apache.org,37401,1676599266596)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for b213250f6e3c76397fc5267bf5934c3e in 231ms, sequenceid=9, compaction requested=false 2023-02-17 02:01:14,241 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for b213250f6e3c76397fc5267bf5934c3e: 2023-02-17 02:01:14,241 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1676599269734.b213250f6e3c76397fc5267bf5934c3e. 2023-02-17 02:01:14,241 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1676599269734.70f7ef12da22dd3ef39c2af364b54ddd. 2023-02-17 02:01:14,241 DEBUG [member: 'jenkins-hbase4.apache.org,37401,1676599266596' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-17 02:01:14,241 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1676599269734.70f7ef12da22dd3ef39c2af364b54ddd. started... 2023-02-17 02:01:14,242 INFO [rs(jenkins-hbase4.apache.org,37401,1676599266596)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 70f7ef12da22dd3ef39c2af364b54ddd 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-17 02:01:14,242 INFO [rs(jenkins-hbase4.apache.org,37401,1676599266596)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/a8930d4446cbfaf62e358646d1db5a41/f2/9e400d90f7364c2f9245fb17f5d046f1, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 02:01:14,244 INFO [rs(jenkins-hbase4.apache.org,37401,1676599266596)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for a8930d4446cbfaf62e358646d1db5a41 in 233ms, sequenceid=9, compaction requested=false 2023-02-17 02:01:14,244 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for a8930d4446cbfaf62e358646d1db5a41: 2023-02-17 02:01:14,245 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1676599269734.a8930d4446cbfaf62e358646d1db5a41. 2023-02-17 02:01:14,245 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1676599269734.3c50622abf2210dda1717f4c123254eb. 2023-02-17 02:01:14,245 DEBUG [member: 'jenkins-hbase4.apache.org,37401,1676599266596' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-17 02:01:14,245 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1676599269734.3c50622abf2210dda1717f4c123254eb. started... 2023-02-17 02:01:14,245 INFO [rs(jenkins-hbase4.apache.org,37401,1676599266596)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 3c50622abf2210dda1717f4c123254eb 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-17 02:01:14,257 INFO [rs(jenkins-hbase4.apache.org,34495,1676599266651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/4d5096d14486c6ef9123841c928ad2ea/f2/5a507af0de4d46b782398dc36f4fdcbd, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 02:01:14,259 INFO [rs(jenkins-hbase4.apache.org,37401,1676599266596)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/4ed625a5af4623dec3e6c74a1f7180c6/f2/4e0ba91d3ae04d2b85277ea88ef2374d, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-17 02:01:14,259 INFO [rs(jenkins-hbase4.apache.org,34495,1676599266651)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 4d5096d14486c6ef9123841c928ad2ea in 242ms, sequenceid=9, compaction requested=false 2023-02-17 02:01:14,259 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 4d5096d14486c6ef9123841c928ad2ea: 2023-02-17 02:01:14,260 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1676599269734.4d5096d14486c6ef9123841c928ad2ea. 2023-02-17 02:01:14,260 DEBUG [member: 'jenkins-hbase4.apache.org,34495,1676599266651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-17 02:01:14,260 INFO [rs(jenkins-hbase4.apache.org,37401,1676599266596)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 4ed625a5af4623dec3e6c74a1f7180c6 in 240ms, sequenceid=9, compaction requested=false 2023-02-17 02:01:14,260 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 4ed625a5af4623dec3e6c74a1f7180c6: 2023-02-17 02:01:14,260 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1676599269734.4ed625a5af4623dec3e6c74a1f7180c6. 2023-02-17 02:01:14,260 DEBUG [member: 'jenkins-hbase4.apache.org,37401,1676599266596' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-17 02:01:14,271 WARN [DataStreamer for file /user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/3c50622abf2210dda1717f4c123254eb/.tmp/f1/dfb14fc632c640f9a9954c4d25c7bf7f] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:630) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:807) 2023-02-17 02:01:14,272 WARN [DataStreamer for file /user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/70f7ef12da22dd3ef39c2af364b54ddd/.tmp/f1/a217dac540354aacaaa128717a2b9cf8] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:630) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:807) 2023-02-17 02:01:14,272 INFO [rs(jenkins-hbase4.apache.org,37401,1676599266596)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/70f7ef12da22dd3ef39c2af364b54ddd/.tmp/f1/a217dac540354aacaaa128717a2b9cf8 2023-02-17 02:01:14,272 INFO [rs(jenkins-hbase4.apache.org,37401,1676599266596)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/3c50622abf2210dda1717f4c123254eb/.tmp/f1/dfb14fc632c640f9a9954c4d25c7bf7f 2023-02-17 02:01:14,292 INFO [rs(jenkins-hbase4.apache.org,37401,1676599266596)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/70f7ef12da22dd3ef39c2af364b54ddd/.tmp/f2/0456b61cd913422ca332a8845e832c05 2023-02-17 02:01:14,296 INFO [rs(jenkins-hbase4.apache.org,37401,1676599266596)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/3c50622abf2210dda1717f4c123254eb/.tmp/f2/523f7bfc44a148db8aa7265f3e0c40c2 2023-02-17 02:01:14,300 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/70f7ef12da22dd3ef39c2af364b54ddd/.tmp/f1/a217dac540354aacaaa128717a2b9cf8 as hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/70f7ef12da22dd3ef39c2af364b54ddd/f1/a217dac540354aacaaa128717a2b9cf8 2023-02-17 02:01:14,302 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/3c50622abf2210dda1717f4c123254eb/.tmp/f1/dfb14fc632c640f9a9954c4d25c7bf7f as hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/3c50622abf2210dda1717f4c123254eb/f1/dfb14fc632c640f9a9954c4d25c7bf7f 2023-02-17 02:01:14,307 INFO [rs(jenkins-hbase4.apache.org,37401,1676599266596)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/70f7ef12da22dd3ef39c2af364b54ddd/f1/a217dac540354aacaaa128717a2b9cf8, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-17 02:01:14,308 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/70f7ef12da22dd3ef39c2af364b54ddd/.tmp/f2/0456b61cd913422ca332a8845e832c05 as hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/70f7ef12da22dd3ef39c2af364b54ddd/f2/0456b61cd913422ca332a8845e832c05 2023-02-17 02:01:14,309 INFO [rs(jenkins-hbase4.apache.org,37401,1676599266596)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/3c50622abf2210dda1717f4c123254eb/f1/dfb14fc632c640f9a9954c4d25c7bf7f, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 02:01:14,310 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/3c50622abf2210dda1717f4c123254eb/.tmp/f2/523f7bfc44a148db8aa7265f3e0c40c2 as hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/3c50622abf2210dda1717f4c123254eb/f2/523f7bfc44a148db8aa7265f3e0c40c2 2023-02-17 02:01:14,316 INFO [rs(jenkins-hbase4.apache.org,37401,1676599266596)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/70f7ef12da22dd3ef39c2af364b54ddd/f2/0456b61cd913422ca332a8845e832c05, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-17 02:01:14,316 INFO [rs(jenkins-hbase4.apache.org,37401,1676599266596)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/3c50622abf2210dda1717f4c123254eb/f2/523f7bfc44a148db8aa7265f3e0c40c2, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 02:01:14,317 INFO [rs(jenkins-hbase4.apache.org,37401,1676599266596)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 70f7ef12da22dd3ef39c2af364b54ddd in 75ms, sequenceid=9, compaction requested=false 2023-02-17 02:01:14,317 INFO [rs(jenkins-hbase4.apache.org,37401,1676599266596)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 3c50622abf2210dda1717f4c123254eb in 72ms, sequenceid=9, compaction requested=false 2023-02-17 02:01:14,317 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 70f7ef12da22dd3ef39c2af364b54ddd: 2023-02-17 02:01:14,317 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 3c50622abf2210dda1717f4c123254eb: 2023-02-17 02:01:14,317 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1676599269734.70f7ef12da22dd3ef39c2af364b54ddd. 2023-02-17 02:01:14,317 DEBUG [rs(jenkins-hbase4.apache.org,37401,1676599266596)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1676599269734.3c50622abf2210dda1717f4c123254eb. 2023-02-17 02:01:14,318 DEBUG [member: 'jenkins-hbase4.apache.org,37401,1676599266596' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-17 02:01:14,318 DEBUG [member: 'jenkins-hbase4.apache.org,37401,1676599266596' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-17 02:01:14,318 DEBUG [member: 'jenkins-hbase4.apache.org,37401,1676599266596' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-17 02:01:14,318 DEBUG [member: 'jenkins-hbase4.apache.org,37401,1676599266596' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37401,1676599266596 2023-02-17 02:01:14,318 DEBUG [member: 'jenkins-hbase4.apache.org,37401,1676599266596' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-17 02:01:14,318 DEBUG [member: 'jenkins-hbase4.apache.org,37401,1676599266596' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37401,1676599266596' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-17 02:01:14,321 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,37401,1676599266596 2023-02-17 02:01:14,321 DEBUG [member: 'jenkins-hbase4.apache.org,37401,1676599266596' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 02:01:14,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,37401,1676599266596 2023-02-17 02:01:14,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 02:01:14,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-17 02:01:14,321 DEBUG [member: 'jenkins-hbase4.apache.org,37401,1676599266596' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37401-0x10060026e590001, quorum=127.0.0.1:50037, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 02:01:14,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 02:01:14,321 DEBUG [member: 'jenkins-hbase4.apache.org,37401,1676599266596' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 02:01:14,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 02:01:14,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-17 02:01:14,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37401,1676599266596 2023-02-17 02:01:14,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 02:01:14,323 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37401,1676599266596' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-17 02:01:14,323 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4f45c824[Count = 1] remaining members to acquire global barrier 2023-02-17 02:01:14,510 INFO [rs(jenkins-hbase4.apache.org,34495,1676599266651)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/6a46e9ed5ad2c334585050f964998e61/.tmp/f1/528b8c68bca649439fde7ed6f9412817 2023-02-17 02:01:14,526 INFO [rs(jenkins-hbase4.apache.org,34495,1676599266651)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/6a46e9ed5ad2c334585050f964998e61/.tmp/f2/4e9d835402ed4915890e571cf1aa8e4a 2023-02-17 02:01:14,533 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/6a46e9ed5ad2c334585050f964998e61/.tmp/f1/528b8c68bca649439fde7ed6f9412817 as hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/6a46e9ed5ad2c334585050f964998e61/f1/528b8c68bca649439fde7ed6f9412817 2023-02-17 02:01:14,539 INFO [rs(jenkins-hbase4.apache.org,34495,1676599266651)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/6a46e9ed5ad2c334585050f964998e61/f1/528b8c68bca649439fde7ed6f9412817, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 02:01:14,540 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/6a46e9ed5ad2c334585050f964998e61/.tmp/f2/4e9d835402ed4915890e571cf1aa8e4a as hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/6a46e9ed5ad2c334585050f964998e61/f2/4e9d835402ed4915890e571cf1aa8e4a 2023-02-17 02:01:14,546 INFO [rs(jenkins-hbase4.apache.org,34495,1676599266651)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/6a46e9ed5ad2c334585050f964998e61/f2/4e9d835402ed4915890e571cf1aa8e4a, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 02:01:14,547 INFO [rs(jenkins-hbase4.apache.org,34495,1676599266651)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 6a46e9ed5ad2c334585050f964998e61 in 532ms, sequenceid=9, compaction requested=false 2023-02-17 02:01:14,547 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 6a46e9ed5ad2c334585050f964998e61: 2023-02-17 02:01:14,547 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1676599269734.6a46e9ed5ad2c334585050f964998e61. 2023-02-17 02:01:14,547 DEBUG [member: 'jenkins-hbase4.apache.org,34495,1676599266651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-17 02:01:14,608 INFO [rs(jenkins-hbase4.apache.org,34495,1676599266651)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/b3da13e5dcdc5200c5067deebd89a3b4/.tmp/f2/980ddbe3f59c4a1d8b84073ae45cd6a7 2023-02-17 02:01:14,615 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/b3da13e5dcdc5200c5067deebd89a3b4/.tmp/f1/36a60ab05e1c4dd48461e0681235cdd8 as hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/b3da13e5dcdc5200c5067deebd89a3b4/f1/36a60ab05e1c4dd48461e0681235cdd8 2023-02-17 02:01:14,621 INFO [rs(jenkins-hbase4.apache.org,34495,1676599266651)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/b3da13e5dcdc5200c5067deebd89a3b4/f1/36a60ab05e1c4dd48461e0681235cdd8, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 02:01:14,622 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/b3da13e5dcdc5200c5067deebd89a3b4/.tmp/f2/980ddbe3f59c4a1d8b84073ae45cd6a7 as hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/b3da13e5dcdc5200c5067deebd89a3b4/f2/980ddbe3f59c4a1d8b84073ae45cd6a7 2023-02-17 02:01:14,628 INFO [rs(jenkins-hbase4.apache.org,34495,1676599266651)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/b3da13e5dcdc5200c5067deebd89a3b4/f2/980ddbe3f59c4a1d8b84073ae45cd6a7, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 02:01:14,629 INFO [rs(jenkins-hbase4.apache.org,34495,1676599266651)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for b3da13e5dcdc5200c5067deebd89a3b4 in 614ms, sequenceid=9, compaction requested=false 2023-02-17 02:01:14,629 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for b3da13e5dcdc5200c5067deebd89a3b4: 2023-02-17 02:01:14,629 DEBUG [rs(jenkins-hbase4.apache.org,34495,1676599266651)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1676599269734.b3da13e5dcdc5200c5067deebd89a3b4. 2023-02-17 02:01:14,629 DEBUG [member: 'jenkins-hbase4.apache.org,34495,1676599266651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-17 02:01:14,629 DEBUG [member: 'jenkins-hbase4.apache.org,34495,1676599266651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-17 02:01:14,629 DEBUG [member: 'jenkins-hbase4.apache.org,34495,1676599266651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,34495,1676599266651 2023-02-17 02:01:14,629 DEBUG [member: 'jenkins-hbase4.apache.org,34495,1676599266651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-17 02:01:14,630 DEBUG [member: 'jenkins-hbase4.apache.org,34495,1676599266651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34495,1676599266651' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-17 02:01:14,632 DEBUG [member: 'jenkins-hbase4.apache.org,34495,1676599266651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 02:01:14,632 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,34495,1676599266651 2023-02-17 02:01:14,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,34495,1676599266651 2023-02-17 02:01:14,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 02:01:14,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-17 02:01:14,633 DEBUG [member: 'jenkins-hbase4.apache.org,34495,1676599266651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34495-0x10060026e590002, quorum=127.0.0.1:50037, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 02:01:14,633 DEBUG [member: 'jenkins-hbase4.apache.org,34495,1676599266651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 02:01:14,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 02:01:14,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 02:01:14,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-17 02:01:14,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34495,1676599266651 2023-02-17 02:01:14,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37401,1676599266596 2023-02-17 02:01:14,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 02:01:14,635 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34495,1676599266651' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-17 02:01:14,635 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4f45c824[Count = 0] remaining members to acquire global barrier 2023-02-17 02:01:14,635 DEBUG [(jenkins-hbase4.apache.org,39477,1676599265371)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-17 02:01:14,635 DEBUG [(jenkins-hbase4.apache.org,39477,1676599265371)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 02:01:14,637 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): regionserver:37401-0x10060026e590001, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 02:01:14,637 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): regionserver:34495-0x10060026e590002, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 02:01:14,637 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 02:01:14,637 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 02:01:14,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 02:01:14,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 02:01:14,637 DEBUG [member: 'jenkins-hbase4.apache.org,37401,1676599266596' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-17 02:01:14,637 DEBUG [member: 'jenkins-hbase4.apache.org,34495,1676599266651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-17 02:01:14,637 DEBUG [member: 'jenkins-hbase4.apache.org,37401,1676599266596' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-17 02:01:14,637 DEBUG [member: 'jenkins-hbase4.apache.org,37401,1676599266596' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,37401,1676599266596' in zk 2023-02-17 02:01:14,637 DEBUG [(jenkins-hbase4.apache.org,39477,1676599265371)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,37401,1676599266596 2023-02-17 02:01:14,637 DEBUG [member: 'jenkins-hbase4.apache.org,34495,1676599266651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-17 02:01:14,637 DEBUG [member: 'jenkins-hbase4.apache.org,34495,1676599266651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,34495,1676599266651' in zk 2023-02-17 02:01:14,638 DEBUG [(jenkins-hbase4.apache.org,39477,1676599265371)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,34495,1676599266651 2023-02-17 02:01:14,638 DEBUG [(jenkins-hbase4.apache.org,39477,1676599265371)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-17 02:01:14,640 DEBUG [member: 'jenkins-hbase4.apache.org,37401,1676599266596' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-17 02:01:14,640 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,37401,1676599266596 2023-02-17 02:01:14,640 DEBUG [member: 'jenkins-hbase4.apache.org,37401,1676599266596' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 02:01:14,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,37401,1676599266596 2023-02-17 02:01:14,640 DEBUG [member: 'jenkins-hbase4.apache.org,37401,1676599266596' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-17 02:01:14,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 02:01:14,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-17 02:01:14,640 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,34495,1676599266651 2023-02-17 02:01:14,640 DEBUG [member: 'jenkins-hbase4.apache.org,34495,1676599266651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-17 02:01:14,641 DEBUG [member: 'jenkins-hbase4.apache.org,34495,1676599266651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 02:01:14,641 DEBUG [member: 'jenkins-hbase4.apache.org,34495,1676599266651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-17 02:01:14,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 02:01:14,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 02:01:14,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-17 02:01:14,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34495,1676599266651 2023-02-17 02:01:14,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37401,1676599266596 2023-02-17 02:01:14,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 02:01:14,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-17 02:01:14,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34495,1676599266651 2023-02-17 02:01:14,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37401,1676599266596 2023-02-17 02:01:14,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,37401,1676599266596': 2023-02-17 02:01:14,645 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37401,1676599266596' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-17 02:01:14,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,34495,1676599266651 2023-02-17 02:01:14,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 02:01:14,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-17 02:01:14,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 02:01:14,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 02:01:14,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-17 02:01:14,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34495,1676599266651 2023-02-17 02:01:14,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37401,1676599266596 2023-02-17 02:01:14,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 02:01:14,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-17 02:01:14,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34495,1676599266651 2023-02-17 02:01:14,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37401,1676599266596 2023-02-17 02:01:14,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,34495,1676599266651': 2023-02-17 02:01:14,649 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34495,1676599266651' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-17 02:01:14,649 INFO [(jenkins-hbase4.apache.org,39477,1676599265371)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-17 02:01:14,649 DEBUG [(jenkins-hbase4.apache.org,39477,1676599265371)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-17 02:01:14,649 DEBUG [(jenkins-hbase4.apache.org,39477,1676599265371)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-17 02:01:14,649 DEBUG [(jenkins-hbase4.apache.org,39477,1676599265371)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-17 02:01:14,649 INFO [(jenkins-hbase4.apache.org,39477,1676599265371)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-17 02:01:14,653 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): regionserver:37401-0x10060026e590001, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 02:01:14,653 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 02:01:14,653 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 02:01:14,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 02:01:14,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 02:01:14,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-17 02:01:14,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 02:01:14,653 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): regionserver:34495-0x10060026e590002, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 02:01:14,653 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): regionserver:37401-0x10060026e590001, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 02:01:14,654 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 02:01:14,654 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): regionserver:34495-0x10060026e590002, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 02:01:14,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 02:01:14,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 02:01:14,654 DEBUG [(jenkins-hbase4.apache.org,39477,1676599265371)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,34495,1676599266651 2023-02-17 02:01:14,654 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 02:01:14,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 02:01:14,655 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 02:01:14,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 02:01:14,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 02:01:14,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-17 02:01:14,655 DEBUG [(jenkins-hbase4.apache.org,39477,1676599265371)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,37401,1676599266596 2023-02-17 02:01:14,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 02:01:14,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 02:01:14,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-17 02:01:14,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34495,1676599266651 2023-02-17 02:01:14,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37401,1676599266596 2023-02-17 02:01:14,657 DEBUG [(jenkins-hbase4.apache.org,39477,1676599265371)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,34495,1676599266651 2023-02-17 02:01:14,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 02:01:14,657 DEBUG [(jenkins-hbase4.apache.org,39477,1676599265371)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,37401,1676599266596 2023-02-17 02:01:14,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-17 02:01:14,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34495,1676599266651 2023-02-17 02:01:14,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37401,1676599266596 2023-02-17 02:01:14,662 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,37401,1676599266596 2023-02-17 02:01:14,662 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-17 02:01:14,662 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): regionserver:34495-0x10060026e590002, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 02:01:14,662 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-17 02:01:14,663 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-17 02:01:14,663 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): regionserver:37401-0x10060026e590001, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 02:01:14,663 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): regionserver:37401-0x10060026e590001, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 02:01:14,662 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,34495,1676599266651 2023-02-17 02:01:14,662 DEBUG [(jenkins-hbase4.apache.org,39477,1676599265371)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 02:01:14,663 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-17 02:01:14,663 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,37401,1676599266596 2023-02-17 02:01:14,663 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 02:01:14,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 02:01:14,663 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 02:01:14,662 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): regionserver:34495-0x10060026e590002, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 02:01:14,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 02:01:14,663 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 02:01:14,664 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,34495,1676599266651 2023-02-17 02:01:14,664 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 02:01:14,664 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 02:01:14,664 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 02:01:14,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 02:01:14,664 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 02:01:14,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 02:01:14,665 DEBUG [Listener at localhost/39237] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-17 02:01:14,666 DEBUG [Listener at localhost/39237] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-17 02:01:14,766 DEBUG [Listener at localhost/39237] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-17 02:01:14,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-17 02:01:14,869 DEBUG [Listener at localhost/39237] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9fcbabae-fa27-eae4-5e88-a8a591b6719e/hadoop-2741863450213468045.jar 2023-02-17 02:01:14,888 INFO [Listener at localhost/39237] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1676599271509 type: FLUSH version: 2 ttl: 0 2023-02-17 02:01:14,889 DEBUG [Listener at localhost/39237] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:44409/user/jenkins/test-data/e4a43e2c-5578-9e5b-3d88-cc8c20ec254e/testWithMapReduceMultiRegion/451140b0-0d80-470b-91bb-e0cd22c5451f/data/default/testWithMapReduce 2023-02-17 02:01:14,890 INFO [Listener at localhost/39237] snapshot.RestoreSnapshotHelper(239): region to add: 4fb7511bdaa2707fcc86962500b3c078 2023-02-17 02:01:14,890 INFO [Listener at localhost/39237] snapshot.RestoreSnapshotHelper(239): region to add: 6a46e9ed5ad2c334585050f964998e61 2023-02-17 02:01:14,890 INFO [Listener at localhost/39237] snapshot.RestoreSnapshotHelper(239): region to add: a8930d4446cbfaf62e358646d1db5a41 2023-02-17 02:01:14,891 INFO [Listener at localhost/39237] snapshot.RestoreSnapshotHelper(239): region to add: b213250f6e3c76397fc5267bf5934c3e 2023-02-17 02:01:14,891 INFO [Listener at localhost/39237] snapshot.RestoreSnapshotHelper(239): region to add: 60da012c2f8c7fe0ec391ffacffa21f0 2023-02-17 02:01:14,891 INFO [Listener at localhost/39237] snapshot.RestoreSnapshotHelper(239): region to add: 4ed625a5af4623dec3e6c74a1f7180c6 2023-02-17 02:01:14,891 INFO [Listener at localhost/39237] snapshot.RestoreSnapshotHelper(239): region to add: 70f7ef12da22dd3ef39c2af364b54ddd 2023-02-17 02:01:14,891 INFO [Listener at localhost/39237] snapshot.RestoreSnapshotHelper(239): region to add: 4d5096d14486c6ef9123841c928ad2ea 2023-02-17 02:01:14,891 INFO [Listener at localhost/39237] snapshot.RestoreSnapshotHelper(239): region to add: b3da13e5dcdc5200c5067deebd89a3b4 2023-02-17 02:01:14,891 INFO [Listener at localhost/39237] snapshot.RestoreSnapshotHelper(239): region to add: 3c50622abf2210dda1717f4c123254eb 2023-02-17 02:01:14,892 INFO [Listener at localhost/39237] snapshot.RestoreSnapshotHelper(585): clone region=4fb7511bdaa2707fcc86962500b3c078 as 4fb7511bdaa2707fcc86962500b3c078 in snapshot testWithMapReduceMultiRegion 2023-02-17 02:01:14,892 INFO [Listener at localhost/39237] snapshot.RestoreSnapshotHelper(585): clone region=6a46e9ed5ad2c334585050f964998e61 as 6a46e9ed5ad2c334585050f964998e61 in snapshot testWithMapReduceMultiRegion 2023-02-17 02:01:14,892 INFO [Listener at localhost/39237] snapshot.RestoreSnapshotHelper(585): clone region=a8930d4446cbfaf62e358646d1db5a41 as a8930d4446cbfaf62e358646d1db5a41 in snapshot testWithMapReduceMultiRegion 2023-02-17 02:01:14,892 INFO [Listener at localhost/39237] snapshot.RestoreSnapshotHelper(585): clone region=b213250f6e3c76397fc5267bf5934c3e as b213250f6e3c76397fc5267bf5934c3e in snapshot testWithMapReduceMultiRegion 2023-02-17 02:01:14,892 INFO [Listener at localhost/39237] snapshot.RestoreSnapshotHelper(585): clone region=60da012c2f8c7fe0ec391ffacffa21f0 as 60da012c2f8c7fe0ec391ffacffa21f0 in snapshot testWithMapReduceMultiRegion 2023-02-17 02:01:14,892 INFO [Listener at localhost/39237] snapshot.RestoreSnapshotHelper(585): clone region=4ed625a5af4623dec3e6c74a1f7180c6 as 4ed625a5af4623dec3e6c74a1f7180c6 in snapshot testWithMapReduceMultiRegion 2023-02-17 02:01:14,892 INFO [Listener at localhost/39237] snapshot.RestoreSnapshotHelper(585): clone region=70f7ef12da22dd3ef39c2af364b54ddd as 70f7ef12da22dd3ef39c2af364b54ddd in snapshot testWithMapReduceMultiRegion 2023-02-17 02:01:14,893 INFO [Listener at localhost/39237] snapshot.RestoreSnapshotHelper(585): clone region=4d5096d14486c6ef9123841c928ad2ea as 4d5096d14486c6ef9123841c928ad2ea in snapshot testWithMapReduceMultiRegion 2023-02-17 02:01:14,893 INFO [Listener at localhost/39237] snapshot.RestoreSnapshotHelper(585): clone region=b3da13e5dcdc5200c5067deebd89a3b4 as b3da13e5dcdc5200c5067deebd89a3b4 in snapshot testWithMapReduceMultiRegion 2023-02-17 02:01:14,893 INFO [Listener at localhost/39237] snapshot.RestoreSnapshotHelper(585): clone region=3c50622abf2210dda1717f4c123254eb as 3c50622abf2210dda1717f4c123254eb in snapshot testWithMapReduceMultiRegion 2023-02-17 02:01:14,896 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 70f7ef12da22dd3ef39c2af364b54ddd, NAME => 'testWithMapReduce,aaa,1676599269734.70f7ef12da22dd3ef39c2af364b54ddd.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44409/user/jenkins/test-data/e4a43e2c-5578-9e5b-3d88-cc8c20ec254e/testWithMapReduceMultiRegion/451140b0-0d80-470b-91bb-e0cd22c5451f 2023-02-17 02:01:14,897 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => b213250f6e3c76397fc5267bf5934c3e, NAME => 'testWithMapReduce,t43,1676599269734.b213250f6e3c76397fc5267bf5934c3e.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44409/user/jenkins/test-data/e4a43e2c-5578-9e5b-3d88-cc8c20ec254e/testWithMapReduceMultiRegion/451140b0-0d80-470b-91bb-e0cd22c5451f 2023-02-17 02:01:14,897 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 6a46e9ed5ad2c334585050f964998e61, NAME => 'testWithMapReduce,q\x11\x10,1676599269734.6a46e9ed5ad2c334585050f964998e61.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44409/user/jenkins/test-data/e4a43e2c-5578-9e5b-3d88-cc8c20ec254e/testWithMapReduceMultiRegion/451140b0-0d80-470b-91bb-e0cd22c5451f 2023-02-17 02:01:14,897 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => a8930d4446cbfaf62e358646d1db5a41, NAME => 'testWithMapReduce,d\x84\x84,1676599269734.a8930d4446cbfaf62e358646d1db5a41.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44409/user/jenkins/test-data/e4a43e2c-5578-9e5b-3d88-cc8c20ec254e/testWithMapReduceMultiRegion/451140b0-0d80-470b-91bb-e0cd22c5451f 2023-02-17 02:01:14,897 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 4d5096d14486c6ef9123841c928ad2ea, NAME => 'testWithMapReduce,m\xED\xED,1676599269734.4d5096d14486c6ef9123841c928ad2ea.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44409/user/jenkins/test-data/e4a43e2c-5578-9e5b-3d88-cc8c20ec254e/testWithMapReduceMultiRegion/451140b0-0d80-470b-91bb-e0cd22c5451f 2023-02-17 02:01:14,897 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 60da012c2f8c7fe0ec391ffacffa21f0, NAME => 'testWithMapReduce,,1676599269734.60da012c2f8c7fe0ec391ffacffa21f0.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44409/user/jenkins/test-data/e4a43e2c-5578-9e5b-3d88-cc8c20ec254e/testWithMapReduceMultiRegion/451140b0-0d80-470b-91bb-e0cd22c5451f 2023-02-17 02:01:14,897 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 4ed625a5af4623dec3e6c74a1f7180c6, NAME => 'testWithMapReduce,wWV,1676599269734.4ed625a5af4623dec3e6c74a1f7180c6.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44409/user/jenkins/test-data/e4a43e2c-5578-9e5b-3d88-cc8c20ec254e/testWithMapReduceMultiRegion/451140b0-0d80-470b-91bb-e0cd22c5451f 2023-02-17 02:01:14,897 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 4fb7511bdaa2707fcc86962500b3c078, NAME => 'testWithMapReduce,zz{,1676599269734.4fb7511bdaa2707fcc86962500b3c078.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44409/user/jenkins/test-data/e4a43e2c-5578-9e5b-3d88-cc8c20ec254e/testWithMapReduceMultiRegion/451140b0-0d80-470b-91bb-e0cd22c5451f 2023-02-17 02:01:14,935 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676599269734.4ed625a5af4623dec3e6c74a1f7180c6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:14,935 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676599269734.4fb7511bdaa2707fcc86962500b3c078.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:14,935 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676599269734.6a46e9ed5ad2c334585050f964998e61.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:14,936 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 4fb7511bdaa2707fcc86962500b3c078, disabling compactions & flushes 2023-02-17 02:01:14,935 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d382863b46a94de7aadcd5b897c03972 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-17 02:01:14,936 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676599269734.4fb7511bdaa2707fcc86962500b3c078. 2023-02-17 02:01:14,936 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9a482387f4d54932b01672de529d047e from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-17 02:01:14,936 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676599269734.4fb7511bdaa2707fcc86962500b3c078. 2023-02-17 02:01:14,936 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676599269734.4fb7511bdaa2707fcc86962500b3c078. after waiting 0 ms 2023-02-17 02:01:14,936 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676599269734.4fb7511bdaa2707fcc86962500b3c078. 2023-02-17 02:01:14,936 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676599269734.4fb7511bdaa2707fcc86962500b3c078. 2023-02-17 02:01:14,936 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 4fb7511bdaa2707fcc86962500b3c078: 2023-02-17 02:01:14,937 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => b3da13e5dcdc5200c5067deebd89a3b4, NAME => 'testWithMapReduce,g\xA7\xA7,1676599269734.b3da13e5dcdc5200c5067deebd89a3b4.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44409/user/jenkins/test-data/e4a43e2c-5578-9e5b-3d88-cc8c20ec254e/testWithMapReduceMultiRegion/451140b0-0d80-470b-91bb-e0cd22c5451f 2023-02-17 02:01:14,949 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676599269734.60da012c2f8c7fe0ec391ffacffa21f0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:14,949 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 60da012c2f8c7fe0ec391ffacffa21f0, disabling compactions & flushes 2023-02-17 02:01:14,949 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676599269734.60da012c2f8c7fe0ec391ffacffa21f0. 2023-02-17 02:01:14,949 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676599269734.60da012c2f8c7fe0ec391ffacffa21f0. 2023-02-17 02:01:14,949 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676599269734.60da012c2f8c7fe0ec391ffacffa21f0. after waiting 0 ms 2023-02-17 02:01:14,949 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676599269734.60da012c2f8c7fe0ec391ffacffa21f0. 2023-02-17 02:01:14,949 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,,1676599269734.60da012c2f8c7fe0ec391ffacffa21f0. 2023-02-17 02:01:14,949 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 60da012c2f8c7fe0ec391ffacffa21f0: 2023-02-17 02:01:14,950 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f0be2190b3f24020a450bb06e832105e from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-17 02:01:14,950 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 3c50622abf2210dda1717f4c123254eb, NAME => 'testWithMapReduce,j\xCA\xCA,1676599269734.3c50622abf2210dda1717f4c123254eb.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44409/user/jenkins/test-data/e4a43e2c-5578-9e5b-3d88-cc8c20ec254e/testWithMapReduceMultiRegion/451140b0-0d80-470b-91bb-e0cd22c5451f 2023-02-17 02:01:14,952 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676599269734.a8930d4446cbfaf62e358646d1db5a41.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:14,952 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 28c40938bb9f49259c9121f3f76cd0bc from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-17 02:01:14,952 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 2cb6ec9838de40e393466e31305dff9d from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-17 02:01:14,963 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 6a46e9ed5ad2c334585050f964998e61, disabling compactions & flushes 2023-02-17 02:01:14,964 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676599269734.6a46e9ed5ad2c334585050f964998e61. 2023-02-17 02:01:14,964 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676599269734.6a46e9ed5ad2c334585050f964998e61. 2023-02-17 02:01:14,964 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676599269734.6a46e9ed5ad2c334585050f964998e61. after waiting 0 ms 2023-02-17 02:01:14,964 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676599269734.6a46e9ed5ad2c334585050f964998e61. 2023-02-17 02:01:14,964 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676599269734.6a46e9ed5ad2c334585050f964998e61. 2023-02-17 02:01:14,964 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 6a46e9ed5ad2c334585050f964998e61: 2023-02-17 02:01:14,964 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676599269734.b213250f6e3c76397fc5267bf5934c3e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:14,964 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 8255554c1457463aa80c1123e8ca9419 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-17 02:01:14,965 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 4ed625a5af4623dec3e6c74a1f7180c6, disabling compactions & flushes 2023-02-17 02:01:14,965 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676599269734.4ed625a5af4623dec3e6c74a1f7180c6. 2023-02-17 02:01:14,965 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676599269734.4ed625a5af4623dec3e6c74a1f7180c6. 2023-02-17 02:01:14,965 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676599269734.4ed625a5af4623dec3e6c74a1f7180c6. after waiting 0 ms 2023-02-17 02:01:14,965 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676599269734.4ed625a5af4623dec3e6c74a1f7180c6. 2023-02-17 02:01:14,965 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676599269734.4ed625a5af4623dec3e6c74a1f7180c6. 2023-02-17 02:01:14,965 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 4ed625a5af4623dec3e6c74a1f7180c6: 2023-02-17 02:01:14,966 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e6640ccd453f4906b0ed3f8cf3b07e80 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-17 02:01:14,966 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676599269734.4d5096d14486c6ef9123841c928ad2ea.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:14,966 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink beb1f4a5373f4eebbb7749c3296e875c from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-17 02:01:14,967 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676599269734.70f7ef12da22dd3ef39c2af364b54ddd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:14,967 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 4dd4450e129c43ad952024fe42c1222f from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-17 02:01:14,975 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676599269734.b3da13e5dcdc5200c5067deebd89a3b4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:14,975 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 54f45e683ff04d808eca260001f90782 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-17 02:01:14,975 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 752df72c44764942b6997c097d06a55c from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-17 02:01:14,976 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d6ea514e04f34b8db33ceb5ebfe7c4d2 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-17 02:01:14,980 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing a8930d4446cbfaf62e358646d1db5a41, disabling compactions & flushes 2023-02-17 02:01:14,980 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 1e07143b10a84aa3b2ec38cfb922dda3 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-17 02:01:14,980 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676599269734.a8930d4446cbfaf62e358646d1db5a41. 2023-02-17 02:01:14,980 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676599269734.a8930d4446cbfaf62e358646d1db5a41. 2023-02-17 02:01:14,980 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676599269734.a8930d4446cbfaf62e358646d1db5a41. after waiting 0 ms 2023-02-17 02:01:14,980 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676599269734.a8930d4446cbfaf62e358646d1db5a41. 2023-02-17 02:01:14,980 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676599269734.a8930d4446cbfaf62e358646d1db5a41. 2023-02-17 02:01:14,980 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for a8930d4446cbfaf62e358646d1db5a41: 2023-02-17 02:01:14,981 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing b213250f6e3c76397fc5267bf5934c3e, disabling compactions & flushes 2023-02-17 02:01:14,981 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676599269734.b213250f6e3c76397fc5267bf5934c3e. 2023-02-17 02:01:14,981 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676599269734.b213250f6e3c76397fc5267bf5934c3e. 2023-02-17 02:01:14,981 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676599269734.b213250f6e3c76397fc5267bf5934c3e. after waiting 0 ms 2023-02-17 02:01:14,981 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676599269734.b213250f6e3c76397fc5267bf5934c3e. 2023-02-17 02:01:14,981 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676599269734.b213250f6e3c76397fc5267bf5934c3e. 2023-02-17 02:01:14,981 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for b213250f6e3c76397fc5267bf5934c3e: 2023-02-17 02:01:14,981 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a9ce531f77fa4c8d9ba8e9c61e3c7c71 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-17 02:01:14,982 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 4d5096d14486c6ef9123841c928ad2ea, disabling compactions & flushes 2023-02-17 02:01:14,982 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676599269734.4d5096d14486c6ef9123841c928ad2ea. 2023-02-17 02:01:14,982 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676599269734.4d5096d14486c6ef9123841c928ad2ea. 2023-02-17 02:01:14,982 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676599269734.4d5096d14486c6ef9123841c928ad2ea. after waiting 0 ms 2023-02-17 02:01:14,982 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676599269734.4d5096d14486c6ef9123841c928ad2ea. 2023-02-17 02:01:14,982 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676599269734.4d5096d14486c6ef9123841c928ad2ea. 2023-02-17 02:01:14,982 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 4d5096d14486c6ef9123841c928ad2ea: 2023-02-17 02:01:14,984 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 70f7ef12da22dd3ef39c2af364b54ddd, disabling compactions & flushes 2023-02-17 02:01:14,984 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676599269734.70f7ef12da22dd3ef39c2af364b54ddd. 2023-02-17 02:01:14,984 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676599269734.70f7ef12da22dd3ef39c2af364b54ddd. 2023-02-17 02:01:14,984 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676599269734.70f7ef12da22dd3ef39c2af364b54ddd. after waiting 0 ms 2023-02-17 02:01:14,984 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676599269734.70f7ef12da22dd3ef39c2af364b54ddd. 2023-02-17 02:01:14,984 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676599269734.70f7ef12da22dd3ef39c2af364b54ddd. 2023-02-17 02:01:14,984 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 70f7ef12da22dd3ef39c2af364b54ddd: 2023-02-17 02:01:14,984 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing b3da13e5dcdc5200c5067deebd89a3b4, disabling compactions & flushes 2023-02-17 02:01:14,984 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676599269734.b3da13e5dcdc5200c5067deebd89a3b4. 2023-02-17 02:01:14,984 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676599269734.3c50622abf2210dda1717f4c123254eb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:14,984 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676599269734.b3da13e5dcdc5200c5067deebd89a3b4. 2023-02-17 02:01:14,985 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 2b0f34e3077e4c0d938384d2c1bc133c from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-17 02:01:14,985 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676599269734.b3da13e5dcdc5200c5067deebd89a3b4. after waiting 0 ms 2023-02-17 02:01:14,985 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676599269734.b3da13e5dcdc5200c5067deebd89a3b4. 2023-02-17 02:01:14,985 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676599269734.b3da13e5dcdc5200c5067deebd89a3b4. 2023-02-17 02:01:14,985 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for b3da13e5dcdc5200c5067deebd89a3b4: 2023-02-17 02:01:14,987 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9fca64ea11194963aa97df2f93a29181 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-17 02:01:14,990 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 3c50622abf2210dda1717f4c123254eb, disabling compactions & flushes 2023-02-17 02:01:14,990 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676599269734.3c50622abf2210dda1717f4c123254eb. 2023-02-17 02:01:14,990 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676599269734.3c50622abf2210dda1717f4c123254eb. 2023-02-17 02:01:14,990 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676599269734.3c50622abf2210dda1717f4c123254eb. after waiting 0 ms 2023-02-17 02:01:14,990 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676599269734.3c50622abf2210dda1717f4c123254eb. 2023-02-17 02:01:14,990 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676599269734.3c50622abf2210dda1717f4c123254eb. 2023-02-17 02:01:14,990 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 3c50622abf2210dda1717f4c123254eb: 2023-02-17 02:01:14,990 INFO [Listener at localhost/39237] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1676599271509 type: FLUSH version: 2 ttl: 0 2023-02-17 02:01:14,990 DEBUG [Listener at localhost/39237] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:44409/user/jenkins/test-data/e4a43e2c-5578-9e5b-3d88-cc8c20ec254e/testWithMapReduceMultiRegion/451140b0-0d80-470b-91bb-e0cd22c5451f 2023-02-17 02:01:14,991 DEBUG [Listener at localhost/39237] util.CommonFSUtils(682): File system contents for path hdfs://localhost:44409/user/jenkins/test-data/e4a43e2c-5578-9e5b-3d88-cc8c20ec254e/testWithMapReduceMultiRegion/451140b0-0d80-470b-91bb-e0cd22c5451f 2023-02-17 02:01:14,991 DEBUG [Listener at localhost/39237] util.CommonFSUtils(699): |-data/ 2023-02-17 02:01:14,992 DEBUG [Listener at localhost/39237] util.CommonFSUtils(699): |----default/ 2023-02-17 02:01:14,992 DEBUG [Listener at localhost/39237] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-17 02:01:14,993 DEBUG [Listener at localhost/39237] util.CommonFSUtils(699): |----------3c50622abf2210dda1717f4c123254eb/ 2023-02-17 02:01:14,994 DEBUG [Listener at localhost/39237] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 02:01:14,994 DEBUG [Listener at localhost/39237] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 02:01:14,994 DEBUG [Listener at localhost/39237] util.CommonFSUtils(702): |----------------testWithMapReduce=3c50622abf2210dda1717f4c123254eb-2b0f34e3077e4c0d938384d2c1bc133c 2023-02-17 02:01:14,994 DEBUG [Listener at localhost/39237] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 02:01:14,995 DEBUG [Listener at localhost/39237] util.CommonFSUtils(702): |----------------testWithMapReduce=3c50622abf2210dda1717f4c123254eb-9fca64ea11194963aa97df2f93a29181 2023-02-17 02:01:14,995 DEBUG [Listener at localhost/39237] util.CommonFSUtils(699): |----------4d5096d14486c6ef9123841c928ad2ea/ 2023-02-17 02:01:14,995 DEBUG [Listener at localhost/39237] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 02:01:14,995 DEBUG [Listener at localhost/39237] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 02:01:14,996 DEBUG [Listener at localhost/39237] util.CommonFSUtils(702): |----------------testWithMapReduce=4d5096d14486c6ef9123841c928ad2ea-beb1f4a5373f4eebbb7749c3296e875c 2023-02-17 02:01:14,996 DEBUG [Listener at localhost/39237] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 02:01:14,996 DEBUG [Listener at localhost/39237] util.CommonFSUtils(702): |----------------testWithMapReduce=4d5096d14486c6ef9123841c928ad2ea-d6ea514e04f34b8db33ceb5ebfe7c4d2 2023-02-17 02:01:14,996 DEBUG [Listener at localhost/39237] util.CommonFSUtils(699): |----------4ed625a5af4623dec3e6c74a1f7180c6/ 2023-02-17 02:01:14,997 DEBUG [Listener at localhost/39237] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 02:01:14,997 DEBUG [Listener at localhost/39237] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 02:01:14,997 DEBUG [Listener at localhost/39237] util.CommonFSUtils(702): |----------------testWithMapReduce=4ed625a5af4623dec3e6c74a1f7180c6-d382863b46a94de7aadcd5b897c03972 2023-02-17 02:01:14,997 DEBUG [Listener at localhost/39237] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 02:01:14,998 DEBUG [Listener at localhost/39237] util.CommonFSUtils(702): |----------------testWithMapReduce=4ed625a5af4623dec3e6c74a1f7180c6-2cb6ec9838de40e393466e31305dff9d 2023-02-17 02:01:14,998 DEBUG [Listener at localhost/39237] util.CommonFSUtils(699): |----------4fb7511bdaa2707fcc86962500b3c078/ 2023-02-17 02:01:14,998 DEBUG [Listener at localhost/39237] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 02:01:14,998 DEBUG [Listener at localhost/39237] util.CommonFSUtils(699): |----------60da012c2f8c7fe0ec391ffacffa21f0/ 2023-02-17 02:01:14,999 DEBUG [Listener at localhost/39237] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 02:01:14,999 DEBUG [Listener at localhost/39237] util.CommonFSUtils(699): |----------6a46e9ed5ad2c334585050f964998e61/ 2023-02-17 02:01:14,999 DEBUG [Listener at localhost/39237] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 02:01:14,999 DEBUG [Listener at localhost/39237] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 02:01:15,000 DEBUG [Listener at localhost/39237] util.CommonFSUtils(702): |----------------testWithMapReduce=6a46e9ed5ad2c334585050f964998e61-9a482387f4d54932b01672de529d047e 2023-02-17 02:01:15,000 DEBUG [Listener at localhost/39237] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 02:01:15,000 DEBUG [Listener at localhost/39237] util.CommonFSUtils(702): |----------------testWithMapReduce=6a46e9ed5ad2c334585050f964998e61-f0be2190b3f24020a450bb06e832105e 2023-02-17 02:01:15,000 DEBUG [Listener at localhost/39237] util.CommonFSUtils(699): |----------70f7ef12da22dd3ef39c2af364b54ddd/ 2023-02-17 02:01:15,001 DEBUG [Listener at localhost/39237] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 02:01:15,001 DEBUG [Listener at localhost/39237] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 02:01:15,001 DEBUG [Listener at localhost/39237] util.CommonFSUtils(702): |----------------testWithMapReduce=70f7ef12da22dd3ef39c2af364b54ddd-4dd4450e129c43ad952024fe42c1222f 2023-02-17 02:01:15,001 DEBUG [Listener at localhost/39237] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 02:01:15,002 DEBUG [Listener at localhost/39237] util.CommonFSUtils(702): |----------------testWithMapReduce=70f7ef12da22dd3ef39c2af364b54ddd-1e07143b10a84aa3b2ec38cfb922dda3 2023-02-17 02:01:15,002 DEBUG [Listener at localhost/39237] util.CommonFSUtils(699): |----------a8930d4446cbfaf62e358646d1db5a41/ 2023-02-17 02:01:15,002 DEBUG [Listener at localhost/39237] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 02:01:15,002 DEBUG [Listener at localhost/39237] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 02:01:15,003 DEBUG [Listener at localhost/39237] util.CommonFSUtils(702): |----------------testWithMapReduce=a8930d4446cbfaf62e358646d1db5a41-28c40938bb9f49259c9121f3f76cd0bc 2023-02-17 02:01:15,003 DEBUG [Listener at localhost/39237] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 02:01:15,003 DEBUG [Listener at localhost/39237] util.CommonFSUtils(702): |----------------testWithMapReduce=a8930d4446cbfaf62e358646d1db5a41-e6640ccd453f4906b0ed3f8cf3b07e80 2023-02-17 02:01:15,003 DEBUG [Listener at localhost/39237] util.CommonFSUtils(699): |----------b213250f6e3c76397fc5267bf5934c3e/ 2023-02-17 02:01:15,004 DEBUG [Listener at localhost/39237] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 02:01:15,004 DEBUG [Listener at localhost/39237] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 02:01:15,004 DEBUG [Listener at localhost/39237] util.CommonFSUtils(702): |----------------testWithMapReduce=b213250f6e3c76397fc5267bf5934c3e-8255554c1457463aa80c1123e8ca9419 2023-02-17 02:01:15,005 DEBUG [Listener at localhost/39237] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 02:01:15,005 DEBUG [Listener at localhost/39237] util.CommonFSUtils(702): |----------------testWithMapReduce=b213250f6e3c76397fc5267bf5934c3e-54f45e683ff04d808eca260001f90782 2023-02-17 02:01:15,005 DEBUG [Listener at localhost/39237] util.CommonFSUtils(699): |----------b3da13e5dcdc5200c5067deebd89a3b4/ 2023-02-17 02:01:15,006 DEBUG [Listener at localhost/39237] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 02:01:15,006 DEBUG [Listener at localhost/39237] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 02:01:15,006 DEBUG [Listener at localhost/39237] util.CommonFSUtils(702): |----------------testWithMapReduce=b3da13e5dcdc5200c5067deebd89a3b4-752df72c44764942b6997c097d06a55c 2023-02-17 02:01:15,006 DEBUG [Listener at localhost/39237] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 02:01:15,007 DEBUG [Listener at localhost/39237] util.CommonFSUtils(702): |----------------testWithMapReduce=b3da13e5dcdc5200c5067deebd89a3b4-a9ce531f77fa4c8d9ba8e9c61e3c7c71 2023-02-17 02:01:15,015 DEBUG [Listener at localhost/39237] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-17 02:01:15,015 DEBUG [Listener at localhost/39237] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-17 02:01:15,016 DEBUG [Listener at localhost/39237] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-17 02:01:15,016 DEBUG [Listener at localhost/39237] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-17 02:01:15,541 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-17 02:01:15,542 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-02-17 02:01:15,909 DEBUG [Listener at localhost/39237] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9fcbabae-fa27-eae4-5e88-a8a591b6719e/hadoop-3957431277271441043.jar 2023-02-17 02:01:15,910 DEBUG [Listener at localhost/39237] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-17 02:01:15,910 DEBUG [Listener at localhost/39237] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-17 02:01:15,977 DEBUG [Listener at localhost/39237] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9fcbabae-fa27-eae4-5e88-a8a591b6719e/hadoop-4462448926724305020.jar 2023-02-17 02:01:15,977 DEBUG [Listener at localhost/39237] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-17 02:01:15,978 DEBUG [Listener at localhost/39237] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-17 02:01:15,978 DEBUG [Listener at localhost/39237] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-17 02:01:15,979 DEBUG [Listener at localhost/39237] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-17 02:01:15,979 DEBUG [Listener at localhost/39237] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-17 02:01:15,979 DEBUG [Listener at localhost/39237] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-17 02:01:15,980 DEBUG [Listener at localhost/39237] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-17 02:01:15,980 DEBUG [Listener at localhost/39237] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-17 02:01:15,981 DEBUG [Listener at localhost/39237] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-17 02:01:15,981 DEBUG [Listener at localhost/39237] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-17 02:01:15,982 DEBUG [Listener at localhost/39237] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-17 02:01:15,982 DEBUG [Listener at localhost/39237] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-17 02:01:15,983 DEBUG [Listener at localhost/39237] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-17 02:01:15,983 DEBUG [Listener at localhost/39237] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-17 02:01:15,983 DEBUG [Listener at localhost/39237] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-17 02:01:15,984 DEBUG [Listener at localhost/39237] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-17 02:01:15,990 DEBUG [Listener at localhost/39237] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-17 02:01:15,990 DEBUG [Listener at localhost/39237] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-17 02:01:15,991 DEBUG [Listener at localhost/39237] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-17 02:01:15,991 DEBUG [Listener at localhost/39237] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-17 02:01:15,992 DEBUG [Listener at localhost/39237] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-17 02:01:16,058 DEBUG [Listener at localhost/39237] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9fcbabae-fa27-eae4-5e88-a8a591b6719e/hadoop-2618890082040486904.jar 2023-02-17 02:01:16,059 DEBUG [Listener at localhost/39237] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-17 02:01:16,110 WARN [Listener at localhost/39237] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-17 02:01:16,126 WARN [Listener at localhost/39237] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-02-17 02:01:16,143 INFO [Listener at localhost/39237] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-17 02:01:16,466 WARN [Listener at localhost/39237] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9fcbabae-fa27-eae4-5e88-a8a591b6719e/mapreduce.cluster.local.dir/1676599276388/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-17 02:01:16,466 WARN [Listener at localhost/39237] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9fcbabae-fa27-eae4-5e88-a8a591b6719e/mapreduce.cluster.local.dir/1676599276388/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-17 02:01:16,611 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676599269734.4fb7511bdaa2707fcc86962500b3c078.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:16,611 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 02:01:16,613 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 02:01:16,615 INFO [StoreOpener-4fb7511bdaa2707fcc86962500b3c078-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4fb7511bdaa2707fcc86962500b3c078 2023-02-17 02:01:16,617 DEBUG [StoreOpener-4fb7511bdaa2707fcc86962500b3c078-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44409/user/jenkins/test-data/e4a43e2c-5578-9e5b-3d88-cc8c20ec254e/testWithMapReduceMultiRegion/451140b0-0d80-470b-91bb-e0cd22c5451f/data/default/testWithMapReduce/4fb7511bdaa2707fcc86962500b3c078/f1 2023-02-17 02:01:16,618 INFO [StoreOpener-4fb7511bdaa2707fcc86962500b3c078-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4fb7511bdaa2707fcc86962500b3c078 columnFamilyName f1 2023-02-17 02:01:16,618 INFO [StoreOpener-4fb7511bdaa2707fcc86962500b3c078-1] regionserver.HStore(310): Store=4fb7511bdaa2707fcc86962500b3c078/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:16,618 INFO [StoreOpener-4fb7511bdaa2707fcc86962500b3c078-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4fb7511bdaa2707fcc86962500b3c078 2023-02-17 02:01:16,620 DEBUG [StoreOpener-4fb7511bdaa2707fcc86962500b3c078-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44409/user/jenkins/test-data/e4a43e2c-5578-9e5b-3d88-cc8c20ec254e/testWithMapReduceMultiRegion/451140b0-0d80-470b-91bb-e0cd22c5451f/data/default/testWithMapReduce/4fb7511bdaa2707fcc86962500b3c078/f2 2023-02-17 02:01:16,621 INFO [StoreOpener-4fb7511bdaa2707fcc86962500b3c078-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4fb7511bdaa2707fcc86962500b3c078 columnFamilyName f2 2023-02-17 02:01:16,621 INFO [StoreOpener-4fb7511bdaa2707fcc86962500b3c078-1] regionserver.HStore(310): Store=4fb7511bdaa2707fcc86962500b3c078/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:16,622 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 02:01:16,622 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 4fb7511bdaa2707fcc86962500b3c078; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62013975, jitterRate=-0.07591976225376129}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 02:01:16,622 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 4fb7511bdaa2707fcc86962500b3c078: 2023-02-17 02:01:16,665 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 4fb7511bdaa2707fcc86962500b3c078, disabling compactions & flushes 2023-02-17 02:01:16,666 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676599269734.4fb7511bdaa2707fcc86962500b3c078. 2023-02-17 02:01:16,666 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676599269734.4fb7511bdaa2707fcc86962500b3c078. 2023-02-17 02:01:16,666 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676599269734.4fb7511bdaa2707fcc86962500b3c078. after waiting 0 ms 2023-02-17 02:01:16,666 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676599269734.4fb7511bdaa2707fcc86962500b3c078. 2023-02-17 02:01:16,666 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676599269734.4fb7511bdaa2707fcc86962500b3c078. 2023-02-17 02:01:16,666 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 4fb7511bdaa2707fcc86962500b3c078: 2023-02-17 02:01:16,680 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676599269734.4ed625a5af4623dec3e6c74a1f7180c6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:16,681 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 02:01:16,681 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 02:01:16,683 INFO [StoreOpener-4ed625a5af4623dec3e6c74a1f7180c6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4ed625a5af4623dec3e6c74a1f7180c6 2023-02-17 02:01:16,684 DEBUG [StoreOpener-4ed625a5af4623dec3e6c74a1f7180c6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44409/user/jenkins/test-data/e4a43e2c-5578-9e5b-3d88-cc8c20ec254e/testWithMapReduceMultiRegion/451140b0-0d80-470b-91bb-e0cd22c5451f/data/default/testWithMapReduce/4ed625a5af4623dec3e6c74a1f7180c6/f1 2023-02-17 02:01:16,685 INFO [StoreOpener-4ed625a5af4623dec3e6c74a1f7180c6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4ed625a5af4623dec3e6c74a1f7180c6 columnFamilyName f1 2023-02-17 02:01:16,693 DEBUG [StoreOpener-4ed625a5af4623dec3e6c74a1f7180c6-1] regionserver.HStore(539): loaded hdfs://localhost:44409/user/jenkins/test-data/e4a43e2c-5578-9e5b-3d88-cc8c20ec254e/testWithMapReduceMultiRegion/451140b0-0d80-470b-91bb-e0cd22c5451f/data/default/testWithMapReduce/4ed625a5af4623dec3e6c74a1f7180c6/f1/testWithMapReduce=4ed625a5af4623dec3e6c74a1f7180c6-d382863b46a94de7aadcd5b897c03972 2023-02-17 02:01:16,693 INFO [StoreOpener-4ed625a5af4623dec3e6c74a1f7180c6-1] regionserver.HStore(310): Store=4ed625a5af4623dec3e6c74a1f7180c6/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:16,693 INFO [StoreOpener-4ed625a5af4623dec3e6c74a1f7180c6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4ed625a5af4623dec3e6c74a1f7180c6 2023-02-17 02:01:16,695 DEBUG [StoreOpener-4ed625a5af4623dec3e6c74a1f7180c6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44409/user/jenkins/test-data/e4a43e2c-5578-9e5b-3d88-cc8c20ec254e/testWithMapReduceMultiRegion/451140b0-0d80-470b-91bb-e0cd22c5451f/data/default/testWithMapReduce/4ed625a5af4623dec3e6c74a1f7180c6/f2 2023-02-17 02:01:16,695 INFO [StoreOpener-4ed625a5af4623dec3e6c74a1f7180c6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4ed625a5af4623dec3e6c74a1f7180c6 columnFamilyName f2 2023-02-17 02:01:16,701 DEBUG [StoreOpener-4ed625a5af4623dec3e6c74a1f7180c6-1] regionserver.HStore(539): loaded hdfs://localhost:44409/user/jenkins/test-data/e4a43e2c-5578-9e5b-3d88-cc8c20ec254e/testWithMapReduceMultiRegion/451140b0-0d80-470b-91bb-e0cd22c5451f/data/default/testWithMapReduce/4ed625a5af4623dec3e6c74a1f7180c6/f2/testWithMapReduce=4ed625a5af4623dec3e6c74a1f7180c6-2cb6ec9838de40e393466e31305dff9d 2023-02-17 02:01:16,701 INFO [StoreOpener-4ed625a5af4623dec3e6c74a1f7180c6-1] regionserver.HStore(310): Store=4ed625a5af4623dec3e6c74a1f7180c6/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:16,702 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 02:01:16,702 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 4ed625a5af4623dec3e6c74a1f7180c6; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73401957, jitterRate=0.09377439320087433}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 02:01:16,703 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 4ed625a5af4623dec3e6c74a1f7180c6: 2023-02-17 02:01:16,862 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 4ed625a5af4623dec3e6c74a1f7180c6, disabling compactions & flushes 2023-02-17 02:01:16,862 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676599269734.4ed625a5af4623dec3e6c74a1f7180c6. 2023-02-17 02:01:16,862 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676599269734.4ed625a5af4623dec3e6c74a1f7180c6. 2023-02-17 02:01:16,862 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676599269734.4ed625a5af4623dec3e6c74a1f7180c6. after waiting 0 ms 2023-02-17 02:01:16,862 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676599269734.4ed625a5af4623dec3e6c74a1f7180c6. 2023-02-17 02:01:16,866 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676599269734.4ed625a5af4623dec3e6c74a1f7180c6. 2023-02-17 02:01:16,866 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 4ed625a5af4623dec3e6c74a1f7180c6: 2023-02-17 02:01:16,871 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676599269734.6a46e9ed5ad2c334585050f964998e61.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:16,872 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 02:01:16,875 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 02:01:16,881 INFO [StoreOpener-6a46e9ed5ad2c334585050f964998e61-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 6a46e9ed5ad2c334585050f964998e61 2023-02-17 02:01:16,882 DEBUG [StoreOpener-6a46e9ed5ad2c334585050f964998e61-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44409/user/jenkins/test-data/e4a43e2c-5578-9e5b-3d88-cc8c20ec254e/testWithMapReduceMultiRegion/451140b0-0d80-470b-91bb-e0cd22c5451f/data/default/testWithMapReduce/6a46e9ed5ad2c334585050f964998e61/f1 2023-02-17 02:01:16,883 INFO [StoreOpener-6a46e9ed5ad2c334585050f964998e61-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6a46e9ed5ad2c334585050f964998e61 columnFamilyName f1 2023-02-17 02:01:16,894 DEBUG [StoreOpener-6a46e9ed5ad2c334585050f964998e61-1] regionserver.HStore(539): loaded hdfs://localhost:44409/user/jenkins/test-data/e4a43e2c-5578-9e5b-3d88-cc8c20ec254e/testWithMapReduceMultiRegion/451140b0-0d80-470b-91bb-e0cd22c5451f/data/default/testWithMapReduce/6a46e9ed5ad2c334585050f964998e61/f1/testWithMapReduce=6a46e9ed5ad2c334585050f964998e61-9a482387f4d54932b01672de529d047e 2023-02-17 02:01:16,894 INFO [StoreOpener-6a46e9ed5ad2c334585050f964998e61-1] regionserver.HStore(310): Store=6a46e9ed5ad2c334585050f964998e61/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:16,895 INFO [StoreOpener-6a46e9ed5ad2c334585050f964998e61-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 6a46e9ed5ad2c334585050f964998e61 2023-02-17 02:01:16,898 DEBUG [StoreOpener-6a46e9ed5ad2c334585050f964998e61-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44409/user/jenkins/test-data/e4a43e2c-5578-9e5b-3d88-cc8c20ec254e/testWithMapReduceMultiRegion/451140b0-0d80-470b-91bb-e0cd22c5451f/data/default/testWithMapReduce/6a46e9ed5ad2c334585050f964998e61/f2 2023-02-17 02:01:16,898 INFO [StoreOpener-6a46e9ed5ad2c334585050f964998e61-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6a46e9ed5ad2c334585050f964998e61 columnFamilyName f2 2023-02-17 02:01:16,906 DEBUG [StoreOpener-6a46e9ed5ad2c334585050f964998e61-1] regionserver.HStore(539): loaded hdfs://localhost:44409/user/jenkins/test-data/e4a43e2c-5578-9e5b-3d88-cc8c20ec254e/testWithMapReduceMultiRegion/451140b0-0d80-470b-91bb-e0cd22c5451f/data/default/testWithMapReduce/6a46e9ed5ad2c334585050f964998e61/f2/testWithMapReduce=6a46e9ed5ad2c334585050f964998e61-f0be2190b3f24020a450bb06e832105e 2023-02-17 02:01:16,907 INFO [StoreOpener-6a46e9ed5ad2c334585050f964998e61-1] regionserver.HStore(310): Store=6a46e9ed5ad2c334585050f964998e61/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:16,907 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 02:01:16,907 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 6a46e9ed5ad2c334585050f964998e61; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72727542, jitterRate=0.08372482657432556}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 02:01:16,907 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 6a46e9ed5ad2c334585050f964998e61: 2023-02-17 02:01:16,966 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 6a46e9ed5ad2c334585050f964998e61, disabling compactions & flushes 2023-02-17 02:01:16,966 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676599269734.6a46e9ed5ad2c334585050f964998e61. 2023-02-17 02:01:16,967 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676599269734.6a46e9ed5ad2c334585050f964998e61. 2023-02-17 02:01:16,967 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676599269734.6a46e9ed5ad2c334585050f964998e61. after waiting 0 ms 2023-02-17 02:01:16,967 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676599269734.6a46e9ed5ad2c334585050f964998e61. 2023-02-17 02:01:16,979 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676599269734.6a46e9ed5ad2c334585050f964998e61. 2023-02-17 02:01:16,979 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 6a46e9ed5ad2c334585050f964998e61: 2023-02-17 02:01:17,006 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676599269734.60da012c2f8c7fe0ec391ffacffa21f0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:17,006 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 02:01:17,011 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 02:01:17,013 INFO [StoreOpener-60da012c2f8c7fe0ec391ffacffa21f0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 60da012c2f8c7fe0ec391ffacffa21f0 2023-02-17 02:01:17,015 DEBUG [StoreOpener-60da012c2f8c7fe0ec391ffacffa21f0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44409/user/jenkins/test-data/e4a43e2c-5578-9e5b-3d88-cc8c20ec254e/testWithMapReduceMultiRegion/451140b0-0d80-470b-91bb-e0cd22c5451f/data/default/testWithMapReduce/60da012c2f8c7fe0ec391ffacffa21f0/f1 2023-02-17 02:01:17,016 INFO [StoreOpener-60da012c2f8c7fe0ec391ffacffa21f0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 60da012c2f8c7fe0ec391ffacffa21f0 columnFamilyName f1 2023-02-17 02:01:17,016 INFO [StoreOpener-60da012c2f8c7fe0ec391ffacffa21f0-1] regionserver.HStore(310): Store=60da012c2f8c7fe0ec391ffacffa21f0/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:17,017 INFO [StoreOpener-60da012c2f8c7fe0ec391ffacffa21f0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 60da012c2f8c7fe0ec391ffacffa21f0 2023-02-17 02:01:17,018 DEBUG [StoreOpener-60da012c2f8c7fe0ec391ffacffa21f0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44409/user/jenkins/test-data/e4a43e2c-5578-9e5b-3d88-cc8c20ec254e/testWithMapReduceMultiRegion/451140b0-0d80-470b-91bb-e0cd22c5451f/data/default/testWithMapReduce/60da012c2f8c7fe0ec391ffacffa21f0/f2 2023-02-17 02:01:17,019 INFO [StoreOpener-60da012c2f8c7fe0ec391ffacffa21f0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 60da012c2f8c7fe0ec391ffacffa21f0 columnFamilyName f2 2023-02-17 02:01:17,019 INFO [StoreOpener-60da012c2f8c7fe0ec391ffacffa21f0-1] regionserver.HStore(310): Store=60da012c2f8c7fe0ec391ffacffa21f0/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:17,019 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 02:01:17,020 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 60da012c2f8c7fe0ec391ffacffa21f0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72076154, jitterRate=0.07401838898658752}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 02:01:17,020 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 60da012c2f8c7fe0ec391ffacffa21f0: 2023-02-17 02:01:17,039 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 60da012c2f8c7fe0ec391ffacffa21f0, disabling compactions & flushes 2023-02-17 02:01:17,039 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676599269734.60da012c2f8c7fe0ec391ffacffa21f0. 2023-02-17 02:01:17,039 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676599269734.60da012c2f8c7fe0ec391ffacffa21f0. 2023-02-17 02:01:17,039 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676599269734.60da012c2f8c7fe0ec391ffacffa21f0. after waiting 0 ms 2023-02-17 02:01:17,039 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676599269734.60da012c2f8c7fe0ec391ffacffa21f0. 2023-02-17 02:01:17,040 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676599269734.60da012c2f8c7fe0ec391ffacffa21f0. 2023-02-17 02:01:17,040 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 60da012c2f8c7fe0ec391ffacffa21f0: 2023-02-17 02:01:17,047 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676599269734.a8930d4446cbfaf62e358646d1db5a41.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:17,047 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 02:01:17,053 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 02:01:17,055 INFO [StoreOpener-a8930d4446cbfaf62e358646d1db5a41-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a8930d4446cbfaf62e358646d1db5a41 2023-02-17 02:01:17,057 DEBUG [StoreOpener-a8930d4446cbfaf62e358646d1db5a41-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44409/user/jenkins/test-data/e4a43e2c-5578-9e5b-3d88-cc8c20ec254e/testWithMapReduceMultiRegion/451140b0-0d80-470b-91bb-e0cd22c5451f/data/default/testWithMapReduce/a8930d4446cbfaf62e358646d1db5a41/f1 2023-02-17 02:01:17,058 INFO [StoreOpener-a8930d4446cbfaf62e358646d1db5a41-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a8930d4446cbfaf62e358646d1db5a41 columnFamilyName f1 2023-02-17 02:01:17,069 DEBUG [StoreOpener-a8930d4446cbfaf62e358646d1db5a41-1] regionserver.HStore(539): loaded hdfs://localhost:44409/user/jenkins/test-data/e4a43e2c-5578-9e5b-3d88-cc8c20ec254e/testWithMapReduceMultiRegion/451140b0-0d80-470b-91bb-e0cd22c5451f/data/default/testWithMapReduce/a8930d4446cbfaf62e358646d1db5a41/f1/testWithMapReduce=a8930d4446cbfaf62e358646d1db5a41-28c40938bb9f49259c9121f3f76cd0bc 2023-02-17 02:01:17,070 INFO [StoreOpener-a8930d4446cbfaf62e358646d1db5a41-1] regionserver.HStore(310): Store=a8930d4446cbfaf62e358646d1db5a41/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:17,070 INFO [StoreOpener-a8930d4446cbfaf62e358646d1db5a41-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a8930d4446cbfaf62e358646d1db5a41 2023-02-17 02:01:17,071 DEBUG [StoreOpener-a8930d4446cbfaf62e358646d1db5a41-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44409/user/jenkins/test-data/e4a43e2c-5578-9e5b-3d88-cc8c20ec254e/testWithMapReduceMultiRegion/451140b0-0d80-470b-91bb-e0cd22c5451f/data/default/testWithMapReduce/a8930d4446cbfaf62e358646d1db5a41/f2 2023-02-17 02:01:17,072 INFO [StoreOpener-a8930d4446cbfaf62e358646d1db5a41-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a8930d4446cbfaf62e358646d1db5a41 columnFamilyName f2 2023-02-17 02:01:17,080 DEBUG [StoreOpener-a8930d4446cbfaf62e358646d1db5a41-1] regionserver.HStore(539): loaded hdfs://localhost:44409/user/jenkins/test-data/e4a43e2c-5578-9e5b-3d88-cc8c20ec254e/testWithMapReduceMultiRegion/451140b0-0d80-470b-91bb-e0cd22c5451f/data/default/testWithMapReduce/a8930d4446cbfaf62e358646d1db5a41/f2/testWithMapReduce=a8930d4446cbfaf62e358646d1db5a41-e6640ccd453f4906b0ed3f8cf3b07e80 2023-02-17 02:01:17,081 INFO [StoreOpener-a8930d4446cbfaf62e358646d1db5a41-1] regionserver.HStore(310): Store=a8930d4446cbfaf62e358646d1db5a41/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:17,081 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 02:01:17,081 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened a8930d4446cbfaf62e358646d1db5a41; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73591868, jitterRate=0.09660428762435913}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 02:01:17,081 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for a8930d4446cbfaf62e358646d1db5a41: 2023-02-17 02:01:17,128 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing a8930d4446cbfaf62e358646d1db5a41, disabling compactions & flushes 2023-02-17 02:01:17,128 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676599269734.a8930d4446cbfaf62e358646d1db5a41. 2023-02-17 02:01:17,128 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676599269734.a8930d4446cbfaf62e358646d1db5a41. 2023-02-17 02:01:17,128 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676599269734.a8930d4446cbfaf62e358646d1db5a41. after waiting 0 ms 2023-02-17 02:01:17,128 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676599269734.a8930d4446cbfaf62e358646d1db5a41. 2023-02-17 02:01:17,133 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676599269734.a8930d4446cbfaf62e358646d1db5a41. 2023-02-17 02:01:17,133 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for a8930d4446cbfaf62e358646d1db5a41: 2023-02-17 02:01:17,143 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676599269734.3c50622abf2210dda1717f4c123254eb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:17,143 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 02:01:17,144 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 02:01:17,146 INFO [StoreOpener-3c50622abf2210dda1717f4c123254eb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3c50622abf2210dda1717f4c123254eb 2023-02-17 02:01:17,148 DEBUG [StoreOpener-3c50622abf2210dda1717f4c123254eb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44409/user/jenkins/test-data/e4a43e2c-5578-9e5b-3d88-cc8c20ec254e/testWithMapReduceMultiRegion/451140b0-0d80-470b-91bb-e0cd22c5451f/data/default/testWithMapReduce/3c50622abf2210dda1717f4c123254eb/f1 2023-02-17 02:01:17,148 INFO [StoreOpener-3c50622abf2210dda1717f4c123254eb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3c50622abf2210dda1717f4c123254eb columnFamilyName f1 2023-02-17 02:01:17,166 DEBUG [StoreOpener-3c50622abf2210dda1717f4c123254eb-1] regionserver.HStore(539): loaded hdfs://localhost:44409/user/jenkins/test-data/e4a43e2c-5578-9e5b-3d88-cc8c20ec254e/testWithMapReduceMultiRegion/451140b0-0d80-470b-91bb-e0cd22c5451f/data/default/testWithMapReduce/3c50622abf2210dda1717f4c123254eb/f1/testWithMapReduce=3c50622abf2210dda1717f4c123254eb-2b0f34e3077e4c0d938384d2c1bc133c 2023-02-17 02:01:17,167 INFO [StoreOpener-3c50622abf2210dda1717f4c123254eb-1] regionserver.HStore(310): Store=3c50622abf2210dda1717f4c123254eb/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:17,167 INFO [StoreOpener-3c50622abf2210dda1717f4c123254eb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3c50622abf2210dda1717f4c123254eb 2023-02-17 02:01:17,168 DEBUG [StoreOpener-3c50622abf2210dda1717f4c123254eb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44409/user/jenkins/test-data/e4a43e2c-5578-9e5b-3d88-cc8c20ec254e/testWithMapReduceMultiRegion/451140b0-0d80-470b-91bb-e0cd22c5451f/data/default/testWithMapReduce/3c50622abf2210dda1717f4c123254eb/f2 2023-02-17 02:01:17,169 INFO [StoreOpener-3c50622abf2210dda1717f4c123254eb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3c50622abf2210dda1717f4c123254eb columnFamilyName f2 2023-02-17 02:01:17,177 DEBUG [StoreOpener-3c50622abf2210dda1717f4c123254eb-1] regionserver.HStore(539): loaded hdfs://localhost:44409/user/jenkins/test-data/e4a43e2c-5578-9e5b-3d88-cc8c20ec254e/testWithMapReduceMultiRegion/451140b0-0d80-470b-91bb-e0cd22c5451f/data/default/testWithMapReduce/3c50622abf2210dda1717f4c123254eb/f2/testWithMapReduce=3c50622abf2210dda1717f4c123254eb-9fca64ea11194963aa97df2f93a29181 2023-02-17 02:01:17,177 INFO [StoreOpener-3c50622abf2210dda1717f4c123254eb-1] regionserver.HStore(310): Store=3c50622abf2210dda1717f4c123254eb/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:17,178 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 02:01:17,178 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 3c50622abf2210dda1717f4c123254eb; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70461354, jitterRate=0.04995599389076233}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 02:01:17,178 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 3c50622abf2210dda1717f4c123254eb: 2023-02-17 02:01:17,259 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 3c50622abf2210dda1717f4c123254eb, disabling compactions & flushes 2023-02-17 02:01:17,260 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676599269734.3c50622abf2210dda1717f4c123254eb. 2023-02-17 02:01:17,260 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676599269734.3c50622abf2210dda1717f4c123254eb. 2023-02-17 02:01:17,260 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676599269734.3c50622abf2210dda1717f4c123254eb. after waiting 0 ms 2023-02-17 02:01:17,260 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676599269734.3c50622abf2210dda1717f4c123254eb. 2023-02-17 02:01:17,265 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676599269734.3c50622abf2210dda1717f4c123254eb. 2023-02-17 02:01:17,265 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 3c50622abf2210dda1717f4c123254eb: 2023-02-17 02:01:17,270 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676599269734.70f7ef12da22dd3ef39c2af364b54ddd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:17,270 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 02:01:17,272 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 02:01:17,274 INFO [StoreOpener-70f7ef12da22dd3ef39c2af364b54ddd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 70f7ef12da22dd3ef39c2af364b54ddd 2023-02-17 02:01:17,275 DEBUG [StoreOpener-70f7ef12da22dd3ef39c2af364b54ddd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44409/user/jenkins/test-data/e4a43e2c-5578-9e5b-3d88-cc8c20ec254e/testWithMapReduceMultiRegion/451140b0-0d80-470b-91bb-e0cd22c5451f/data/default/testWithMapReduce/70f7ef12da22dd3ef39c2af364b54ddd/f1 2023-02-17 02:01:17,276 INFO [StoreOpener-70f7ef12da22dd3ef39c2af364b54ddd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 70f7ef12da22dd3ef39c2af364b54ddd columnFamilyName f1 2023-02-17 02:01:17,286 DEBUG [StoreOpener-70f7ef12da22dd3ef39c2af364b54ddd-1] regionserver.HStore(539): loaded hdfs://localhost:44409/user/jenkins/test-data/e4a43e2c-5578-9e5b-3d88-cc8c20ec254e/testWithMapReduceMultiRegion/451140b0-0d80-470b-91bb-e0cd22c5451f/data/default/testWithMapReduce/70f7ef12da22dd3ef39c2af364b54ddd/f1/testWithMapReduce=70f7ef12da22dd3ef39c2af364b54ddd-4dd4450e129c43ad952024fe42c1222f 2023-02-17 02:01:17,287 INFO [StoreOpener-70f7ef12da22dd3ef39c2af364b54ddd-1] regionserver.HStore(310): Store=70f7ef12da22dd3ef39c2af364b54ddd/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:17,287 INFO [StoreOpener-70f7ef12da22dd3ef39c2af364b54ddd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 70f7ef12da22dd3ef39c2af364b54ddd 2023-02-17 02:01:17,288 DEBUG [StoreOpener-70f7ef12da22dd3ef39c2af364b54ddd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44409/user/jenkins/test-data/e4a43e2c-5578-9e5b-3d88-cc8c20ec254e/testWithMapReduceMultiRegion/451140b0-0d80-470b-91bb-e0cd22c5451f/data/default/testWithMapReduce/70f7ef12da22dd3ef39c2af364b54ddd/f2 2023-02-17 02:01:17,288 INFO [StoreOpener-70f7ef12da22dd3ef39c2af364b54ddd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 70f7ef12da22dd3ef39c2af364b54ddd columnFamilyName f2 2023-02-17 02:01:17,297 DEBUG [StoreOpener-70f7ef12da22dd3ef39c2af364b54ddd-1] regionserver.HStore(539): loaded hdfs://localhost:44409/user/jenkins/test-data/e4a43e2c-5578-9e5b-3d88-cc8c20ec254e/testWithMapReduceMultiRegion/451140b0-0d80-470b-91bb-e0cd22c5451f/data/default/testWithMapReduce/70f7ef12da22dd3ef39c2af364b54ddd/f2/testWithMapReduce=70f7ef12da22dd3ef39c2af364b54ddd-1e07143b10a84aa3b2ec38cfb922dda3 2023-02-17 02:01:17,298 INFO [StoreOpener-70f7ef12da22dd3ef39c2af364b54ddd-1] regionserver.HStore(310): Store=70f7ef12da22dd3ef39c2af364b54ddd/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:17,298 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 02:01:17,298 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 70f7ef12da22dd3ef39c2af364b54ddd; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66383372, jitterRate=-0.010810673236846924}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 02:01:17,298 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 70f7ef12da22dd3ef39c2af364b54ddd: 2023-02-17 02:01:17,346 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 70f7ef12da22dd3ef39c2af364b54ddd, disabling compactions & flushes 2023-02-17 02:01:17,346 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676599269734.70f7ef12da22dd3ef39c2af364b54ddd. 2023-02-17 02:01:17,346 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676599269734.70f7ef12da22dd3ef39c2af364b54ddd. 2023-02-17 02:01:17,346 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676599269734.70f7ef12da22dd3ef39c2af364b54ddd. after waiting 0 ms 2023-02-17 02:01:17,346 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676599269734.70f7ef12da22dd3ef39c2af364b54ddd. 2023-02-17 02:01:17,360 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676599269734.70f7ef12da22dd3ef39c2af364b54ddd. 2023-02-17 02:01:17,360 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 70f7ef12da22dd3ef39c2af364b54ddd: 2023-02-17 02:01:17,372 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676599269734.b213250f6e3c76397fc5267bf5934c3e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:17,372 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 02:01:17,378 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 02:01:17,382 INFO [StoreOpener-b213250f6e3c76397fc5267bf5934c3e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b213250f6e3c76397fc5267bf5934c3e 2023-02-17 02:01:17,383 DEBUG [StoreOpener-b213250f6e3c76397fc5267bf5934c3e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44409/user/jenkins/test-data/e4a43e2c-5578-9e5b-3d88-cc8c20ec254e/testWithMapReduceMultiRegion/451140b0-0d80-470b-91bb-e0cd22c5451f/data/default/testWithMapReduce/b213250f6e3c76397fc5267bf5934c3e/f1 2023-02-17 02:01:17,384 INFO [StoreOpener-b213250f6e3c76397fc5267bf5934c3e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b213250f6e3c76397fc5267bf5934c3e columnFamilyName f1 2023-02-17 02:01:17,393 DEBUG [StoreOpener-b213250f6e3c76397fc5267bf5934c3e-1] regionserver.HStore(539): loaded hdfs://localhost:44409/user/jenkins/test-data/e4a43e2c-5578-9e5b-3d88-cc8c20ec254e/testWithMapReduceMultiRegion/451140b0-0d80-470b-91bb-e0cd22c5451f/data/default/testWithMapReduce/b213250f6e3c76397fc5267bf5934c3e/f1/testWithMapReduce=b213250f6e3c76397fc5267bf5934c3e-8255554c1457463aa80c1123e8ca9419 2023-02-17 02:01:17,393 INFO [StoreOpener-b213250f6e3c76397fc5267bf5934c3e-1] regionserver.HStore(310): Store=b213250f6e3c76397fc5267bf5934c3e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:17,393 INFO [StoreOpener-b213250f6e3c76397fc5267bf5934c3e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b213250f6e3c76397fc5267bf5934c3e 2023-02-17 02:01:17,394 DEBUG [StoreOpener-b213250f6e3c76397fc5267bf5934c3e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44409/user/jenkins/test-data/e4a43e2c-5578-9e5b-3d88-cc8c20ec254e/testWithMapReduceMultiRegion/451140b0-0d80-470b-91bb-e0cd22c5451f/data/default/testWithMapReduce/b213250f6e3c76397fc5267bf5934c3e/f2 2023-02-17 02:01:17,395 INFO [StoreOpener-b213250f6e3c76397fc5267bf5934c3e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b213250f6e3c76397fc5267bf5934c3e columnFamilyName f2 2023-02-17 02:01:17,401 DEBUG [StoreOpener-b213250f6e3c76397fc5267bf5934c3e-1] regionserver.HStore(539): loaded hdfs://localhost:44409/user/jenkins/test-data/e4a43e2c-5578-9e5b-3d88-cc8c20ec254e/testWithMapReduceMultiRegion/451140b0-0d80-470b-91bb-e0cd22c5451f/data/default/testWithMapReduce/b213250f6e3c76397fc5267bf5934c3e/f2/testWithMapReduce=b213250f6e3c76397fc5267bf5934c3e-54f45e683ff04d808eca260001f90782 2023-02-17 02:01:17,402 INFO [StoreOpener-b213250f6e3c76397fc5267bf5934c3e-1] regionserver.HStore(310): Store=b213250f6e3c76397fc5267bf5934c3e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:17,402 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 02:01:17,402 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened b213250f6e3c76397fc5267bf5934c3e; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68623018, jitterRate=0.022562652826309204}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 02:01:17,402 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for b213250f6e3c76397fc5267bf5934c3e: 2023-02-17 02:01:17,433 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing b213250f6e3c76397fc5267bf5934c3e, disabling compactions & flushes 2023-02-17 02:01:17,433 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676599269734.b213250f6e3c76397fc5267bf5934c3e. 2023-02-17 02:01:17,433 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676599269734.b213250f6e3c76397fc5267bf5934c3e. 2023-02-17 02:01:17,433 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676599269734.b213250f6e3c76397fc5267bf5934c3e. after waiting 0 ms 2023-02-17 02:01:17,433 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676599269734.b213250f6e3c76397fc5267bf5934c3e. 2023-02-17 02:01:17,439 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676599269734.b213250f6e3c76397fc5267bf5934c3e. 2023-02-17 02:01:17,440 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for b213250f6e3c76397fc5267bf5934c3e: 2023-02-17 02:01:17,444 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676599269734.b3da13e5dcdc5200c5067deebd89a3b4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:17,444 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 02:01:17,450 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 02:01:17,452 INFO [StoreOpener-b3da13e5dcdc5200c5067deebd89a3b4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b3da13e5dcdc5200c5067deebd89a3b4 2023-02-17 02:01:17,453 DEBUG [StoreOpener-b3da13e5dcdc5200c5067deebd89a3b4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44409/user/jenkins/test-data/e4a43e2c-5578-9e5b-3d88-cc8c20ec254e/testWithMapReduceMultiRegion/451140b0-0d80-470b-91bb-e0cd22c5451f/data/default/testWithMapReduce/b3da13e5dcdc5200c5067deebd89a3b4/f1 2023-02-17 02:01:17,454 INFO [StoreOpener-b3da13e5dcdc5200c5067deebd89a3b4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b3da13e5dcdc5200c5067deebd89a3b4 columnFamilyName f1 2023-02-17 02:01:17,460 DEBUG [StoreOpener-b3da13e5dcdc5200c5067deebd89a3b4-1] regionserver.HStore(539): loaded hdfs://localhost:44409/user/jenkins/test-data/e4a43e2c-5578-9e5b-3d88-cc8c20ec254e/testWithMapReduceMultiRegion/451140b0-0d80-470b-91bb-e0cd22c5451f/data/default/testWithMapReduce/b3da13e5dcdc5200c5067deebd89a3b4/f1/testWithMapReduce=b3da13e5dcdc5200c5067deebd89a3b4-752df72c44764942b6997c097d06a55c 2023-02-17 02:01:17,461 INFO [StoreOpener-b3da13e5dcdc5200c5067deebd89a3b4-1] regionserver.HStore(310): Store=b3da13e5dcdc5200c5067deebd89a3b4/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:17,461 INFO [StoreOpener-b3da13e5dcdc5200c5067deebd89a3b4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b3da13e5dcdc5200c5067deebd89a3b4 2023-02-17 02:01:17,462 DEBUG [StoreOpener-b3da13e5dcdc5200c5067deebd89a3b4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44409/user/jenkins/test-data/e4a43e2c-5578-9e5b-3d88-cc8c20ec254e/testWithMapReduceMultiRegion/451140b0-0d80-470b-91bb-e0cd22c5451f/data/default/testWithMapReduce/b3da13e5dcdc5200c5067deebd89a3b4/f2 2023-02-17 02:01:17,462 INFO [StoreOpener-b3da13e5dcdc5200c5067deebd89a3b4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b3da13e5dcdc5200c5067deebd89a3b4 columnFamilyName f2 2023-02-17 02:01:17,469 DEBUG [StoreOpener-b3da13e5dcdc5200c5067deebd89a3b4-1] regionserver.HStore(539): loaded hdfs://localhost:44409/user/jenkins/test-data/e4a43e2c-5578-9e5b-3d88-cc8c20ec254e/testWithMapReduceMultiRegion/451140b0-0d80-470b-91bb-e0cd22c5451f/data/default/testWithMapReduce/b3da13e5dcdc5200c5067deebd89a3b4/f2/testWithMapReduce=b3da13e5dcdc5200c5067deebd89a3b4-a9ce531f77fa4c8d9ba8e9c61e3c7c71 2023-02-17 02:01:17,469 INFO [StoreOpener-b3da13e5dcdc5200c5067deebd89a3b4-1] regionserver.HStore(310): Store=b3da13e5dcdc5200c5067deebd89a3b4/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:17,469 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 02:01:17,469 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened b3da13e5dcdc5200c5067deebd89a3b4; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60908368, jitterRate=-0.09239459037780762}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 02:01:17,469 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for b3da13e5dcdc5200c5067deebd89a3b4: 2023-02-17 02:01:17,501 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing b3da13e5dcdc5200c5067deebd89a3b4, disabling compactions & flushes 2023-02-17 02:01:17,501 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676599269734.b3da13e5dcdc5200c5067deebd89a3b4. 2023-02-17 02:01:17,501 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676599269734.b3da13e5dcdc5200c5067deebd89a3b4. 2023-02-17 02:01:17,502 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676599269734.b3da13e5dcdc5200c5067deebd89a3b4. after waiting 0 ms 2023-02-17 02:01:17,502 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676599269734.b3da13e5dcdc5200c5067deebd89a3b4. 2023-02-17 02:01:17,504 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676599269734.b3da13e5dcdc5200c5067deebd89a3b4. 2023-02-17 02:01:17,505 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for b3da13e5dcdc5200c5067deebd89a3b4: 2023-02-17 02:01:17,509 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676599269734.4d5096d14486c6ef9123841c928ad2ea.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:17,509 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 02:01:17,512 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 02:01:17,514 INFO [StoreOpener-4d5096d14486c6ef9123841c928ad2ea-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4d5096d14486c6ef9123841c928ad2ea 2023-02-17 02:01:17,515 DEBUG [StoreOpener-4d5096d14486c6ef9123841c928ad2ea-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44409/user/jenkins/test-data/e4a43e2c-5578-9e5b-3d88-cc8c20ec254e/testWithMapReduceMultiRegion/451140b0-0d80-470b-91bb-e0cd22c5451f/data/default/testWithMapReduce/4d5096d14486c6ef9123841c928ad2ea/f1 2023-02-17 02:01:17,515 INFO [StoreOpener-4d5096d14486c6ef9123841c928ad2ea-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4d5096d14486c6ef9123841c928ad2ea columnFamilyName f1 2023-02-17 02:01:17,522 DEBUG [StoreOpener-4d5096d14486c6ef9123841c928ad2ea-1] regionserver.HStore(539): loaded hdfs://localhost:44409/user/jenkins/test-data/e4a43e2c-5578-9e5b-3d88-cc8c20ec254e/testWithMapReduceMultiRegion/451140b0-0d80-470b-91bb-e0cd22c5451f/data/default/testWithMapReduce/4d5096d14486c6ef9123841c928ad2ea/f1/testWithMapReduce=4d5096d14486c6ef9123841c928ad2ea-beb1f4a5373f4eebbb7749c3296e875c 2023-02-17 02:01:17,522 INFO [StoreOpener-4d5096d14486c6ef9123841c928ad2ea-1] regionserver.HStore(310): Store=4d5096d14486c6ef9123841c928ad2ea/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:17,522 INFO [StoreOpener-4d5096d14486c6ef9123841c928ad2ea-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4d5096d14486c6ef9123841c928ad2ea 2023-02-17 02:01:17,523 DEBUG [StoreOpener-4d5096d14486c6ef9123841c928ad2ea-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44409/user/jenkins/test-data/e4a43e2c-5578-9e5b-3d88-cc8c20ec254e/testWithMapReduceMultiRegion/451140b0-0d80-470b-91bb-e0cd22c5451f/data/default/testWithMapReduce/4d5096d14486c6ef9123841c928ad2ea/f2 2023-02-17 02:01:17,524 INFO [StoreOpener-4d5096d14486c6ef9123841c928ad2ea-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4d5096d14486c6ef9123841c928ad2ea columnFamilyName f2 2023-02-17 02:01:17,529 DEBUG [StoreOpener-4d5096d14486c6ef9123841c928ad2ea-1] regionserver.HStore(539): loaded hdfs://localhost:44409/user/jenkins/test-data/e4a43e2c-5578-9e5b-3d88-cc8c20ec254e/testWithMapReduceMultiRegion/451140b0-0d80-470b-91bb-e0cd22c5451f/data/default/testWithMapReduce/4d5096d14486c6ef9123841c928ad2ea/f2/testWithMapReduce=4d5096d14486c6ef9123841c928ad2ea-d6ea514e04f34b8db33ceb5ebfe7c4d2 2023-02-17 02:01:17,529 INFO [StoreOpener-4d5096d14486c6ef9123841c928ad2ea-1] regionserver.HStore(310): Store=4d5096d14486c6ef9123841c928ad2ea/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:17,530 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 02:01:17,530 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 4d5096d14486c6ef9123841c928ad2ea; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74120668, jitterRate=0.10448402166366577}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 02:01:17,530 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 4d5096d14486c6ef9123841c928ad2ea: 2023-02-17 02:01:17,580 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 4d5096d14486c6ef9123841c928ad2ea, disabling compactions & flushes 2023-02-17 02:01:17,580 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676599269734.4d5096d14486c6ef9123841c928ad2ea. 2023-02-17 02:01:17,580 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676599269734.4d5096d14486c6ef9123841c928ad2ea. 2023-02-17 02:01:17,580 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676599269734.4d5096d14486c6ef9123841c928ad2ea. after waiting 0 ms 2023-02-17 02:01:17,580 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676599269734.4d5096d14486c6ef9123841c928ad2ea. 2023-02-17 02:01:17,584 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676599269734.4d5096d14486c6ef9123841c928ad2ea. 2023-02-17 02:01:17,584 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 4d5096d14486c6ef9123841c928ad2ea: 2023-02-17 02:01:18,544 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39477] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMapReduceMultiRegion" 2023-02-17 02:01:18,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39477] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceMultiRegion 2023-02-17 02:01:18,550 INFO [Listener at localhost/39237] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-17 02:01:18,551 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39477] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-17 02:01:18,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39477] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-17 02:01:18,561 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676599278561"}]},"ts":"1676599278561"} 2023-02-17 02:01:18,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-17 02:01:18,564 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-17 02:01:18,566 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-17 02:01:18,569 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=60da012c2f8c7fe0ec391ffacffa21f0, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=70f7ef12da22dd3ef39c2af364b54ddd, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=a8930d4446cbfaf62e358646d1db5a41, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=b3da13e5dcdc5200c5067deebd89a3b4, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=3c50622abf2210dda1717f4c123254eb, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=4d5096d14486c6ef9123841c928ad2ea, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=6a46e9ed5ad2c334585050f964998e61, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=b213250f6e3c76397fc5267bf5934c3e, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=4ed625a5af4623dec3e6c74a1f7180c6, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=4fb7511bdaa2707fcc86962500b3c078, UNASSIGN}] 2023-02-17 02:01:18,572 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=6a46e9ed5ad2c334585050f964998e61, UNASSIGN 2023-02-17 02:01:18,572 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=3c50622abf2210dda1717f4c123254eb, UNASSIGN 2023-02-17 02:01:18,572 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=b3da13e5dcdc5200c5067deebd89a3b4, UNASSIGN 2023-02-17 02:01:18,573 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=4d5096d14486c6ef9123841c928ad2ea, UNASSIGN 2023-02-17 02:01:18,574 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=6a46e9ed5ad2c334585050f964998e61, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34495,1676599266651 2023-02-17 02:01:18,574 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=b3da13e5dcdc5200c5067deebd89a3b4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34495,1676599266651 2023-02-17 02:01:18,574 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=3c50622abf2210dda1717f4c123254eb, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37401,1676599266596 2023-02-17 02:01:18,574 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676599269734.b3da13e5dcdc5200c5067deebd89a3b4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676599278574"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676599278574"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676599278574"}]},"ts":"1676599278574"} 2023-02-17 02:01:18,574 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676599269734.3c50622abf2210dda1717f4c123254eb.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676599278574"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676599278574"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676599278574"}]},"ts":"1676599278574"} 2023-02-17 02:01:18,574 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676599269734.6a46e9ed5ad2c334585050f964998e61.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676599278574"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676599278574"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676599278574"}]},"ts":"1676599278574"} 2023-02-17 02:01:18,575 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=4fb7511bdaa2707fcc86962500b3c078, UNASSIGN 2023-02-17 02:01:18,575 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=4d5096d14486c6ef9123841c928ad2ea, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34495,1676599266651 2023-02-17 02:01:18,576 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676599269734.4d5096d14486c6ef9123841c928ad2ea.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676599278575"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676599278575"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676599278575"}]},"ts":"1676599278575"} 2023-02-17 02:01:18,576 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=4fb7511bdaa2707fcc86962500b3c078, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34495,1676599266651 2023-02-17 02:01:18,576 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676599269734.4fb7511bdaa2707fcc86962500b3c078.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676599278576"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676599278576"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676599278576"}]},"ts":"1676599278576"} 2023-02-17 02:01:18,579 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=37, state=RUNNABLE; CloseRegionProcedure b3da13e5dcdc5200c5067deebd89a3b4, server=jenkins-hbase4.apache.org,34495,1676599266651}] 2023-02-17 02:01:18,587 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=38, state=RUNNABLE; CloseRegionProcedure 3c50622abf2210dda1717f4c123254eb, server=jenkins-hbase4.apache.org,37401,1676599266596}] 2023-02-17 02:01:18,588 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=4ed625a5af4623dec3e6c74a1f7180c6, UNASSIGN 2023-02-17 02:01:18,589 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=4ed625a5af4623dec3e6c74a1f7180c6, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37401,1676599266596 2023-02-17 02:01:18,589 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676599269734.4ed625a5af4623dec3e6c74a1f7180c6.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676599278589"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676599278589"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676599278589"}]},"ts":"1676599278589"} 2023-02-17 02:01:18,591 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=39, state=RUNNABLE; CloseRegionProcedure 4d5096d14486c6ef9123841c928ad2ea, server=jenkins-hbase4.apache.org,34495,1676599266651}] 2023-02-17 02:01:18,591 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=40, state=RUNNABLE; CloseRegionProcedure 6a46e9ed5ad2c334585050f964998e61, server=jenkins-hbase4.apache.org,34495,1676599266651}] 2023-02-17 02:01:18,591 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=b213250f6e3c76397fc5267bf5934c3e, UNASSIGN 2023-02-17 02:01:18,592 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=43, state=RUNNABLE; CloseRegionProcedure 4fb7511bdaa2707fcc86962500b3c078, server=jenkins-hbase4.apache.org,34495,1676599266651}] 2023-02-17 02:01:18,593 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=42, state=RUNNABLE; CloseRegionProcedure 4ed625a5af4623dec3e6c74a1f7180c6, server=jenkins-hbase4.apache.org,37401,1676599266596}] 2023-02-17 02:01:18,603 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=b213250f6e3c76397fc5267bf5934c3e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37401,1676599266596 2023-02-17 02:01:18,603 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676599269734.b213250f6e3c76397fc5267bf5934c3e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676599278603"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676599278603"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676599278603"}]},"ts":"1676599278603"} 2023-02-17 02:01:18,604 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=a8930d4446cbfaf62e358646d1db5a41, UNASSIGN 2023-02-17 02:01:18,606 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=41, state=RUNNABLE; CloseRegionProcedure b213250f6e3c76397fc5267bf5934c3e, server=jenkins-hbase4.apache.org,37401,1676599266596}] 2023-02-17 02:01:18,613 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=a8930d4446cbfaf62e358646d1db5a41, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37401,1676599266596 2023-02-17 02:01:18,613 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676599269734.a8930d4446cbfaf62e358646d1db5a41.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676599278613"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676599278613"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676599278613"}]},"ts":"1676599278613"} 2023-02-17 02:01:18,614 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=70f7ef12da22dd3ef39c2af364b54ddd, UNASSIGN 2023-02-17 02:01:18,616 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=36, state=RUNNABLE; CloseRegionProcedure a8930d4446cbfaf62e358646d1db5a41, server=jenkins-hbase4.apache.org,37401,1676599266596}] 2023-02-17 02:01:18,616 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=70f7ef12da22dd3ef39c2af364b54ddd, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37401,1676599266596 2023-02-17 02:01:18,617 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676599269734.70f7ef12da22dd3ef39c2af364b54ddd.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676599278616"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676599278616"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676599278616"}]},"ts":"1676599278616"} 2023-02-17 02:01:18,617 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=60da012c2f8c7fe0ec391ffacffa21f0, UNASSIGN 2023-02-17 02:01:18,618 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=60da012c2f8c7fe0ec391ffacffa21f0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34495,1676599266651 2023-02-17 02:01:18,619 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676599269734.60da012c2f8c7fe0ec391ffacffa21f0.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676599278618"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676599278618"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676599278618"}]},"ts":"1676599278618"} 2023-02-17 02:01:18,619 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=35, state=RUNNABLE; CloseRegionProcedure 70f7ef12da22dd3ef39c2af364b54ddd, server=jenkins-hbase4.apache.org,37401,1676599266596}] 2023-02-17 02:01:18,621 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=34, state=RUNNABLE; CloseRegionProcedure 60da012c2f8c7fe0ec391ffacffa21f0, server=jenkins-hbase4.apache.org,34495,1676599266651}] 2023-02-17 02:01:18,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-17 02:01:18,739 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 4d5096d14486c6ef9123841c928ad2ea 2023-02-17 02:01:18,739 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 4d5096d14486c6ef9123841c928ad2ea, disabling compactions & flushes 2023-02-17 02:01:18,739 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676599269734.4d5096d14486c6ef9123841c928ad2ea. 2023-02-17 02:01:18,739 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676599269734.4d5096d14486c6ef9123841c928ad2ea. 2023-02-17 02:01:18,739 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676599269734.4d5096d14486c6ef9123841c928ad2ea. after waiting 0 ms 2023-02-17 02:01:18,739 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676599269734.4d5096d14486c6ef9123841c928ad2ea. 2023-02-17 02:01:18,747 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close b213250f6e3c76397fc5267bf5934c3e 2023-02-17 02:01:18,748 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing b213250f6e3c76397fc5267bf5934c3e, disabling compactions & flushes 2023-02-17 02:01:18,748 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676599269734.b213250f6e3c76397fc5267bf5934c3e. 2023-02-17 02:01:18,748 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676599269734.b213250f6e3c76397fc5267bf5934c3e. 2023-02-17 02:01:18,748 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676599269734.b213250f6e3c76397fc5267bf5934c3e. after waiting 0 ms 2023-02-17 02:01:18,748 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676599269734.b213250f6e3c76397fc5267bf5934c3e. 2023-02-17 02:01:18,757 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/4d5096d14486c6ef9123841c928ad2ea/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 02:01:18,758 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/b213250f6e3c76397fc5267bf5934c3e/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 02:01:18,760 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676599269734.b213250f6e3c76397fc5267bf5934c3e. 2023-02-17 02:01:18,760 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676599269734.4d5096d14486c6ef9123841c928ad2ea. 2023-02-17 02:01:18,760 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for b213250f6e3c76397fc5267bf5934c3e: 2023-02-17 02:01:18,760 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 4d5096d14486c6ef9123841c928ad2ea: 2023-02-17 02:01:18,763 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed b213250f6e3c76397fc5267bf5934c3e 2023-02-17 02:01:18,763 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 70f7ef12da22dd3ef39c2af364b54ddd 2023-02-17 02:01:18,763 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 70f7ef12da22dd3ef39c2af364b54ddd, disabling compactions & flushes 2023-02-17 02:01:18,763 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676599269734.70f7ef12da22dd3ef39c2af364b54ddd. 2023-02-17 02:01:18,763 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676599269734.70f7ef12da22dd3ef39c2af364b54ddd. 2023-02-17 02:01:18,763 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676599269734.70f7ef12da22dd3ef39c2af364b54ddd. after waiting 0 ms 2023-02-17 02:01:18,763 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676599269734.70f7ef12da22dd3ef39c2af364b54ddd. 2023-02-17 02:01:18,763 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=b213250f6e3c76397fc5267bf5934c3e, regionState=CLOSED 2023-02-17 02:01:18,764 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676599269734.b213250f6e3c76397fc5267bf5934c3e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676599278763"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676599278763"}]},"ts":"1676599278763"} 2023-02-17 02:01:18,764 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 4d5096d14486c6ef9123841c928ad2ea 2023-02-17 02:01:18,764 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close b3da13e5dcdc5200c5067deebd89a3b4 2023-02-17 02:01:18,764 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing b3da13e5dcdc5200c5067deebd89a3b4, disabling compactions & flushes 2023-02-17 02:01:18,764 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676599269734.b3da13e5dcdc5200c5067deebd89a3b4. 2023-02-17 02:01:18,764 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676599269734.b3da13e5dcdc5200c5067deebd89a3b4. 2023-02-17 02:01:18,764 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676599269734.b3da13e5dcdc5200c5067deebd89a3b4. after waiting 0 ms 2023-02-17 02:01:18,764 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676599269734.b3da13e5dcdc5200c5067deebd89a3b4. 2023-02-17 02:01:18,769 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=4d5096d14486c6ef9123841c928ad2ea, regionState=CLOSED 2023-02-17 02:01:18,769 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676599269734.4d5096d14486c6ef9123841c928ad2ea.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676599278764"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676599278764"}]},"ts":"1676599278764"} 2023-02-17 02:01:18,778 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=41 2023-02-17 02:01:18,778 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=41, state=SUCCESS; CloseRegionProcedure b213250f6e3c76397fc5267bf5934c3e, server=jenkins-hbase4.apache.org,37401,1676599266596 in 165 msec 2023-02-17 02:01:18,780 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/70f7ef12da22dd3ef39c2af364b54ddd/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 02:01:18,781 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=39 2023-02-17 02:01:18,781 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=b213250f6e3c76397fc5267bf5934c3e, UNASSIGN in 211 msec 2023-02-17 02:01:18,781 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=39, state=SUCCESS; CloseRegionProcedure 4d5096d14486c6ef9123841c928ad2ea, server=jenkins-hbase4.apache.org,34495,1676599266651 in 186 msec 2023-02-17 02:01:18,782 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/b3da13e5dcdc5200c5067deebd89a3b4/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 02:01:18,783 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676599269734.70f7ef12da22dd3ef39c2af364b54ddd. 2023-02-17 02:01:18,783 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 70f7ef12da22dd3ef39c2af364b54ddd: 2023-02-17 02:01:18,784 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676599269734.b3da13e5dcdc5200c5067deebd89a3b4. 2023-02-17 02:01:18,784 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for b3da13e5dcdc5200c5067deebd89a3b4: 2023-02-17 02:01:18,784 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=4d5096d14486c6ef9123841c928ad2ea, UNASSIGN in 214 msec 2023-02-17 02:01:18,786 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 70f7ef12da22dd3ef39c2af364b54ddd 2023-02-17 02:01:18,786 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close a8930d4446cbfaf62e358646d1db5a41 2023-02-17 02:01:18,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing a8930d4446cbfaf62e358646d1db5a41, disabling compactions & flushes 2023-02-17 02:01:18,786 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676599269734.a8930d4446cbfaf62e358646d1db5a41. 2023-02-17 02:01:18,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676599269734.a8930d4446cbfaf62e358646d1db5a41. 2023-02-17 02:01:18,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676599269734.a8930d4446cbfaf62e358646d1db5a41. after waiting 0 ms 2023-02-17 02:01:18,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676599269734.a8930d4446cbfaf62e358646d1db5a41. 2023-02-17 02:01:18,786 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=70f7ef12da22dd3ef39c2af364b54ddd, regionState=CLOSED 2023-02-17 02:01:18,787 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676599269734.70f7ef12da22dd3ef39c2af364b54ddd.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676599278786"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676599278786"}]},"ts":"1676599278786"} 2023-02-17 02:01:18,789 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed b3da13e5dcdc5200c5067deebd89a3b4 2023-02-17 02:01:18,789 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 4fb7511bdaa2707fcc86962500b3c078 2023-02-17 02:01:18,790 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 4fb7511bdaa2707fcc86962500b3c078, disabling compactions & flushes 2023-02-17 02:01:18,790 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676599269734.4fb7511bdaa2707fcc86962500b3c078. 2023-02-17 02:01:18,790 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676599269734.4fb7511bdaa2707fcc86962500b3c078. 2023-02-17 02:01:18,790 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676599269734.4fb7511bdaa2707fcc86962500b3c078. after waiting 0 ms 2023-02-17 02:01:18,790 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676599269734.4fb7511bdaa2707fcc86962500b3c078. 2023-02-17 02:01:18,793 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=b3da13e5dcdc5200c5067deebd89a3b4, regionState=CLOSED 2023-02-17 02:01:18,793 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676599269734.b3da13e5dcdc5200c5067deebd89a3b4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676599278793"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676599278793"}]},"ts":"1676599278793"} 2023-02-17 02:01:18,801 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=35 2023-02-17 02:01:18,801 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=35, state=SUCCESS; CloseRegionProcedure 70f7ef12da22dd3ef39c2af364b54ddd, server=jenkins-hbase4.apache.org,37401,1676599266596 in 179 msec 2023-02-17 02:01:18,802 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=37 2023-02-17 02:01:18,802 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=37, state=SUCCESS; CloseRegionProcedure b3da13e5dcdc5200c5067deebd89a3b4, server=jenkins-hbase4.apache.org,34495,1676599266651 in 220 msec 2023-02-17 02:01:18,808 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/4fb7511bdaa2707fcc86962500b3c078/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-17 02:01:18,809 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676599269734.4fb7511bdaa2707fcc86962500b3c078. 2023-02-17 02:01:18,809 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 4fb7511bdaa2707fcc86962500b3c078: 2023-02-17 02:01:18,811 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/a8930d4446cbfaf62e358646d1db5a41/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 02:01:18,812 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676599269734.a8930d4446cbfaf62e358646d1db5a41. 2023-02-17 02:01:18,812 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for a8930d4446cbfaf62e358646d1db5a41: 2023-02-17 02:01:18,812 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=70f7ef12da22dd3ef39c2af364b54ddd, UNASSIGN in 234 msec 2023-02-17 02:01:18,814 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 4fb7511bdaa2707fcc86962500b3c078 2023-02-17 02:01:18,814 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 60da012c2f8c7fe0ec391ffacffa21f0 2023-02-17 02:01:18,814 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 60da012c2f8c7fe0ec391ffacffa21f0, disabling compactions & flushes 2023-02-17 02:01:18,814 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676599269734.60da012c2f8c7fe0ec391ffacffa21f0. 2023-02-17 02:01:18,814 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676599269734.60da012c2f8c7fe0ec391ffacffa21f0. 2023-02-17 02:01:18,814 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676599269734.60da012c2f8c7fe0ec391ffacffa21f0. after waiting 0 ms 2023-02-17 02:01:18,815 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676599269734.60da012c2f8c7fe0ec391ffacffa21f0. 2023-02-17 02:01:18,815 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=b3da13e5dcdc5200c5067deebd89a3b4, UNASSIGN in 235 msec 2023-02-17 02:01:18,815 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=4fb7511bdaa2707fcc86962500b3c078, regionState=CLOSED 2023-02-17 02:01:18,816 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676599269734.4fb7511bdaa2707fcc86962500b3c078.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676599278815"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676599278815"}]},"ts":"1676599278815"} 2023-02-17 02:01:18,816 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=a8930d4446cbfaf62e358646d1db5a41, regionState=CLOSED 2023-02-17 02:01:18,817 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676599269734.a8930d4446cbfaf62e358646d1db5a41.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676599278816"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676599278816"}]},"ts":"1676599278816"} 2023-02-17 02:01:18,821 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=43 2023-02-17 02:01:18,821 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=43, state=SUCCESS; CloseRegionProcedure 4fb7511bdaa2707fcc86962500b3c078, server=jenkins-hbase4.apache.org,34495,1676599266651 in 226 msec 2023-02-17 02:01:18,822 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed a8930d4446cbfaf62e358646d1db5a41 2023-02-17 02:01:18,822 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 4ed625a5af4623dec3e6c74a1f7180c6 2023-02-17 02:01:18,822 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 4ed625a5af4623dec3e6c74a1f7180c6, disabling compactions & flushes 2023-02-17 02:01:18,823 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676599269734.4ed625a5af4623dec3e6c74a1f7180c6. 2023-02-17 02:01:18,823 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676599269734.4ed625a5af4623dec3e6c74a1f7180c6. 2023-02-17 02:01:18,823 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676599269734.4ed625a5af4623dec3e6c74a1f7180c6. after waiting 0 ms 2023-02-17 02:01:18,823 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676599269734.4ed625a5af4623dec3e6c74a1f7180c6. 2023-02-17 02:01:18,823 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=36 2023-02-17 02:01:18,823 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=36, state=SUCCESS; CloseRegionProcedure a8930d4446cbfaf62e358646d1db5a41, server=jenkins-hbase4.apache.org,37401,1676599266596 in 203 msec 2023-02-17 02:01:18,824 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=4fb7511bdaa2707fcc86962500b3c078, UNASSIGN in 252 msec 2023-02-17 02:01:18,825 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/60da012c2f8c7fe0ec391ffacffa21f0/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-17 02:01:18,825 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=a8930d4446cbfaf62e358646d1db5a41, UNASSIGN in 256 msec 2023-02-17 02:01:18,826 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676599269734.60da012c2f8c7fe0ec391ffacffa21f0. 2023-02-17 02:01:18,826 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 60da012c2f8c7fe0ec391ffacffa21f0: 2023-02-17 02:01:18,829 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 60da012c2f8c7fe0ec391ffacffa21f0 2023-02-17 02:01:18,829 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 6a46e9ed5ad2c334585050f964998e61 2023-02-17 02:01:18,829 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 6a46e9ed5ad2c334585050f964998e61, disabling compactions & flushes 2023-02-17 02:01:18,829 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676599269734.6a46e9ed5ad2c334585050f964998e61. 2023-02-17 02:01:18,829 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=60da012c2f8c7fe0ec391ffacffa21f0, regionState=CLOSED 2023-02-17 02:01:18,829 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676599269734.6a46e9ed5ad2c334585050f964998e61. 2023-02-17 02:01:18,829 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676599269734.6a46e9ed5ad2c334585050f964998e61. after waiting 0 ms 2023-02-17 02:01:18,829 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1676599269734.60da012c2f8c7fe0ec391ffacffa21f0.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676599278829"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676599278829"}]},"ts":"1676599278829"} 2023-02-17 02:01:18,829 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676599269734.6a46e9ed5ad2c334585050f964998e61. 2023-02-17 02:01:18,830 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/4ed625a5af4623dec3e6c74a1f7180c6/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 02:01:18,832 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676599269734.4ed625a5af4623dec3e6c74a1f7180c6. 2023-02-17 02:01:18,832 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 4ed625a5af4623dec3e6c74a1f7180c6: 2023-02-17 02:01:18,834 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 4ed625a5af4623dec3e6c74a1f7180c6 2023-02-17 02:01:18,834 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 3c50622abf2210dda1717f4c123254eb 2023-02-17 02:01:18,834 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 3c50622abf2210dda1717f4c123254eb, disabling compactions & flushes 2023-02-17 02:01:18,834 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676599269734.3c50622abf2210dda1717f4c123254eb. 2023-02-17 02:01:18,834 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676599269734.3c50622abf2210dda1717f4c123254eb. 2023-02-17 02:01:18,834 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676599269734.3c50622abf2210dda1717f4c123254eb. after waiting 0 ms 2023-02-17 02:01:18,834 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676599269734.3c50622abf2210dda1717f4c123254eb. 2023-02-17 02:01:18,836 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=4ed625a5af4623dec3e6c74a1f7180c6, regionState=CLOSED 2023-02-17 02:01:18,837 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676599269734.4ed625a5af4623dec3e6c74a1f7180c6.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676599278836"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676599278836"}]},"ts":"1676599278836"} 2023-02-17 02:01:18,837 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/6a46e9ed5ad2c334585050f964998e61/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 02:01:18,838 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=34 2023-02-17 02:01:18,838 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=34, state=SUCCESS; CloseRegionProcedure 60da012c2f8c7fe0ec391ffacffa21f0, server=jenkins-hbase4.apache.org,34495,1676599266651 in 210 msec 2023-02-17 02:01:18,839 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676599269734.6a46e9ed5ad2c334585050f964998e61. 2023-02-17 02:01:18,839 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 6a46e9ed5ad2c334585050f964998e61: 2023-02-17 02:01:18,841 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/default/testWithMapReduce/3c50622abf2210dda1717f4c123254eb/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 02:01:18,842 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 6a46e9ed5ad2c334585050f964998e61 2023-02-17 02:01:18,842 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=60da012c2f8c7fe0ec391ffacffa21f0, UNASSIGN in 271 msec 2023-02-17 02:01:18,843 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=6a46e9ed5ad2c334585050f964998e61, regionState=CLOSED 2023-02-17 02:01:18,843 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676599269734.6a46e9ed5ad2c334585050f964998e61.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676599278843"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676599278843"}]},"ts":"1676599278843"} 2023-02-17 02:01:18,849 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676599269734.3c50622abf2210dda1717f4c123254eb. 2023-02-17 02:01:18,849 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 3c50622abf2210dda1717f4c123254eb: 2023-02-17 02:01:18,849 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=42 2023-02-17 02:01:18,849 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=42, state=SUCCESS; CloseRegionProcedure 4ed625a5af4623dec3e6c74a1f7180c6, server=jenkins-hbase4.apache.org,37401,1676599266596 in 247 msec 2023-02-17 02:01:18,851 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 3c50622abf2210dda1717f4c123254eb 2023-02-17 02:01:18,853 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=40 2023-02-17 02:01:18,853 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=3c50622abf2210dda1717f4c123254eb, regionState=CLOSED 2023-02-17 02:01:18,853 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=40, state=SUCCESS; CloseRegionProcedure 6a46e9ed5ad2c334585050f964998e61, server=jenkins-hbase4.apache.org,34495,1676599266651 in 254 msec 2023-02-17 02:01:18,853 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=4ed625a5af4623dec3e6c74a1f7180c6, UNASSIGN in 280 msec 2023-02-17 02:01:18,853 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676599269734.3c50622abf2210dda1717f4c123254eb.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676599278853"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676599278853"}]},"ts":"1676599278853"} 2023-02-17 02:01:18,855 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=6a46e9ed5ad2c334585050f964998e61, UNASSIGN in 286 msec 2023-02-17 02:01:18,858 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=38 2023-02-17 02:01:18,858 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=38, state=SUCCESS; CloseRegionProcedure 3c50622abf2210dda1717f4c123254eb, server=jenkins-hbase4.apache.org,37401,1676599266596 in 269 msec 2023-02-17 02:01:18,860 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=38, resume processing ppid=33 2023-02-17 02:01:18,860 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=3c50622abf2210dda1717f4c123254eb, UNASSIGN in 291 msec 2023-02-17 02:01:18,861 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676599278861"}]},"ts":"1676599278861"} 2023-02-17 02:01:18,863 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-17 02:01:18,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-17 02:01:18,870 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-17 02:01:18,873 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 319 msec 2023-02-17 02:01:19,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-17 02:01:19,169 INFO [Listener at localhost/39237] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 33 completed 2023-02-17 02:01:19,174 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39477] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testWithMapReduce 2023-02-17 02:01:19,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39477] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-17 02:01:19,183 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-17 02:01:19,185 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-17 02:01:19,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-17 02:01:19,203 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/60da012c2f8c7fe0ec391ffacffa21f0 2023-02-17 02:01:19,203 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/a8930d4446cbfaf62e358646d1db5a41 2023-02-17 02:01:19,203 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/3c50622abf2210dda1717f4c123254eb 2023-02-17 02:01:19,203 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/6a46e9ed5ad2c334585050f964998e61 2023-02-17 02:01:19,203 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/4d5096d14486c6ef9123841c928ad2ea 2023-02-17 02:01:19,203 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/b3da13e5dcdc5200c5067deebd89a3b4 2023-02-17 02:01:19,203 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/70f7ef12da22dd3ef39c2af364b54ddd 2023-02-17 02:01:19,203 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/b213250f6e3c76397fc5267bf5934c3e 2023-02-17 02:01:19,211 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/60da012c2f8c7fe0ec391ffacffa21f0/f1, FileablePath, hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/60da012c2f8c7fe0ec391ffacffa21f0/f2, FileablePath, hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/60da012c2f8c7fe0ec391ffacffa21f0/recovered.edits] 2023-02-17 02:01:19,211 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/6a46e9ed5ad2c334585050f964998e61/f1, FileablePath, hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/6a46e9ed5ad2c334585050f964998e61/f2, FileablePath, hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/6a46e9ed5ad2c334585050f964998e61/recovered.edits] 2023-02-17 02:01:19,211 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/b213250f6e3c76397fc5267bf5934c3e/f1, FileablePath, hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/b213250f6e3c76397fc5267bf5934c3e/f2, FileablePath, hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/b213250f6e3c76397fc5267bf5934c3e/recovered.edits] 2023-02-17 02:01:19,214 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/b3da13e5dcdc5200c5067deebd89a3b4/f1, FileablePath, hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/b3da13e5dcdc5200c5067deebd89a3b4/f2, FileablePath, hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/b3da13e5dcdc5200c5067deebd89a3b4/recovered.edits] 2023-02-17 02:01:19,214 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/3c50622abf2210dda1717f4c123254eb/f1, FileablePath, hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/3c50622abf2210dda1717f4c123254eb/f2, FileablePath, hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/3c50622abf2210dda1717f4c123254eb/recovered.edits] 2023-02-17 02:01:19,214 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/70f7ef12da22dd3ef39c2af364b54ddd/f1, FileablePath, hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/70f7ef12da22dd3ef39c2af364b54ddd/f2, FileablePath, hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/70f7ef12da22dd3ef39c2af364b54ddd/recovered.edits] 2023-02-17 02:01:19,217 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/a8930d4446cbfaf62e358646d1db5a41/f1, FileablePath, hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/a8930d4446cbfaf62e358646d1db5a41/f2, FileablePath, hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/a8930d4446cbfaf62e358646d1db5a41/recovered.edits] 2023-02-17 02:01:19,218 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/4d5096d14486c6ef9123841c928ad2ea/f1, FileablePath, hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/4d5096d14486c6ef9123841c928ad2ea/f2, FileablePath, hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/4d5096d14486c6ef9123841c928ad2ea/recovered.edits] 2023-02-17 02:01:19,235 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/b213250f6e3c76397fc5267bf5934c3e/f1/8255554c1457463aa80c1123e8ca9419 to hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/archive/data/default/testWithMapReduce/b213250f6e3c76397fc5267bf5934c3e/f1/8255554c1457463aa80c1123e8ca9419 2023-02-17 02:01:19,235 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/60da012c2f8c7fe0ec391ffacffa21f0/recovered.edits/6.seqid to hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/archive/data/default/testWithMapReduce/60da012c2f8c7fe0ec391ffacffa21f0/recovered.edits/6.seqid 2023-02-17 02:01:19,235 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/b3da13e5dcdc5200c5067deebd89a3b4/f1/36a60ab05e1c4dd48461e0681235cdd8 to hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/archive/data/default/testWithMapReduce/b3da13e5dcdc5200c5067deebd89a3b4/f1/36a60ab05e1c4dd48461e0681235cdd8 2023-02-17 02:01:19,236 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/6a46e9ed5ad2c334585050f964998e61/f1/528b8c68bca649439fde7ed6f9412817 to hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/archive/data/default/testWithMapReduce/6a46e9ed5ad2c334585050f964998e61/f1/528b8c68bca649439fde7ed6f9412817 2023-02-17 02:01:19,236 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/4d5096d14486c6ef9123841c928ad2ea/f1/0f623e170a8544df993946f6a66737fd to hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/archive/data/default/testWithMapReduce/4d5096d14486c6ef9123841c928ad2ea/f1/0f623e170a8544df993946f6a66737fd 2023-02-17 02:01:19,237 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/70f7ef12da22dd3ef39c2af364b54ddd/f1/4dd4450e129c43ad952024fe42c1222f to hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/archive/data/default/testWithMapReduce/70f7ef12da22dd3ef39c2af364b54ddd/f1/4dd4450e129c43ad952024fe42c1222f 2023-02-17 02:01:19,237 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/3c50622abf2210dda1717f4c123254eb/f1/2b0f34e3077e4c0d938384d2c1bc133c to hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/archive/data/default/testWithMapReduce/3c50622abf2210dda1717f4c123254eb/f1/2b0f34e3077e4c0d938384d2c1bc133c 2023-02-17 02:01:19,238 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/a8930d4446cbfaf62e358646d1db5a41/f1/28c40938bb9f49259c9121f3f76cd0bc to hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/archive/data/default/testWithMapReduce/a8930d4446cbfaf62e358646d1db5a41/f1/28c40938bb9f49259c9121f3f76cd0bc 2023-02-17 02:01:19,239 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/60da012c2f8c7fe0ec391ffacffa21f0 2023-02-17 02:01:19,239 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/4ed625a5af4623dec3e6c74a1f7180c6 2023-02-17 02:01:19,243 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/b3da13e5dcdc5200c5067deebd89a3b4/f1/752df72c44764942b6997c097d06a55c to hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/archive/data/default/testWithMapReduce/b3da13e5dcdc5200c5067deebd89a3b4/f1/752df72c44764942b6997c097d06a55c 2023-02-17 02:01:19,243 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/b213250f6e3c76397fc5267bf5934c3e/f1/b764110361ab45439fc2a4fe3e733f41 to hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/archive/data/default/testWithMapReduce/b213250f6e3c76397fc5267bf5934c3e/f1/b764110361ab45439fc2a4fe3e733f41 2023-02-17 02:01:19,244 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/6a46e9ed5ad2c334585050f964998e61/f1/9a482387f4d54932b01672de529d047e to hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/archive/data/default/testWithMapReduce/6a46e9ed5ad2c334585050f964998e61/f1/9a482387f4d54932b01672de529d047e 2023-02-17 02:01:19,244 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/4d5096d14486c6ef9123841c928ad2ea/f1/beb1f4a5373f4eebbb7749c3296e875c to hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/archive/data/default/testWithMapReduce/4d5096d14486c6ef9123841c928ad2ea/f1/beb1f4a5373f4eebbb7749c3296e875c 2023-02-17 02:01:19,245 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/70f7ef12da22dd3ef39c2af364b54ddd/f1/a217dac540354aacaaa128717a2b9cf8 to hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/archive/data/default/testWithMapReduce/70f7ef12da22dd3ef39c2af364b54ddd/f1/a217dac540354aacaaa128717a2b9cf8 2023-02-17 02:01:19,245 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/3c50622abf2210dda1717f4c123254eb/f1/dfb14fc632c640f9a9954c4d25c7bf7f to hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/archive/data/default/testWithMapReduce/3c50622abf2210dda1717f4c123254eb/f1/dfb14fc632c640f9a9954c4d25c7bf7f 2023-02-17 02:01:19,245 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/a8930d4446cbfaf62e358646d1db5a41/f1/bb46fd5d51b64ef4aa69b2fc9f382113 to hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/archive/data/default/testWithMapReduce/a8930d4446cbfaf62e358646d1db5a41/f1/bb46fd5d51b64ef4aa69b2fc9f382113 2023-02-17 02:01:19,249 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/4ed625a5af4623dec3e6c74a1f7180c6/f1, FileablePath, hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/4ed625a5af4623dec3e6c74a1f7180c6/f2, FileablePath, hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/4ed625a5af4623dec3e6c74a1f7180c6/recovered.edits] 2023-02-17 02:01:19,259 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/b3da13e5dcdc5200c5067deebd89a3b4/f2/980ddbe3f59c4a1d8b84073ae45cd6a7 to hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/archive/data/default/testWithMapReduce/b3da13e5dcdc5200c5067deebd89a3b4/f2/980ddbe3f59c4a1d8b84073ae45cd6a7 2023-02-17 02:01:19,260 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/b213250f6e3c76397fc5267bf5934c3e/f2/54f45e683ff04d808eca260001f90782 to hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/archive/data/default/testWithMapReduce/b213250f6e3c76397fc5267bf5934c3e/f2/54f45e683ff04d808eca260001f90782 2023-02-17 02:01:19,260 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/6a46e9ed5ad2c334585050f964998e61/f2/4e9d835402ed4915890e571cf1aa8e4a to hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/archive/data/default/testWithMapReduce/6a46e9ed5ad2c334585050f964998e61/f2/4e9d835402ed4915890e571cf1aa8e4a 2023-02-17 02:01:19,261 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/4d5096d14486c6ef9123841c928ad2ea/f2/5a507af0de4d46b782398dc36f4fdcbd to hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/archive/data/default/testWithMapReduce/4d5096d14486c6ef9123841c928ad2ea/f2/5a507af0de4d46b782398dc36f4fdcbd 2023-02-17 02:01:19,261 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/70f7ef12da22dd3ef39c2af364b54ddd/f2/0456b61cd913422ca332a8845e832c05 to hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/archive/data/default/testWithMapReduce/70f7ef12da22dd3ef39c2af364b54ddd/f2/0456b61cd913422ca332a8845e832c05 2023-02-17 02:01:19,261 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/a8930d4446cbfaf62e358646d1db5a41/f2/9e400d90f7364c2f9245fb17f5d046f1 to hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/archive/data/default/testWithMapReduce/a8930d4446cbfaf62e358646d1db5a41/f2/9e400d90f7364c2f9245fb17f5d046f1 2023-02-17 02:01:19,261 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/3c50622abf2210dda1717f4c123254eb/f2/523f7bfc44a148db8aa7265f3e0c40c2 to hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/archive/data/default/testWithMapReduce/3c50622abf2210dda1717f4c123254eb/f2/523f7bfc44a148db8aa7265f3e0c40c2 2023-02-17 02:01:19,265 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/b213250f6e3c76397fc5267bf5934c3e/f2/db4a9c73b7274ef4ada26fa9b8d4952b to hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/archive/data/default/testWithMapReduce/b213250f6e3c76397fc5267bf5934c3e/f2/db4a9c73b7274ef4ada26fa9b8d4952b 2023-02-17 02:01:19,265 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/b3da13e5dcdc5200c5067deebd89a3b4/f2/a9ce531f77fa4c8d9ba8e9c61e3c7c71 to hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/archive/data/default/testWithMapReduce/b3da13e5dcdc5200c5067deebd89a3b4/f2/a9ce531f77fa4c8d9ba8e9c61e3c7c71 2023-02-17 02:01:19,266 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/6a46e9ed5ad2c334585050f964998e61/f2/f0be2190b3f24020a450bb06e832105e to hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/archive/data/default/testWithMapReduce/6a46e9ed5ad2c334585050f964998e61/f2/f0be2190b3f24020a450bb06e832105e 2023-02-17 02:01:19,266 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/4d5096d14486c6ef9123841c928ad2ea/f2/d6ea514e04f34b8db33ceb5ebfe7c4d2 to hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/archive/data/default/testWithMapReduce/4d5096d14486c6ef9123841c928ad2ea/f2/d6ea514e04f34b8db33ceb5ebfe7c4d2 2023-02-17 02:01:19,266 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/70f7ef12da22dd3ef39c2af364b54ddd/f2/1e07143b10a84aa3b2ec38cfb922dda3 to hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/archive/data/default/testWithMapReduce/70f7ef12da22dd3ef39c2af364b54ddd/f2/1e07143b10a84aa3b2ec38cfb922dda3 2023-02-17 02:01:19,267 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/3c50622abf2210dda1717f4c123254eb/f2/9fca64ea11194963aa97df2f93a29181 to hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/archive/data/default/testWithMapReduce/3c50622abf2210dda1717f4c123254eb/f2/9fca64ea11194963aa97df2f93a29181 2023-02-17 02:01:19,267 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/a8930d4446cbfaf62e358646d1db5a41/f2/e6640ccd453f4906b0ed3f8cf3b07e80 to hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/archive/data/default/testWithMapReduce/a8930d4446cbfaf62e358646d1db5a41/f2/e6640ccd453f4906b0ed3f8cf3b07e80 2023-02-17 02:01:19,268 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/4ed625a5af4623dec3e6c74a1f7180c6/f1/82b52401df184524ad58392cebf98a2e to hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/archive/data/default/testWithMapReduce/4ed625a5af4623dec3e6c74a1f7180c6/f1/82b52401df184524ad58392cebf98a2e 2023-02-17 02:01:19,272 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/4ed625a5af4623dec3e6c74a1f7180c6/f1/d382863b46a94de7aadcd5b897c03972 to hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/archive/data/default/testWithMapReduce/4ed625a5af4623dec3e6c74a1f7180c6/f1/d382863b46a94de7aadcd5b897c03972 2023-02-17 02:01:19,276 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/b213250f6e3c76397fc5267bf5934c3e/recovered.edits/12.seqid to hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/archive/data/default/testWithMapReduce/b213250f6e3c76397fc5267bf5934c3e/recovered.edits/12.seqid 2023-02-17 02:01:19,276 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/70f7ef12da22dd3ef39c2af364b54ddd/recovered.edits/12.seqid to hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/archive/data/default/testWithMapReduce/70f7ef12da22dd3ef39c2af364b54ddd/recovered.edits/12.seqid 2023-02-17 02:01:19,276 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/b3da13e5dcdc5200c5067deebd89a3b4/recovered.edits/12.seqid to hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/archive/data/default/testWithMapReduce/b3da13e5dcdc5200c5067deebd89a3b4/recovered.edits/12.seqid 2023-02-17 02:01:19,277 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/3c50622abf2210dda1717f4c123254eb/recovered.edits/12.seqid to hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/archive/data/default/testWithMapReduce/3c50622abf2210dda1717f4c123254eb/recovered.edits/12.seqid 2023-02-17 02:01:19,277 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/a8930d4446cbfaf62e358646d1db5a41/recovered.edits/12.seqid to hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/archive/data/default/testWithMapReduce/a8930d4446cbfaf62e358646d1db5a41/recovered.edits/12.seqid 2023-02-17 02:01:19,278 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/70f7ef12da22dd3ef39c2af364b54ddd 2023-02-17 02:01:19,278 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/4fb7511bdaa2707fcc86962500b3c078 2023-02-17 02:01:19,278 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/b213250f6e3c76397fc5267bf5934c3e 2023-02-17 02:01:19,278 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/4d5096d14486c6ef9123841c928ad2ea/recovered.edits/12.seqid to hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/archive/data/default/testWithMapReduce/4d5096d14486c6ef9123841c928ad2ea/recovered.edits/12.seqid 2023-02-17 02:01:19,278 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/b3da13e5dcdc5200c5067deebd89a3b4 2023-02-17 02:01:19,279 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/3c50622abf2210dda1717f4c123254eb 2023-02-17 02:01:19,279 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/a8930d4446cbfaf62e358646d1db5a41 2023-02-17 02:01:19,279 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/6a46e9ed5ad2c334585050f964998e61/recovered.edits/12.seqid to hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/archive/data/default/testWithMapReduce/6a46e9ed5ad2c334585050f964998e61/recovered.edits/12.seqid 2023-02-17 02:01:19,280 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/4d5096d14486c6ef9123841c928ad2ea 2023-02-17 02:01:19,280 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/6a46e9ed5ad2c334585050f964998e61 2023-02-17 02:01:19,281 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/4ed625a5af4623dec3e6c74a1f7180c6/f2/2cb6ec9838de40e393466e31305dff9d to hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/archive/data/default/testWithMapReduce/4ed625a5af4623dec3e6c74a1f7180c6/f2/2cb6ec9838de40e393466e31305dff9d 2023-02-17 02:01:19,282 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/4fb7511bdaa2707fcc86962500b3c078/f1, FileablePath, hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/4fb7511bdaa2707fcc86962500b3c078/f2, FileablePath, hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/4fb7511bdaa2707fcc86962500b3c078/recovered.edits] 2023-02-17 02:01:19,284 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/4ed625a5af4623dec3e6c74a1f7180c6/f2/4e0ba91d3ae04d2b85277ea88ef2374d to hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/archive/data/default/testWithMapReduce/4ed625a5af4623dec3e6c74a1f7180c6/f2/4e0ba91d3ae04d2b85277ea88ef2374d 2023-02-17 02:01:19,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-17 02:01:19,291 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/4ed625a5af4623dec3e6c74a1f7180c6/recovered.edits/12.seqid to hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/archive/data/default/testWithMapReduce/4ed625a5af4623dec3e6c74a1f7180c6/recovered.edits/12.seqid 2023-02-17 02:01:19,292 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/4ed625a5af4623dec3e6c74a1f7180c6 2023-02-17 02:01:19,294 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/4fb7511bdaa2707fcc86962500b3c078/recovered.edits/6.seqid to hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/archive/data/default/testWithMapReduce/4fb7511bdaa2707fcc86962500b3c078/recovered.edits/6.seqid 2023-02-17 02:01:19,295 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/.tmp/data/default/testWithMapReduce/4fb7511bdaa2707fcc86962500b3c078 2023-02-17 02:01:19,295 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-17 02:01:19,307 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-17 02:01:19,343 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMapReduce from hbase:meta 2023-02-17 02:01:19,347 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-17 02:01:19,349 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-17 02:01:19,349 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-17 02:01:19,349 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1676599269734.60da012c2f8c7fe0ec391ffacffa21f0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676599279349"}]},"ts":"9223372036854775807"} 2023-02-17 02:01:19,350 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,aaa,1676599269734.70f7ef12da22dd3ef39c2af364b54ddd.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676599279349"}]},"ts":"9223372036854775807"} 2023-02-17 02:01:19,350 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,d\\x84\\x84,1676599269734.a8930d4446cbfaf62e358646d1db5a41.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676599279349"}]},"ts":"9223372036854775807"} 2023-02-17 02:01:19,350 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,g\\xA7\\xA7,1676599269734.b3da13e5dcdc5200c5067deebd89a3b4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676599279349"}]},"ts":"9223372036854775807"} 2023-02-17 02:01:19,350 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,j\\xCA\\xCA,1676599269734.3c50622abf2210dda1717f4c123254eb.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676599279349"}]},"ts":"9223372036854775807"} 2023-02-17 02:01:19,350 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,m\\xED\\xED,1676599269734.4d5096d14486c6ef9123841c928ad2ea.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676599279349"}]},"ts":"9223372036854775807"} 2023-02-17 02:01:19,350 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,q\\x11\\x10,1676599269734.6a46e9ed5ad2c334585050f964998e61.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676599279349"}]},"ts":"9223372036854775807"} 2023-02-17 02:01:19,350 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,t43,1676599269734.b213250f6e3c76397fc5267bf5934c3e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676599279349"}]},"ts":"9223372036854775807"} 2023-02-17 02:01:19,350 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,wWV,1676599269734.4ed625a5af4623dec3e6c74a1f7180c6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676599279349"}]},"ts":"9223372036854775807"} 2023-02-17 02:01:19,350 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,zz{,1676599269734.4fb7511bdaa2707fcc86962500b3c078.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676599279349"}]},"ts":"9223372036854775807"} 2023-02-17 02:01:19,353 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-17 02:01:19,353 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 60da012c2f8c7fe0ec391ffacffa21f0, NAME => 'testWithMapReduce,,1676599269734.60da012c2f8c7fe0ec391ffacffa21f0.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => 70f7ef12da22dd3ef39c2af364b54ddd, NAME => 'testWithMapReduce,aaa,1676599269734.70f7ef12da22dd3ef39c2af364b54ddd.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => a8930d4446cbfaf62e358646d1db5a41, NAME => 'testWithMapReduce,d\x84\x84,1676599269734.a8930d4446cbfaf62e358646d1db5a41.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => b3da13e5dcdc5200c5067deebd89a3b4, NAME => 'testWithMapReduce,g\xA7\xA7,1676599269734.b3da13e5dcdc5200c5067deebd89a3b4.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => 3c50622abf2210dda1717f4c123254eb, NAME => 'testWithMapReduce,j\xCA\xCA,1676599269734.3c50622abf2210dda1717f4c123254eb.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => 4d5096d14486c6ef9123841c928ad2ea, NAME => 'testWithMapReduce,m\xED\xED,1676599269734.4d5096d14486c6ef9123841c928ad2ea.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => 6a46e9ed5ad2c334585050f964998e61, NAME => 'testWithMapReduce,q\x11\x10,1676599269734.6a46e9ed5ad2c334585050f964998e61.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => b213250f6e3c76397fc5267bf5934c3e, NAME => 'testWithMapReduce,t43,1676599269734.b213250f6e3c76397fc5267bf5934c3e.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => 4ed625a5af4623dec3e6c74a1f7180c6, NAME => 'testWithMapReduce,wWV,1676599269734.4ed625a5af4623dec3e6c74a1f7180c6.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => 4fb7511bdaa2707fcc86962500b3c078, NAME => 'testWithMapReduce,zz{,1676599269734.4fb7511bdaa2707fcc86962500b3c078.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-17 02:01:19,353 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-17 02:01:19,354 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676599279353"}]},"ts":"9223372036854775807"} 2023-02-17 02:01:19,356 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-17 02:01:19,358 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-17 02:01:19,359 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 183 msec 2023-02-17 02:01:19,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-17 02:01:19,490 INFO [Listener at localhost/39237] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 54 completed 2023-02-17 02:01:19,491 INFO [Listener at localhost/39237] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-17 02:01:19,491 INFO [Listener at localhost/39237] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-17 02:01:19,491 DEBUG [Listener at localhost/39237] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2d710525 to 127.0.0.1:50037 2023-02-17 02:01:19,491 DEBUG [Listener at localhost/39237] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 02:01:19,491 DEBUG [Listener at localhost/39237] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-17 02:01:19,491 DEBUG [Listener at localhost/39237] util.JVMClusterUtil(257): Found active master hash=764365770, stopped=false 2023-02-17 02:01:19,492 INFO [Listener at localhost/39237] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,39477,1676599265371 2023-02-17 02:01:19,495 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): regionserver:34495-0x10060026e590002, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-17 02:01:19,496 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): regionserver:37401-0x10060026e590001, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-17 02:01:19,496 INFO [Listener at localhost/39237] procedure2.ProcedureExecutor(629): Stopping 2023-02-17 02:01:19,496 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-17 02:01:19,496 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 02:01:19,497 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34495-0x10060026e590002, quorum=127.0.0.1:50037, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 02:01:19,497 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37401-0x10060026e590001, quorum=127.0.0.1:50037, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 02:01:19,497 DEBUG [Listener at localhost/39237] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x21e1069f to 127.0.0.1:50037 2023-02-17 02:01:19,497 DEBUG [Listener at localhost/39237] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 02:01:19,497 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 02:01:19,498 INFO [Listener at localhost/39237] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,37401,1676599266596' ***** 2023-02-17 02:01:19,498 INFO [Listener at localhost/39237] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-17 02:01:19,498 INFO [Listener at localhost/39237] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,34495,1676599266651' ***** 2023-02-17 02:01:19,498 INFO [Listener at localhost/39237] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-17 02:01:19,498 INFO [RS:0;jenkins-hbase4:37401] regionserver.HeapMemoryManager(220): Stopping 2023-02-17 02:01:19,498 INFO [RS:0;jenkins-hbase4:37401] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-17 02:01:19,498 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-17 02:01:19,498 INFO [RS:0;jenkins-hbase4:37401] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-17 02:01:19,499 INFO [RS:0;jenkins-hbase4:37401] regionserver.HRegionServer(3304): Received CLOSE for a4798e0c958d05023433fed00aa11afa 2023-02-17 02:01:19,499 INFO [RS:0;jenkins-hbase4:37401] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,37401,1676599266596 2023-02-17 02:01:19,499 DEBUG [RS:0;jenkins-hbase4:37401] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x17a516e2 to 127.0.0.1:50037 2023-02-17 02:01:19,499 DEBUG [RS:0;jenkins-hbase4:37401] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 02:01:19,499 INFO [RS:0;jenkins-hbase4:37401] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-17 02:01:19,499 INFO [RS:0;jenkins-hbase4:37401] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-17 02:01:19,499 INFO [RS:0;jenkins-hbase4:37401] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-17 02:01:19,499 INFO [RS:0;jenkins-hbase4:37401] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-17 02:01:19,500 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing a4798e0c958d05023433fed00aa11afa, disabling compactions & flushes 2023-02-17 02:01:19,500 INFO [RS:0;jenkins-hbase4:37401] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-17 02:01:19,500 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676599268814.a4798e0c958d05023433fed00aa11afa. 2023-02-17 02:01:19,500 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676599268814.a4798e0c958d05023433fed00aa11afa. 2023-02-17 02:01:19,500 INFO [RS:1;jenkins-hbase4:34495] regionserver.HeapMemoryManager(220): Stopping 2023-02-17 02:01:19,500 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676599268814.a4798e0c958d05023433fed00aa11afa. after waiting 0 ms 2023-02-17 02:01:19,501 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676599268814.a4798e0c958d05023433fed00aa11afa. 2023-02-17 02:01:19,501 INFO [RS:1;jenkins-hbase4:34495] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-17 02:01:19,501 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing a4798e0c958d05023433fed00aa11afa 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-17 02:01:19,500 DEBUG [RS:0;jenkins-hbase4:37401] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740, a4798e0c958d05023433fed00aa11afa=hbase:namespace,,1676599268814.a4798e0c958d05023433fed00aa11afa.} 2023-02-17 02:01:19,501 INFO [RS:1;jenkins-hbase4:34495] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-17 02:01:19,501 INFO [RS:1;jenkins-hbase4:34495] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,34495,1676599266651 2023-02-17 02:01:19,501 DEBUG [RS:1;jenkins-hbase4:34495] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x51e5b4d4 to 127.0.0.1:50037 2023-02-17 02:01:19,501 DEBUG [RS:1;jenkins-hbase4:34495] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 02:01:19,501 INFO [RS:1;jenkins-hbase4:34495] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,34495,1676599266651; all regions closed. 2023-02-17 02:01:19,501 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-17 02:01:19,502 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-17 02:01:19,502 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-17 02:01:19,502 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-17 02:01:19,502 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-17 02:01:19,502 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-17 02:01:19,503 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=24.29 KB heapSize=40.20 KB 2023-02-17 02:01:19,503 DEBUG [RS:0;jenkins-hbase4:37401] regionserver.HRegionServer(1505): Waiting on 1588230740, a4798e0c958d05023433fed00aa11afa 2023-02-17 02:01:19,511 DEBUG [RS:1;jenkins-hbase4:34495] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/oldWALs 2023-02-17 02:01:19,511 INFO [RS:1;jenkins-hbase4:34495] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34495%2C1676599266651:(num 1676599269176) 2023-02-17 02:01:19,511 DEBUG [RS:1;jenkins-hbase4:34495] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 02:01:19,511 INFO [RS:1;jenkins-hbase4:34495] regionserver.LeaseManager(133): Closed leases 2023-02-17 02:01:19,519 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-17 02:01:19,519 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-17 02:01:19,533 INFO [RS:1;jenkins-hbase4:34495] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-17 02:01:19,533 INFO [RS:1;jenkins-hbase4:34495] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-17 02:01:19,533 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-17 02:01:19,533 INFO [RS:1;jenkins-hbase4:34495] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-17 02:01:19,534 INFO [RS:1;jenkins-hbase4:34495] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-17 02:01:19,535 INFO [RS:1;jenkins-hbase4:34495] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34495 2023-02-17 02:01:19,539 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/hbase/namespace/a4798e0c958d05023433fed00aa11afa/.tmp/info/2e9c76e899fb4185a5ad321660df9b94 2023-02-17 02:01:19,558 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/hbase/namespace/a4798e0c958d05023433fed00aa11afa/.tmp/info/2e9c76e899fb4185a5ad321660df9b94 as hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/hbase/namespace/a4798e0c958d05023433fed00aa11afa/info/2e9c76e899fb4185a5ad321660df9b94 2023-02-17 02:01:19,571 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/hbase/namespace/a4798e0c958d05023433fed00aa11afa/info/2e9c76e899fb4185a5ad321660df9b94, entries=2, sequenceid=6, filesize=4.8 K 2023-02-17 02:01:19,572 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for a4798e0c958d05023433fed00aa11afa in 71ms, sequenceid=6, compaction requested=false 2023-02-17 02:01:19,582 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/hbase/namespace/a4798e0c958d05023433fed00aa11afa/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-17 02:01:19,583 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676599268814.a4798e0c958d05023433fed00aa11afa. 2023-02-17 02:01:19,583 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for a4798e0c958d05023433fed00aa11afa: 2023-02-17 02:01:19,583 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676599268814.a4798e0c958d05023433fed00aa11afa. 2023-02-17 02:01:19,609 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): regionserver:37401-0x10060026e590001, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34495,1676599266651 2023-02-17 02:01:19,609 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 02:01:19,609 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): regionserver:34495-0x10060026e590002, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34495,1676599266651 2023-02-17 02:01:19,609 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): regionserver:37401-0x10060026e590001, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 02:01:19,609 ERROR [Listener at localhost/39237-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@28fdbc59 rejected from java.util.concurrent.ThreadPoolExecutor@2cc23d9e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 02:01:19,609 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): regionserver:34495-0x10060026e590002, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 02:01:19,609 ERROR [Listener at localhost/39237-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1d391092 rejected from java.util.concurrent.ThreadPoolExecutor@2cc23d9e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 02:01:19,609 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,34495,1676599266651] 2023-02-17 02:01:19,610 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,34495,1676599266651; numProcessing=1 2023-02-17 02:01:19,612 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,34495,1676599266651 already deleted, retry=false 2023-02-17 02:01:19,612 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,34495,1676599266651 expired; onlineServers=1 2023-02-17 02:01:19,704 DEBUG [RS:0;jenkins-hbase4:37401] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-17 02:01:19,898 INFO [RS:1;jenkins-hbase4:34495] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,34495,1676599266651; zookeeper connection closed. 2023-02-17 02:01:19,899 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): regionserver:34495-0x10060026e590002, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 02:01:19,899 ERROR [Listener at localhost/39237-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@65f08057 rejected from java.util.concurrent.ThreadPoolExecutor@2cc23d9e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 02:01:19,899 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): regionserver:34495-0x10060026e590002, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 02:01:19,899 ERROR [Listener at localhost/39237-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5c876502 rejected from java.util.concurrent.ThreadPoolExecutor@2cc23d9e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 02:01:19,904 DEBUG [RS:0;jenkins-hbase4:37401] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-17 02:01:19,904 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@61baf52a] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@61baf52a 2023-02-17 02:01:19,956 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.08 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/hbase/meta/1588230740/.tmp/info/daf595e462d34cb8b8379c4748459752 2023-02-17 02:01:19,965 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for daf595e462d34cb8b8379c4748459752 2023-02-17 02:01:19,980 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=997 B at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/hbase/meta/1588230740/.tmp/rep_barrier/221c68b982bf435881c264f2a02f068f 2023-02-17 02:01:19,987 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 221c68b982bf435881c264f2a02f068f 2023-02-17 02:01:20,007 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.24 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/hbase/meta/1588230740/.tmp/table/d8754579e8084a438b6988280cb557e1 2023-02-17 02:01:20,013 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d8754579e8084a438b6988280cb557e1 2023-02-17 02:01:20,014 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/hbase/meta/1588230740/.tmp/info/daf595e462d34cb8b8379c4748459752 as hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/hbase/meta/1588230740/info/daf595e462d34cb8b8379c4748459752 2023-02-17 02:01:20,021 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for daf595e462d34cb8b8379c4748459752 2023-02-17 02:01:20,021 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/hbase/meta/1588230740/info/daf595e462d34cb8b8379c4748459752, entries=30, sequenceid=57, filesize=7.9 K 2023-02-17 02:01:20,022 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/hbase/meta/1588230740/.tmp/rep_barrier/221c68b982bf435881c264f2a02f068f as hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/hbase/meta/1588230740/rep_barrier/221c68b982bf435881c264f2a02f068f 2023-02-17 02:01:20,027 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 221c68b982bf435881c264f2a02f068f 2023-02-17 02:01:20,028 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/hbase/meta/1588230740/rep_barrier/221c68b982bf435881c264f2a02f068f, entries=10, sequenceid=57, filesize=5.9 K 2023-02-17 02:01:20,028 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/hbase/meta/1588230740/.tmp/table/d8754579e8084a438b6988280cb557e1 as hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/hbase/meta/1588230740/table/d8754579e8084a438b6988280cb557e1 2023-02-17 02:01:20,046 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d8754579e8084a438b6988280cb557e1 2023-02-17 02:01:20,046 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/hbase/meta/1588230740/table/d8754579e8084a438b6988280cb557e1, entries=13, sequenceid=57, filesize=5.9 K 2023-02-17 02:01:20,048 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~24.29 KB/24876, heapSize ~40.16 KB/41120, currentSize=0 B/0 for 1588230740 in 546ms, sequenceid=57, compaction requested=false 2023-02-17 02:01:20,066 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-17 02:01:20,066 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-17 02:01:20,068 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-17 02:01:20,068 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-17 02:01:20,068 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-17 02:01:20,104 INFO [RS:0;jenkins-hbase4:37401] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,37401,1676599266596; all regions closed. 2023-02-17 02:01:20,113 DEBUG [RS:0;jenkins-hbase4:37401] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/oldWALs 2023-02-17 02:01:20,113 INFO [RS:0;jenkins-hbase4:37401] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37401%2C1676599266596.meta:.meta(num 1676599268437) 2023-02-17 02:01:20,121 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-17 02:01:20,121 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-17 02:01:20,122 DEBUG [RS:0;jenkins-hbase4:37401] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/oldWALs 2023-02-17 02:01:20,122 INFO [RS:0;jenkins-hbase4:37401] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37401%2C1676599266596:(num 1676599269176) 2023-02-17 02:01:20,122 DEBUG [RS:0;jenkins-hbase4:37401] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 02:01:20,122 INFO [RS:0;jenkins-hbase4:37401] regionserver.LeaseManager(133): Closed leases 2023-02-17 02:01:20,122 INFO [RS:0;jenkins-hbase4:37401] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-17 02:01:20,123 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-17 02:01:20,124 INFO [RS:0;jenkins-hbase4:37401] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37401 2023-02-17 02:01:20,130 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): regionserver:37401-0x10060026e590001, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37401,1676599266596 2023-02-17 02:01:20,130 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 02:01:20,130 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,37401,1676599266596] 2023-02-17 02:01:20,130 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,37401,1676599266596; numProcessing=2 2023-02-17 02:01:20,132 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,37401,1676599266596 already deleted, retry=false 2023-02-17 02:01:20,132 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,37401,1676599266596 expired; onlineServers=0 2023-02-17 02:01:20,132 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,39477,1676599265371' ***** 2023-02-17 02:01:20,132 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-17 02:01:20,133 DEBUG [M:0;jenkins-hbase4:39477] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@a12b39d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-17 02:01:20,134 INFO [M:0;jenkins-hbase4:39477] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,39477,1676599265371 2023-02-17 02:01:20,134 INFO [M:0;jenkins-hbase4:39477] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,39477,1676599265371; all regions closed. 2023-02-17 02:01:20,134 DEBUG [M:0;jenkins-hbase4:39477] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 02:01:20,134 DEBUG [M:0;jenkins-hbase4:39477] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-17 02:01:20,135 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-17 02:01:20,135 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676599267901] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676599267901,5,FailOnTimeoutGroup] 2023-02-17 02:01:20,135 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676599267905] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676599267905,5,FailOnTimeoutGroup] 2023-02-17 02:01:20,135 DEBUG [M:0;jenkins-hbase4:39477] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-17 02:01:20,136 INFO [M:0;jenkins-hbase4:39477] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-17 02:01:20,136 INFO [M:0;jenkins-hbase4:39477] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-17 02:01:20,136 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-17 02:01:20,136 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 02:01:20,136 INFO [M:0;jenkins-hbase4:39477] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-17 02:01:20,137 DEBUG [M:0;jenkins-hbase4:39477] master.HMaster(1512): Stopping service threads 2023-02-17 02:01:20,137 INFO [M:0;jenkins-hbase4:39477] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-17 02:01:20,137 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 02:01:20,137 ERROR [M:0;jenkins-hbase4:39477] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-1,5,PEWorkerGroup] Thread[HFileArchiver-2,5,PEWorkerGroup] Thread[HFileArchiver-3,5,PEWorkerGroup] Thread[HFileArchiver-4,5,PEWorkerGroup] Thread[HFileArchiver-5,5,PEWorkerGroup] Thread[HFileArchiver-6,5,PEWorkerGroup] Thread[HFileArchiver-7,5,PEWorkerGroup] Thread[HFileArchiver-8,5,PEWorkerGroup] 2023-02-17 02:01:20,142 INFO [M:0;jenkins-hbase4:39477] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-17 02:01:20,142 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-17 02:01:20,143 DEBUG [M:0;jenkins-hbase4:39477] zookeeper.ZKUtil(398): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-17 02:01:20,143 WARN [M:0;jenkins-hbase4:39477] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-17 02:01:20,143 INFO [M:0;jenkins-hbase4:39477] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-17 02:01:20,143 INFO [M:0;jenkins-hbase4:39477] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-17 02:01:20,144 DEBUG [M:0;jenkins-hbase4:39477] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-17 02:01:20,144 INFO [M:0;jenkins-hbase4:39477] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 02:01:20,144 DEBUG [M:0;jenkins-hbase4:39477] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 02:01:20,144 DEBUG [M:0;jenkins-hbase4:39477] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-17 02:01:20,144 DEBUG [M:0;jenkins-hbase4:39477] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 02:01:20,144 INFO [M:0;jenkins-hbase4:39477] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=159.27 KB heapSize=192.19 KB 2023-02-17 02:01:20,164 INFO [M:0;jenkins-hbase4:39477] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=159.27 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/88a9b25c998c40878653fd8aa929bafa 2023-02-17 02:01:20,171 DEBUG [M:0;jenkins-hbase4:39477] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/88a9b25c998c40878653fd8aa929bafa as hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/88a9b25c998c40878653fd8aa929bafa 2023-02-17 02:01:20,177 INFO [M:0;jenkins-hbase4:39477] regionserver.HStore(1080): Added hdfs://localhost:44409/user/jenkins/test-data/7deb61db-99c8-f70d-78d0-805ca69b0590/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/88a9b25c998c40878653fd8aa929bafa, entries=53, sequenceid=357, filesize=10.4 K 2023-02-17 02:01:20,178 INFO [M:0;jenkins-hbase4:39477] regionserver.HRegion(2947): Finished flush of dataSize ~159.27 KB/163095, heapSize ~192.17 KB/196784, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 34ms, sequenceid=357, compaction requested=false 2023-02-17 02:01:20,180 INFO [M:0;jenkins-hbase4:39477] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 02:01:20,180 DEBUG [M:0;jenkins-hbase4:39477] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-17 02:01:20,186 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-17 02:01:20,186 INFO [M:0;jenkins-hbase4:39477] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-17 02:01:20,187 INFO [M:0;jenkins-hbase4:39477] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39477 2023-02-17 02:01:20,192 DEBUG [M:0;jenkins-hbase4:39477] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,39477,1676599265371 already deleted, retry=false 2023-02-17 02:01:20,231 INFO [RS:0;jenkins-hbase4:37401] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,37401,1676599266596; zookeeper connection closed. 2023-02-17 02:01:20,231 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): regionserver:37401-0x10060026e590001, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 02:01:20,231 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1b56e663] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1b56e663 2023-02-17 02:01:20,231 ERROR [Listener at localhost/39237-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7224efc2 rejected from java.util.concurrent.ThreadPoolExecutor@761b755e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 02:01:20,232 INFO [Listener at localhost/39237] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-17 02:01:20,232 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): regionserver:37401-0x10060026e590001, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 02:01:20,232 ERROR [Listener at localhost/39237-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@576f8fda rejected from java.util.concurrent.ThreadPoolExecutor@761b755e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 02:01:20,331 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 02:01:20,332 INFO [M:0;jenkins-hbase4:39477] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,39477,1676599265371; zookeeper connection closed. 2023-02-17 02:01:20,332 ERROR [Listener at localhost/39237-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1e8c6672 rejected from java.util.concurrent.ThreadPoolExecutor@2eb0bd16[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 02:01:20,332 DEBUG [Listener at localhost/39237-EventThread] zookeeper.ZKWatcher(600): master:39477-0x10060026e590000, quorum=127.0.0.1:50037, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 02:01:20,332 ERROR [Listener at localhost/39237-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6305c476 rejected from java.util.concurrent.ThreadPoolExecutor@2eb0bd16[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 02:01:20,334 WARN [Listener at localhost/39237] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-17 02:01:20,339 INFO [Listener at localhost/39237] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-17 02:01:20,446 WARN [BP-1224028020-172.31.14.131-1676599261545 heartbeating to localhost/127.0.0.1:44409] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-17 02:01:20,446 WARN [BP-1224028020-172.31.14.131-1676599261545 heartbeating to localhost/127.0.0.1:44409] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1224028020-172.31.14.131-1676599261545 (Datanode Uuid 4551252e-02fd-4a4f-af1f-94b7e0b17be8) service to localhost/127.0.0.1:44409 2023-02-17 02:01:20,448 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9fcbabae-fa27-eae4-5e88-a8a591b6719e/cluster_8d6fc572-0034-0c6e-550f-84d1b147065c/dfs/data/data3/current/BP-1224028020-172.31.14.131-1676599261545] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 02:01:20,448 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9fcbabae-fa27-eae4-5e88-a8a591b6719e/cluster_8d6fc572-0034-0c6e-550f-84d1b147065c/dfs/data/data4/current/BP-1224028020-172.31.14.131-1676599261545] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 02:01:20,450 WARN [Listener at localhost/39237] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-17 02:01:20,460 INFO [Listener at localhost/39237] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-17 02:01:20,564 WARN [BP-1224028020-172.31.14.131-1676599261545 heartbeating to localhost/127.0.0.1:44409] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-17 02:01:20,564 WARN [BP-1224028020-172.31.14.131-1676599261545 heartbeating to localhost/127.0.0.1:44409] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1224028020-172.31.14.131-1676599261545 (Datanode Uuid 3179bd2f-5480-4f6e-914b-5af32208deb3) service to localhost/127.0.0.1:44409 2023-02-17 02:01:20,565 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9fcbabae-fa27-eae4-5e88-a8a591b6719e/cluster_8d6fc572-0034-0c6e-550f-84d1b147065c/dfs/data/data2/current/BP-1224028020-172.31.14.131-1676599261545] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 02:01:20,566 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9fcbabae-fa27-eae4-5e88-a8a591b6719e/cluster_8d6fc572-0034-0c6e-550f-84d1b147065c/dfs/data/data1/current/BP-1224028020-172.31.14.131-1676599261545] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 02:01:20,606 INFO [Listener at localhost/39237] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-17 02:01:20,728 INFO [Listener at localhost/39237] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-17 02:01:20,813 INFO [Listener at localhost/39237] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-17 02:01:20,837 INFO [Listener at localhost/39237] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=103 (was 7) Potentially hanging thread: IPC Parameter Sending Thread #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase4:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-3-worker-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: IPC Client (1508527786) connection to localhost/127.0.0.1:44409 from jenkins.hfs.0 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: region-location-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.0@localhost:44409 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner java.lang.Object.wait(Native Method) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165) org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner.run(FileSystem.java:3693) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/39237 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SnapshotHandlerChoreCleaner sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-3-worker-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.hdfs.PeerCache@7e8c74a1 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.PeerCache.run(PeerCache.java:253) org.apache.hadoop.hdfs.PeerCache.access$000(PeerCache.java:46) org.apache.hadoop.hdfs.PeerCache$1.run(PeerCache.java:124) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SessionTracker java.lang.Thread.sleep(Native Method) org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151) Potentially hanging thread: nioEventLoopGroup-2-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Monitor thread for TaskMonitor java.lang.Thread.sleep(Native Method) org.apache.hadoop.hbase.monitoring.TaskMonitor$MonitorRunnable.run(TaskMonitor.java:327) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LeaseRenewer:jenkins@localhost:44409 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-3-worker-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: HBase-Metrics2-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-1 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcClient-timer-pool-0 java.lang.Thread.sleep(Native Method) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:600) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:496) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,39477,1676599265371)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-5-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Client (1508527786) connection to localhost/127.0.0.1:44409 from jenkins.hfs.1 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1508527786) connection to localhost/127.0.0.1:44409 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: ForkJoinPool-3-worker-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Idle-Rpc-Conn-Sweeper-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1508527786) connection to localhost/127.0.0.1:44409 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Parameter Sending Thread #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.1@localhost:44409 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase4:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=551 (was 240) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=318 (was 221) - SystemLoadAverage LEAK? -, ProcessCount=170 (was 167) - ProcessCount LEAK? -, AvailableMemoryMB=8242 (was 9663) 2023-02-17 02:01:20,851 INFO [Listener at localhost/39237] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=103, OpenFileDescriptor=551, MaxFileDescriptor=60000, SystemLoadAverage=318, ProcessCount=170, AvailableMemoryMB=8240 2023-02-17 02:01:20,865 INFO [Listener at localhost/39237] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9fcbabae-fa27-eae4-5e88-a8a591b6719e/hadoop.log.dir so I do NOT create it in target/test-data/f1b0266e-bab7-2139-00bf-960e9cca3a54 2023-02-17 02:01:20,865 WARN [Listener at localhost/39237] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9fcbabae-fa27-eae4-5e88-a8a591b6719e/hadoop.log.dir Erasing configuration value by system value. 2023-02-17 02:01:20,865 INFO [Listener at localhost/39237] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9fcbabae-fa27-eae4-5e88-a8a591b6719e/hadoop.tmp.dir so I do NOT create it in target/test-data/f1b0266e-bab7-2139-00bf-960e9cca3a54 2023-02-17 02:01:20,866 WARN [Listener at localhost/39237] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9fcbabae-fa27-eae4-5e88-a8a591b6719e/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-17 02:01:20,866 DEBUG [Listener at localhost/39237] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1b0266e-bab7-2139-00bf-960e9cca3a54 2023-02-17 02:01:20,866 INFO [Listener at localhost/39237] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-17 02:01:20,866 INFO [Listener at localhost/39237] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1b0266e-bab7-2139-00bf-960e9cca3a54/cluster_644caca6-26f9-eef7-aee2-cdd95793493a, deleteOnExit=true 2023-02-17 02:01:20,866 INFO [Listener at localhost/39237] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-17 02:01:20,866 INFO [Listener at localhost/39237] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1b0266e-bab7-2139-00bf-960e9cca3a54/test.cache.data in system properties and HBase conf 2023-02-17 02:01:20,866 INFO [Listener at localhost/39237] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1b0266e-bab7-2139-00bf-960e9cca3a54/hadoop.tmp.dir in system properties and HBase conf 2023-02-17 02:01:20,867 INFO [Listener at localhost/39237] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1b0266e-bab7-2139-00bf-960e9cca3a54/hadoop.log.dir in system properties and HBase conf 2023-02-17 02:01:20,867 INFO [Listener at localhost/39237] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1b0266e-bab7-2139-00bf-960e9cca3a54/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-17 02:01:20,867 INFO [Listener at localhost/39237] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1b0266e-bab7-2139-00bf-960e9cca3a54/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-17 02:01:20,867 INFO [Listener at localhost/39237] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-17 02:01:20,867 DEBUG [Listener at localhost/39237] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-17 02:01:20,868 INFO [Listener at localhost/39237] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1b0266e-bab7-2139-00bf-960e9cca3a54/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-17 02:01:20,868 INFO [Listener at localhost/39237] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1b0266e-bab7-2139-00bf-960e9cca3a54/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-17 02:01:20,868 INFO [Listener at localhost/39237] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1b0266e-bab7-2139-00bf-960e9cca3a54/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-17 02:01:20,868 INFO [Listener at localhost/39237] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1b0266e-bab7-2139-00bf-960e9cca3a54/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-17 02:01:20,868 INFO [Listener at localhost/39237] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1b0266e-bab7-2139-00bf-960e9cca3a54/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-17 02:01:20,868 INFO [Listener at localhost/39237] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1b0266e-bab7-2139-00bf-960e9cca3a54/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-17 02:01:20,869 INFO [Listener at localhost/39237] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1b0266e-bab7-2139-00bf-960e9cca3a54/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-17 02:01:20,869 INFO [Listener at localhost/39237] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1b0266e-bab7-2139-00bf-960e9cca3a54/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-17 02:01:20,869 INFO [Listener at localhost/39237] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1b0266e-bab7-2139-00bf-960e9cca3a54/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-17 02:01:20,869 INFO [Listener at localhost/39237] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1b0266e-bab7-2139-00bf-960e9cca3a54/nfs.dump.dir in system properties and HBase conf 2023-02-17 02:01:20,869 INFO [Listener at localhost/39237] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1b0266e-bab7-2139-00bf-960e9cca3a54/java.io.tmpdir in system properties and HBase conf 2023-02-17 02:01:20,869 INFO [Listener at localhost/39237] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1b0266e-bab7-2139-00bf-960e9cca3a54/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-17 02:01:20,870 INFO [Listener at localhost/39237] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1b0266e-bab7-2139-00bf-960e9cca3a54/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-17 02:01:20,870 INFO [Listener at localhost/39237] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1b0266e-bab7-2139-00bf-960e9cca3a54/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-17 02:01:20,875 WARN [Listener at localhost/39237] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-17 02:01:20,875 WARN [Listener at localhost/39237] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-17 02:01:20,931 WARN [Listener at localhost/39237] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-17 02:01:20,935 INFO [Listener at localhost/39237] log.Slf4jLog(67): jetty-6.1.26 2023-02-17 02:01:20,946 INFO [Listener at localhost/39237] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1b0266e-bab7-2139-00bf-960e9cca3a54/java.io.tmpdir/Jetty_localhost_39535_hdfs____.q37291/webapp 2023-02-17 02:01:21,073 INFO [Listener at localhost/39237] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39535 2023-02-17 02:01:21,078 WARN [Listener at localhost/39237] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-17 02:01:21,079 WARN [Listener at localhost/39237] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-17 02:01:21,140 WARN [Listener at localhost/36619] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-17 02:01:21,171 WARN [Listener at localhost/36619] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-17 02:01:21,174 WARN [Listener at localhost/36619] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-17 02:01:21,176 INFO [Listener at localhost/36619] log.Slf4jLog(67): jetty-6.1.26 2023-02-17 02:01:21,188 INFO [Listener at localhost/36619] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1b0266e-bab7-2139-00bf-960e9cca3a54/java.io.tmpdir/Jetty_localhost_34043_datanode____.jzgmln/webapp 2023-02-17 02:01:21,312 INFO [Listener at localhost/36619] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34043 2023-02-17 02:01:21,325 WARN [Listener at localhost/35913] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-17 02:01:21,341 WARN [Listener at localhost/35913] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-17 02:01:21,344 WARN [Listener at localhost/35913] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-17 02:01:21,346 INFO [Listener at localhost/35913] log.Slf4jLog(67): jetty-6.1.26 2023-02-17 02:01:21,359 INFO [Listener at localhost/35913] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1b0266e-bab7-2139-00bf-960e9cca3a54/java.io.tmpdir/Jetty_localhost_33331_datanode____aaf7bs/webapp 2023-02-17 02:01:21,458 INFO [Listener at localhost/35913] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33331 2023-02-17 02:01:21,466 WARN [Listener at localhost/46551] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-17 02:01:21,550 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x75fc2b27ea674199: Processing first storage report for DS-faad23f7-05c5-4975-a5fd-86be57dbbf30 from datanode 9f9a53ee-72ab-4bb9-9992-b3102189cfaa 2023-02-17 02:01:21,550 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x75fc2b27ea674199: from storage DS-faad23f7-05c5-4975-a5fd-86be57dbbf30 node DatanodeRegistration(127.0.0.1:40969, datanodeUuid=9f9a53ee-72ab-4bb9-9992-b3102189cfaa, infoPort=37019, infoSecurePort=0, ipcPort=35913, storageInfo=lv=-57;cid=testClusterID;nsid=1141399731;c=1676599280878), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-17 02:01:21,551 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x75fc2b27ea674199: Processing first storage report for DS-23656367-812b-4042-bbe5-554e7ad2b61b from datanode 9f9a53ee-72ab-4bb9-9992-b3102189cfaa 2023-02-17 02:01:21,551 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x75fc2b27ea674199: from storage DS-23656367-812b-4042-bbe5-554e7ad2b61b node DatanodeRegistration(127.0.0.1:40969, datanodeUuid=9f9a53ee-72ab-4bb9-9992-b3102189cfaa, infoPort=37019, infoSecurePort=0, ipcPort=35913, storageInfo=lv=-57;cid=testClusterID;nsid=1141399731;c=1676599280878), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-17 02:01:21,774 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x53646067854ba5f6: Processing first storage report for DS-2cf1e9d8-a66f-48d9-97b4-ab85b7c5cd21 from datanode 8ca3a3e5-11a6-4775-8d0f-a9cce0b3d215 2023-02-17 02:01:21,774 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x53646067854ba5f6: from storage DS-2cf1e9d8-a66f-48d9-97b4-ab85b7c5cd21 node DatanodeRegistration(127.0.0.1:41363, datanodeUuid=8ca3a3e5-11a6-4775-8d0f-a9cce0b3d215, infoPort=40559, infoSecurePort=0, ipcPort=46551, storageInfo=lv=-57;cid=testClusterID;nsid=1141399731;c=1676599280878), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-17 02:01:21,774 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x53646067854ba5f6: Processing first storage report for DS-cdee4f8c-07cd-4069-bf52-a2470e3cf160 from datanode 8ca3a3e5-11a6-4775-8d0f-a9cce0b3d215 2023-02-17 02:01:21,774 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x53646067854ba5f6: from storage DS-cdee4f8c-07cd-4069-bf52-a2470e3cf160 node DatanodeRegistration(127.0.0.1:41363, datanodeUuid=8ca3a3e5-11a6-4775-8d0f-a9cce0b3d215, infoPort=40559, infoSecurePort=0, ipcPort=46551, storageInfo=lv=-57;cid=testClusterID;nsid=1141399731;c=1676599280878), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-17 02:01:21,778 DEBUG [Listener at localhost/46551] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1b0266e-bab7-2139-00bf-960e9cca3a54 2023-02-17 02:01:21,783 INFO [Listener at localhost/46551] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1b0266e-bab7-2139-00bf-960e9cca3a54/cluster_644caca6-26f9-eef7-aee2-cdd95793493a/zookeeper_0, clientPort=62873, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1b0266e-bab7-2139-00bf-960e9cca3a54/cluster_644caca6-26f9-eef7-aee2-cdd95793493a/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1b0266e-bab7-2139-00bf-960e9cca3a54/cluster_644caca6-26f9-eef7-aee2-cdd95793493a/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-17 02:01:21,785 INFO [Listener at localhost/46551] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=62873 2023-02-17 02:01:21,785 INFO [Listener at localhost/46551] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 02:01:21,787 INFO [Listener at localhost/46551] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 02:01:21,806 INFO [Listener at localhost/46551] util.FSUtils(479): Created version file at hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239 with version=8 2023-02-17 02:01:21,807 INFO [Listener at localhost/46551] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 02:01:21,808 INFO [Listener at localhost/46551] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 02:01:21,809 INFO [Listener at localhost/46551] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:36619/user/jenkins/test-data/e42fbbaf-2fbf-3bc7-220c-4ace9dd84d78/hbase-staging 2023-02-17 02:01:21,811 INFO [Listener at localhost/46551] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-17 02:01:21,811 INFO [Listener at localhost/46551] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 02:01:21,811 INFO [Listener at localhost/46551] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-17 02:01:21,811 INFO [Listener at localhost/46551] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-17 02:01:21,811 INFO [Listener at localhost/46551] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 02:01:21,811 INFO [Listener at localhost/46551] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-17 02:01:21,811 INFO [Listener at localhost/46551] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-17 02:01:21,813 INFO [Listener at localhost/46551] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36043 2023-02-17 02:01:21,813 INFO [Listener at localhost/46551] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 02:01:21,814 INFO [Listener at localhost/46551] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 02:01:21,815 INFO [Listener at localhost/46551] zookeeper.RecoverableZooKeeper(93): Process identifier=master:36043 connecting to ZooKeeper ensemble=127.0.0.1:62873 2023-02-17 02:01:21,823 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): master:360430x0, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-17 02:01:21,825 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:36043-0x1006002b2390000 connected 2023-02-17 02:01:21,844 DEBUG [Listener at localhost/46551] zookeeper.ZKUtil(164): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 02:01:21,844 DEBUG [Listener at localhost/46551] zookeeper.ZKUtil(164): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 02:01:21,847 DEBUG [Listener at localhost/46551] zookeeper.ZKUtil(164): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-17 02:01:21,851 DEBUG [Listener at localhost/46551] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36043 2023-02-17 02:01:21,851 DEBUG [Listener at localhost/46551] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36043 2023-02-17 02:01:21,851 DEBUG [Listener at localhost/46551] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36043 2023-02-17 02:01:21,852 DEBUG [Listener at localhost/46551] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36043 2023-02-17 02:01:21,853 DEBUG [Listener at localhost/46551] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36043 2023-02-17 02:01:21,853 INFO [Listener at localhost/46551] master.HMaster(444): hbase.rootdir=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239, hbase.cluster.distributed=false 2023-02-17 02:01:21,872 INFO [Listener at localhost/46551] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-17 02:01:21,872 INFO [Listener at localhost/46551] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 02:01:21,873 INFO [Listener at localhost/46551] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-17 02:01:21,873 INFO [Listener at localhost/46551] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-17 02:01:21,873 INFO [Listener at localhost/46551] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 02:01:21,873 INFO [Listener at localhost/46551] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-17 02:01:21,873 INFO [Listener at localhost/46551] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-17 02:01:21,876 INFO [Listener at localhost/46551] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42015 2023-02-17 02:01:21,876 INFO [Listener at localhost/46551] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-17 02:01:21,880 DEBUG [Listener at localhost/46551] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 02:01:21,880 INFO [Listener at localhost/46551] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 02:01:21,881 INFO [Listener at localhost/46551] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 02:01:21,882 INFO [Listener at localhost/46551] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42015 connecting to ZooKeeper ensemble=127.0.0.1:62873 2023-02-17 02:01:21,887 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): regionserver:420150x0, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-17 02:01:21,888 DEBUG [Listener at localhost/46551] zookeeper.ZKUtil(164): regionserver:420150x0, quorum=127.0.0.1:62873, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 02:01:21,889 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:42015-0x1006002b2390001 connected 2023-02-17 02:01:21,889 DEBUG [Listener at localhost/46551] zookeeper.ZKUtil(164): regionserver:42015-0x1006002b2390001, quorum=127.0.0.1:62873, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 02:01:21,890 DEBUG [Listener at localhost/46551] zookeeper.ZKUtil(164): regionserver:42015-0x1006002b2390001, quorum=127.0.0.1:62873, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-17 02:01:21,890 DEBUG [Listener at localhost/46551] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42015 2023-02-17 02:01:21,891 DEBUG [Listener at localhost/46551] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42015 2023-02-17 02:01:21,893 DEBUG [Listener at localhost/46551] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42015 2023-02-17 02:01:21,895 DEBUG [Listener at localhost/46551] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42015 2023-02-17 02:01:21,895 DEBUG [Listener at localhost/46551] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42015 2023-02-17 02:01:21,908 INFO [Listener at localhost/46551] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-17 02:01:21,908 INFO [Listener at localhost/46551] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 02:01:21,908 INFO [Listener at localhost/46551] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-17 02:01:21,908 INFO [Listener at localhost/46551] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-17 02:01:21,908 INFO [Listener at localhost/46551] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 02:01:21,908 INFO [Listener at localhost/46551] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-17 02:01:21,909 INFO [Listener at localhost/46551] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-17 02:01:21,910 INFO [Listener at localhost/46551] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37987 2023-02-17 02:01:21,911 INFO [Listener at localhost/46551] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-17 02:01:21,913 DEBUG [Listener at localhost/46551] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 02:01:21,914 INFO [Listener at localhost/46551] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 02:01:21,916 INFO [Listener at localhost/46551] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 02:01:21,917 INFO [Listener at localhost/46551] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:37987 connecting to ZooKeeper ensemble=127.0.0.1:62873 2023-02-17 02:01:21,920 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): regionserver:379870x0, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-17 02:01:21,922 DEBUG [Listener at localhost/46551] zookeeper.ZKUtil(164): regionserver:379870x0, quorum=127.0.0.1:62873, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 02:01:21,922 DEBUG [Listener at localhost/46551] zookeeper.ZKUtil(164): regionserver:379870x0, quorum=127.0.0.1:62873, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 02:01:21,923 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:37987-0x1006002b2390002 connected 2023-02-17 02:01:21,923 DEBUG [Listener at localhost/46551] zookeeper.ZKUtil(164): regionserver:37987-0x1006002b2390002, quorum=127.0.0.1:62873, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-17 02:01:21,924 DEBUG [Listener at localhost/46551] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37987 2023-02-17 02:01:21,927 DEBUG [Listener at localhost/46551] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37987 2023-02-17 02:01:21,928 DEBUG [Listener at localhost/46551] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37987 2023-02-17 02:01:21,931 DEBUG [Listener at localhost/46551] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37987 2023-02-17 02:01:21,931 DEBUG [Listener at localhost/46551] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37987 2023-02-17 02:01:21,933 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,36043,1676599281810 2023-02-17 02:01:21,934 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-17 02:01:21,935 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,36043,1676599281810 2023-02-17 02:01:21,937 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): regionserver:42015-0x1006002b2390001, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-17 02:01:21,938 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): regionserver:37987-0x1006002b2390002, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-17 02:01:21,938 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-17 02:01:21,938 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 02:01:21,939 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-17 02:01:21,940 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,36043,1676599281810 from backup master directory 2023-02-17 02:01:21,940 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-17 02:01:21,943 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,36043,1676599281810 2023-02-17 02:01:21,943 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-17 02:01:21,943 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-17 02:01:21,943 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,36043,1676599281810 2023-02-17 02:01:21,968 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/hbase.id with ID: 69c3737e-c182-439a-9bc6-62f71be8e8d5 2023-02-17 02:01:21,984 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 02:01:21,990 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 02:01:22,001 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x1087185d to 127.0.0.1:62873 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 02:01:22,007 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@53161db7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 02:01:22,008 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-17 02:01:22,008 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-17 02:01:22,008 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 02:01:22,010 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/MasterData/data/master/store-tmp 2023-02-17 02:01:22,018 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:22,018 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-17 02:01:22,018 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 02:01:22,018 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 02:01:22,018 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-17 02:01:22,019 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 02:01:22,019 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 02:01:22,019 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-17 02:01:22,019 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/MasterData/WALs/jenkins-hbase4.apache.org,36043,1676599281810 2023-02-17 02:01:22,022 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36043%2C1676599281810, suffix=, logDir=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/MasterData/WALs/jenkins-hbase4.apache.org,36043,1676599281810, archiveDir=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/MasterData/oldWALs, maxLogs=10 2023-02-17 02:01:22,039 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40969,DS-faad23f7-05c5-4975-a5fd-86be57dbbf30,DISK] 2023-02-17 02:01:22,040 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41363,DS-2cf1e9d8-a66f-48d9-97b4-ab85b7c5cd21,DISK] 2023-02-17 02:01:22,046 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/MasterData/WALs/jenkins-hbase4.apache.org,36043,1676599281810/jenkins-hbase4.apache.org%2C36043%2C1676599281810.1676599282022 2023-02-17 02:01:22,046 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40969,DS-faad23f7-05c5-4975-a5fd-86be57dbbf30,DISK], DatanodeInfoWithStorage[127.0.0.1:41363,DS-2cf1e9d8-a66f-48d9-97b4-ab85b7c5cd21,DISK]] 2023-02-17 02:01:22,046 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-17 02:01:22,046 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:22,046 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-17 02:01:22,047 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-17 02:01:22,048 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-17 02:01:22,049 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-17 02:01:22,050 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-17 02:01:22,050 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:22,051 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-17 02:01:22,051 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-17 02:01:22,054 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-17 02:01:22,055 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 02:01:22,056 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61272070, jitterRate=-0.08697500824928284}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-17 02:01:22,056 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-17 02:01:22,056 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-17 02:01:22,057 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-17 02:01:22,058 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-17 02:01:22,058 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-17 02:01:22,058 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-17 02:01:22,058 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-17 02:01:22,058 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-17 02:01:22,060 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-17 02:01:22,060 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-17 02:01:22,072 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-17 02:01:22,072 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-17 02:01:22,073 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-17 02:01:22,073 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-17 02:01:22,073 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-17 02:01:22,075 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 02:01:22,075 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-17 02:01:22,076 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-17 02:01:22,077 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-17 02:01:22,079 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-17 02:01:22,079 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): regionserver:37987-0x1006002b2390002, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-17 02:01:22,079 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 02:01:22,079 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): regionserver:42015-0x1006002b2390001, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-17 02:01:22,080 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,36043,1676599281810, sessionid=0x1006002b2390000, setting cluster-up flag (Was=false) 2023-02-17 02:01:22,084 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 02:01:22,089 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-17 02:01:22,090 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,36043,1676599281810 2023-02-17 02:01:22,092 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 02:01:22,097 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-17 02:01:22,098 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,36043,1676599281810 2023-02-17 02:01:22,099 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/.hbase-snapshot/.tmp 2023-02-17 02:01:22,100 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-17 02:01:22,101 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-17 02:01:22,101 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-17 02:01:22,101 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-17 02:01:22,101 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-17 02:01:22,101 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-17 02:01:22,101 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:22,101 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-17 02:01:22,101 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:22,104 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676599312104 2023-02-17 02:01:22,104 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-17 02:01:22,105 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-17 02:01:22,105 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-17 02:01:22,105 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-17 02:01:22,105 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-17 02:01:22,105 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-17 02:01:22,105 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:22,105 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-17 02:01:22,106 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-17 02:01:22,106 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-17 02:01:22,106 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-17 02:01:22,106 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-17 02:01:22,106 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-17 02:01:22,106 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-17 02:01:22,107 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676599282106,5,FailOnTimeoutGroup] 2023-02-17 02:01:22,107 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676599282107,5,FailOnTimeoutGroup] 2023-02-17 02:01:22,107 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:22,107 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-17 02:01:22,107 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-17 02:01:22,107 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:22,107 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:22,120 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-17 02:01:22,120 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-17 02:01:22,121 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239 2023-02-17 02:01:22,130 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:22,131 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-17 02:01:22,133 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/hbase/meta/1588230740/info 2023-02-17 02:01:22,134 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-17 02:01:22,134 INFO [RS:0;jenkins-hbase4:42015] regionserver.HRegionServer(952): ClusterId : 69c3737e-c182-439a-9bc6-62f71be8e8d5 2023-02-17 02:01:22,134 DEBUG [RS:0;jenkins-hbase4:42015] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-17 02:01:22,135 INFO [RS:1;jenkins-hbase4:37987] regionserver.HRegionServer(952): ClusterId : 69c3737e-c182-439a-9bc6-62f71be8e8d5 2023-02-17 02:01:22,135 DEBUG [RS:1;jenkins-hbase4:37987] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-17 02:01:22,136 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:22,136 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-17 02:01:22,137 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/hbase/meta/1588230740/rep_barrier 2023-02-17 02:01:22,137 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-17 02:01:22,138 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:22,138 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-17 02:01:22,138 DEBUG [RS:0;jenkins-hbase4:42015] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-17 02:01:22,139 DEBUG [RS:0;jenkins-hbase4:42015] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-17 02:01:22,139 DEBUG [RS:1;jenkins-hbase4:37987] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-17 02:01:22,139 DEBUG [RS:1;jenkins-hbase4:37987] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-17 02:01:22,139 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/hbase/meta/1588230740/table 2023-02-17 02:01:22,140 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-17 02:01:22,140 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:22,141 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/hbase/meta/1588230740 2023-02-17 02:01:22,141 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/hbase/meta/1588230740 2023-02-17 02:01:22,142 DEBUG [RS:0;jenkins-hbase4:42015] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-17 02:01:22,144 DEBUG [RS:0;jenkins-hbase4:42015] zookeeper.ReadOnlyZKClient(139): Connect 0x162b01c5 to 127.0.0.1:62873 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 02:01:22,144 DEBUG [RS:1;jenkins-hbase4:37987] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-17 02:01:22,146 DEBUG [RS:1;jenkins-hbase4:37987] zookeeper.ReadOnlyZKClient(139): Connect 0x48e5bfe1 to 127.0.0.1:62873 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 02:01:22,148 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-17 02:01:22,150 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-17 02:01:22,152 DEBUG [RS:0;jenkins-hbase4:42015] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@18ecfd70, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 02:01:22,152 DEBUG [RS:0;jenkins-hbase4:42015] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1cd36ab5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-17 02:01:22,152 DEBUG [RS:1;jenkins-hbase4:37987] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4622488d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 02:01:22,153 DEBUG [RS:1;jenkins-hbase4:37987] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@421dd491, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-17 02:01:22,158 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 02:01:22,159 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74662624, jitterRate=0.11255979537963867}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-17 02:01:22,159 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-17 02:01:22,159 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-17 02:01:22,159 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-17 02:01:22,159 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-17 02:01:22,159 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-17 02:01:22,159 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-17 02:01:22,163 DEBUG [RS:0;jenkins-hbase4:42015] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:42015 2023-02-17 02:01:22,163 INFO [RS:0;jenkins-hbase4:42015] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-17 02:01:22,163 INFO [RS:0;jenkins-hbase4:42015] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-17 02:01:22,163 DEBUG [RS:0;jenkins-hbase4:42015] regionserver.HRegionServer(1023): About to register with Master. 2023-02-17 02:01:22,164 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-17 02:01:22,164 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-17 02:01:22,164 INFO [RS:0;jenkins-hbase4:42015] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,36043,1676599281810 with isa=jenkins-hbase4.apache.org/172.31.14.131:42015, startcode=1676599281872 2023-02-17 02:01:22,164 DEBUG [RS:0;jenkins-hbase4:42015] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-17 02:01:22,165 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-17 02:01:22,165 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-17 02:01:22,165 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-17 02:01:22,165 DEBUG [RS:1;jenkins-hbase4:37987] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:37987 2023-02-17 02:01:22,166 INFO [RS:1;jenkins-hbase4:37987] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-17 02:01:22,166 INFO [RS:1;jenkins-hbase4:37987] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-17 02:01:22,166 DEBUG [RS:1;jenkins-hbase4:37987] regionserver.HRegionServer(1023): About to register with Master. 2023-02-17 02:01:22,167 INFO [RS:1;jenkins-hbase4:37987] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,36043,1676599281810 with isa=jenkins-hbase4.apache.org/172.31.14.131:37987, startcode=1676599281907 2023-02-17 02:01:22,167 DEBUG [RS:1;jenkins-hbase4:37987] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-17 02:01:22,169 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-17 02:01:22,170 INFO [RS-EventLoopGroup-6-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37083, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-02-17 02:01:22,171 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36043] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,42015,1676599281872 2023-02-17 02:01:22,171 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-17 02:01:22,174 DEBUG [RS:0;jenkins-hbase4:42015] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239 2023-02-17 02:01:22,174 DEBUG [RS:0;jenkins-hbase4:42015] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:36619 2023-02-17 02:01:22,174 DEBUG [RS:0;jenkins-hbase4:42015] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-17 02:01:22,174 INFO [RS-EventLoopGroup-6-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56279, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.3 (auth:SIMPLE), service=RegionServerStatusService 2023-02-17 02:01:22,175 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36043] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,37987,1676599281907 2023-02-17 02:01:22,175 DEBUG [RS:1;jenkins-hbase4:37987] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239 2023-02-17 02:01:22,175 DEBUG [RS:1;jenkins-hbase4:37987] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:36619 2023-02-17 02:01:22,175 DEBUG [RS:1;jenkins-hbase4:37987] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-17 02:01:22,176 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 02:01:22,180 DEBUG [RS:0;jenkins-hbase4:42015] zookeeper.ZKUtil(162): regionserver:42015-0x1006002b2390001, quorum=127.0.0.1:62873, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42015,1676599281872 2023-02-17 02:01:22,180 WARN [RS:0;jenkins-hbase4:42015] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-17 02:01:22,180 INFO [RS:0;jenkins-hbase4:42015] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 02:01:22,180 DEBUG [RS:1;jenkins-hbase4:37987] zookeeper.ZKUtil(162): regionserver:37987-0x1006002b2390002, quorum=127.0.0.1:62873, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37987,1676599281907 2023-02-17 02:01:22,180 DEBUG [RS:0;jenkins-hbase4:42015] regionserver.HRegionServer(1947): logDir=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/WALs/jenkins-hbase4.apache.org,42015,1676599281872 2023-02-17 02:01:22,180 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,37987,1676599281907] 2023-02-17 02:01:22,180 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,42015,1676599281872] 2023-02-17 02:01:22,180 WARN [RS:1;jenkins-hbase4:37987] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-17 02:01:22,180 INFO [RS:1;jenkins-hbase4:37987] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 02:01:22,180 DEBUG [RS:1;jenkins-hbase4:37987] regionserver.HRegionServer(1947): logDir=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/WALs/jenkins-hbase4.apache.org,37987,1676599281907 2023-02-17 02:01:22,186 DEBUG [RS:1;jenkins-hbase4:37987] zookeeper.ZKUtil(162): regionserver:37987-0x1006002b2390002, quorum=127.0.0.1:62873, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42015,1676599281872 2023-02-17 02:01:22,186 DEBUG [RS:0;jenkins-hbase4:42015] zookeeper.ZKUtil(162): regionserver:42015-0x1006002b2390001, quorum=127.0.0.1:62873, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42015,1676599281872 2023-02-17 02:01:22,187 DEBUG [RS:1;jenkins-hbase4:37987] zookeeper.ZKUtil(162): regionserver:37987-0x1006002b2390002, quorum=127.0.0.1:62873, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37987,1676599281907 2023-02-17 02:01:22,187 DEBUG [RS:0;jenkins-hbase4:42015] zookeeper.ZKUtil(162): regionserver:42015-0x1006002b2390001, quorum=127.0.0.1:62873, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37987,1676599281907 2023-02-17 02:01:22,188 DEBUG [RS:1;jenkins-hbase4:37987] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-17 02:01:22,188 DEBUG [RS:0;jenkins-hbase4:42015] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-17 02:01:22,188 INFO [RS:1;jenkins-hbase4:37987] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-17 02:01:22,188 INFO [RS:0;jenkins-hbase4:42015] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-17 02:01:22,191 INFO [RS:1;jenkins-hbase4:37987] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-17 02:01:22,191 INFO [RS:1;jenkins-hbase4:37987] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-17 02:01:22,191 INFO [RS:1;jenkins-hbase4:37987] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:22,196 INFO [RS:1;jenkins-hbase4:37987] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-17 02:01:22,196 INFO [RS:0;jenkins-hbase4:42015] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-17 02:01:22,199 INFO [RS:1;jenkins-hbase4:37987] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:22,199 INFO [RS:0;jenkins-hbase4:42015] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-17 02:01:22,200 INFO [RS:0;jenkins-hbase4:42015] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:22,200 DEBUG [RS:1;jenkins-hbase4:37987] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:22,200 DEBUG [RS:1;jenkins-hbase4:37987] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:22,200 DEBUG [RS:1;jenkins-hbase4:37987] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:22,200 DEBUG [RS:1;jenkins-hbase4:37987] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:22,200 DEBUG [RS:1;jenkins-hbase4:37987] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:22,200 DEBUG [RS:1;jenkins-hbase4:37987] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-17 02:01:22,200 DEBUG [RS:1;jenkins-hbase4:37987] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:22,200 DEBUG [RS:1;jenkins-hbase4:37987] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:22,200 DEBUG [RS:1;jenkins-hbase4:37987] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:22,200 DEBUG [RS:1;jenkins-hbase4:37987] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:22,200 INFO [RS:0;jenkins-hbase4:42015] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-17 02:01:22,202 INFO [RS:1;jenkins-hbase4:37987] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:22,202 INFO [RS:1;jenkins-hbase4:37987] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:22,202 INFO [RS:1;jenkins-hbase4:37987] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:22,202 INFO [RS:0;jenkins-hbase4:42015] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:22,203 DEBUG [RS:0;jenkins-hbase4:42015] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:22,203 DEBUG [RS:0;jenkins-hbase4:42015] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:22,203 DEBUG [RS:0;jenkins-hbase4:42015] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:22,203 DEBUG [RS:0;jenkins-hbase4:42015] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:22,203 DEBUG [RS:0;jenkins-hbase4:42015] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:22,203 DEBUG [RS:0;jenkins-hbase4:42015] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-17 02:01:22,203 DEBUG [RS:0;jenkins-hbase4:42015] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:22,203 DEBUG [RS:0;jenkins-hbase4:42015] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:22,203 DEBUG [RS:0;jenkins-hbase4:42015] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:22,203 DEBUG [RS:0;jenkins-hbase4:42015] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:22,212 INFO [RS:0;jenkins-hbase4:42015] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:22,213 INFO [RS:0;jenkins-hbase4:42015] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:22,213 INFO [RS:0;jenkins-hbase4:42015] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:22,216 INFO [RS:1;jenkins-hbase4:37987] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-17 02:01:22,216 INFO [RS:1;jenkins-hbase4:37987] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37987,1676599281907-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:22,226 INFO [RS:0;jenkins-hbase4:42015] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-17 02:01:22,226 INFO [RS:0;jenkins-hbase4:42015] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42015,1676599281872-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:22,229 INFO [RS:1;jenkins-hbase4:37987] regionserver.Replication(203): jenkins-hbase4.apache.org,37987,1676599281907 started 2023-02-17 02:01:22,229 INFO [RS:1;jenkins-hbase4:37987] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,37987,1676599281907, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:37987, sessionid=0x1006002b2390002 2023-02-17 02:01:22,229 DEBUG [RS:1;jenkins-hbase4:37987] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-17 02:01:22,229 DEBUG [RS:1;jenkins-hbase4:37987] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,37987,1676599281907 2023-02-17 02:01:22,229 DEBUG [RS:1;jenkins-hbase4:37987] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37987,1676599281907' 2023-02-17 02:01:22,229 DEBUG [RS:1;jenkins-hbase4:37987] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 02:01:22,230 DEBUG [RS:1;jenkins-hbase4:37987] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 02:01:22,230 DEBUG [RS:1;jenkins-hbase4:37987] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-17 02:01:22,230 DEBUG [RS:1;jenkins-hbase4:37987] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-17 02:01:22,230 DEBUG [RS:1;jenkins-hbase4:37987] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,37987,1676599281907 2023-02-17 02:01:22,230 DEBUG [RS:1;jenkins-hbase4:37987] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37987,1676599281907' 2023-02-17 02:01:22,230 DEBUG [RS:1;jenkins-hbase4:37987] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 02:01:22,230 DEBUG [RS:1;jenkins-hbase4:37987] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 02:01:22,231 DEBUG [RS:1;jenkins-hbase4:37987] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-17 02:01:22,231 INFO [RS:1;jenkins-hbase4:37987] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-17 02:01:22,231 INFO [RS:1;jenkins-hbase4:37987] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-17 02:01:22,238 INFO [RS:0;jenkins-hbase4:42015] regionserver.Replication(203): jenkins-hbase4.apache.org,42015,1676599281872 started 2023-02-17 02:01:22,238 INFO [RS:0;jenkins-hbase4:42015] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,42015,1676599281872, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:42015, sessionid=0x1006002b2390001 2023-02-17 02:01:22,238 DEBUG [RS:0;jenkins-hbase4:42015] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-17 02:01:22,238 DEBUG [RS:0;jenkins-hbase4:42015] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,42015,1676599281872 2023-02-17 02:01:22,238 DEBUG [RS:0;jenkins-hbase4:42015] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42015,1676599281872' 2023-02-17 02:01:22,239 DEBUG [RS:0;jenkins-hbase4:42015] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 02:01:22,239 DEBUG [RS:0;jenkins-hbase4:42015] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 02:01:22,239 DEBUG [RS:0;jenkins-hbase4:42015] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-17 02:01:22,239 DEBUG [RS:0;jenkins-hbase4:42015] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-17 02:01:22,239 DEBUG [RS:0;jenkins-hbase4:42015] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,42015,1676599281872 2023-02-17 02:01:22,239 DEBUG [RS:0;jenkins-hbase4:42015] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42015,1676599281872' 2023-02-17 02:01:22,239 DEBUG [RS:0;jenkins-hbase4:42015] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 02:01:22,240 DEBUG [RS:0;jenkins-hbase4:42015] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 02:01:22,240 DEBUG [RS:0;jenkins-hbase4:42015] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-17 02:01:22,240 INFO [RS:0;jenkins-hbase4:42015] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-17 02:01:22,240 INFO [RS:0;jenkins-hbase4:42015] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-17 02:01:22,322 DEBUG [jenkins-hbase4:36043] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-17 02:01:22,322 DEBUG [jenkins-hbase4:36043] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-17 02:01:22,324 DEBUG [jenkins-hbase4:36043] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-17 02:01:22,324 DEBUG [jenkins-hbase4:36043] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-17 02:01:22,324 DEBUG [jenkins-hbase4:36043] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-17 02:01:22,325 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,42015,1676599281872, state=OPENING 2023-02-17 02:01:22,327 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-17 02:01:22,328 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 02:01:22,329 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-17 02:01:22,329 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,42015,1676599281872}] 2023-02-17 02:01:22,483 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,42015,1676599281872 2023-02-17 02:01:22,483 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-17 02:01:22,486 INFO [RS-EventLoopGroup-7-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57620, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-17 02:01:22,490 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-17 02:01:22,490 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 02:01:22,491 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42015%2C1676599281872.meta, suffix=.meta, logDir=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/WALs/jenkins-hbase4.apache.org,42015,1676599281872, archiveDir=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/oldWALs, maxLogs=32 2023-02-17 02:01:22,508 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40969,DS-faad23f7-05c5-4975-a5fd-86be57dbbf30,DISK] 2023-02-17 02:01:22,509 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41363,DS-2cf1e9d8-a66f-48d9-97b4-ab85b7c5cd21,DISK] 2023-02-17 02:01:22,511 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/WALs/jenkins-hbase4.apache.org,42015,1676599281872/jenkins-hbase4.apache.org%2C42015%2C1676599281872.meta.1676599282492.meta 2023-02-17 02:01:22,511 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41363,DS-2cf1e9d8-a66f-48d9-97b4-ab85b7c5cd21,DISK], DatanodeInfoWithStorage[127.0.0.1:40969,DS-faad23f7-05c5-4975-a5fd-86be57dbbf30,DISK]] 2023-02-17 02:01:22,511 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-17 02:01:22,512 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-17 02:01:22,512 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-17 02:01:22,513 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-17 02:01:22,513 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-17 02:01:22,513 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:22,513 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-17 02:01:22,513 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-17 02:01:22,514 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-17 02:01:22,515 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/hbase/meta/1588230740/info 2023-02-17 02:01:22,516 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/hbase/meta/1588230740/info 2023-02-17 02:01:22,516 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-17 02:01:22,516 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:22,517 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-17 02:01:22,518 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/hbase/meta/1588230740/rep_barrier 2023-02-17 02:01:22,518 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/hbase/meta/1588230740/rep_barrier 2023-02-17 02:01:22,518 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-17 02:01:22,518 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:22,519 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-17 02:01:22,520 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/hbase/meta/1588230740/table 2023-02-17 02:01:22,520 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/hbase/meta/1588230740/table 2023-02-17 02:01:22,520 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-17 02:01:22,521 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:22,521 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/hbase/meta/1588230740 2023-02-17 02:01:22,522 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/hbase/meta/1588230740 2023-02-17 02:01:22,525 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-17 02:01:22,526 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-17 02:01:22,527 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60581182, jitterRate=-0.09727004170417786}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-17 02:01:22,527 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-17 02:01:22,527 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676599282483 2023-02-17 02:01:22,532 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-17 02:01:22,532 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-17 02:01:22,533 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,42015,1676599281872, state=OPEN 2023-02-17 02:01:22,534 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-17 02:01:22,534 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-17 02:01:22,536 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-17 02:01:22,536 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,42015,1676599281872 in 205 msec 2023-02-17 02:01:22,538 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-17 02:01:22,538 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 371 msec 2023-02-17 02:01:22,540 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 440 msec 2023-02-17 02:01:22,540 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676599282540, completionTime=-1 2023-02-17 02:01:22,541 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-17 02:01:22,541 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-17 02:01:22,544 DEBUG [hconnection-0x5cbf09ce-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 02:01:22,546 INFO [RS-EventLoopGroup-7-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57630, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 02:01:22,548 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-17 02:01:22,548 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676599342548 2023-02-17 02:01:22,548 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676599402548 2023-02-17 02:01:22,548 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 7 msec 2023-02-17 02:01:22,556 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36043,1676599281810-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:22,556 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36043,1676599281810-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:22,556 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36043,1676599281810-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:22,556 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:36043, period=300000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:22,556 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:22,556 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-17 02:01:22,557 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-17 02:01:22,558 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-17 02:01:22,559 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-17 02:01:22,560 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-17 02:01:22,560 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-17 02:01:22,562 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/.tmp/data/hbase/namespace/b16a80a118e9e9e6f4ef40d996157ccb 2023-02-17 02:01:22,563 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/.tmp/data/hbase/namespace/b16a80a118e9e9e6f4ef40d996157ccb empty. 2023-02-17 02:01:22,563 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/.tmp/data/hbase/namespace/b16a80a118e9e9e6f4ef40d996157ccb 2023-02-17 02:01:22,563 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-17 02:01:22,578 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-17 02:01:22,580 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => b16a80a118e9e9e6f4ef40d996157ccb, NAME => 'hbase:namespace,,1676599282556.b16a80a118e9e9e6f4ef40d996157ccb.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/.tmp 2023-02-17 02:01:22,593 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676599282556.b16a80a118e9e9e6f4ef40d996157ccb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:22,593 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing b16a80a118e9e9e6f4ef40d996157ccb, disabling compactions & flushes 2023-02-17 02:01:22,593 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676599282556.b16a80a118e9e9e6f4ef40d996157ccb. 2023-02-17 02:01:22,593 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676599282556.b16a80a118e9e9e6f4ef40d996157ccb. 2023-02-17 02:01:22,593 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676599282556.b16a80a118e9e9e6f4ef40d996157ccb. after waiting 0 ms 2023-02-17 02:01:22,593 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676599282556.b16a80a118e9e9e6f4ef40d996157ccb. 2023-02-17 02:01:22,593 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676599282556.b16a80a118e9e9e6f4ef40d996157ccb. 2023-02-17 02:01:22,593 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for b16a80a118e9e9e6f4ef40d996157ccb: 2023-02-17 02:01:22,596 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-17 02:01:22,597 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676599282556.b16a80a118e9e9e6f4ef40d996157ccb.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676599282597"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676599282597"}]},"ts":"1676599282597"} 2023-02-17 02:01:22,601 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-17 02:01:22,602 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-17 02:01:22,602 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676599282602"}]},"ts":"1676599282602"} 2023-02-17 02:01:22,604 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-17 02:01:22,607 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-17 02:01:22,608 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-17 02:01:22,608 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-17 02:01:22,608 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-17 02:01:22,608 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=b16a80a118e9e9e6f4ef40d996157ccb, ASSIGN}] 2023-02-17 02:01:22,611 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=b16a80a118e9e9e6f4ef40d996157ccb, ASSIGN 2023-02-17 02:01:22,612 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=b16a80a118e9e9e6f4ef40d996157ccb, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42015,1676599281872; forceNewPlan=false, retain=false 2023-02-17 02:01:22,763 INFO [jenkins-hbase4:36043] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-17 02:01:22,764 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=b16a80a118e9e9e6f4ef40d996157ccb, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42015,1676599281872 2023-02-17 02:01:22,764 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676599282556.b16a80a118e9e9e6f4ef40d996157ccb.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676599282764"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676599282764"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676599282764"}]},"ts":"1676599282764"} 2023-02-17 02:01:22,767 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure b16a80a118e9e9e6f4ef40d996157ccb, server=jenkins-hbase4.apache.org,42015,1676599281872}] 2023-02-17 02:01:22,923 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676599282556.b16a80a118e9e9e6f4ef40d996157ccb. 2023-02-17 02:01:22,925 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42015%2C1676599281872, suffix=, logDir=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/WALs/jenkins-hbase4.apache.org,42015,1676599281872, archiveDir=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/oldWALs, maxLogs=32 2023-02-17 02:01:22,947 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41363,DS-2cf1e9d8-a66f-48d9-97b4-ab85b7c5cd21,DISK] 2023-02-17 02:01:22,949 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40969,DS-faad23f7-05c5-4975-a5fd-86be57dbbf30,DISK] 2023-02-17 02:01:22,952 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/WALs/jenkins-hbase4.apache.org,42015,1676599281872/jenkins-hbase4.apache.org%2C42015%2C1676599281872.1676599282926 2023-02-17 02:01:22,952 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41363,DS-2cf1e9d8-a66f-48d9-97b4-ab85b7c5cd21,DISK], DatanodeInfoWithStorage[127.0.0.1:40969,DS-faad23f7-05c5-4975-a5fd-86be57dbbf30,DISK]] 2023-02-17 02:01:22,952 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => b16a80a118e9e9e6f4ef40d996157ccb, NAME => 'hbase:namespace,,1676599282556.b16a80a118e9e9e6f4ef40d996157ccb.', STARTKEY => '', ENDKEY => ''} 2023-02-17 02:01:22,953 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace b16a80a118e9e9e6f4ef40d996157ccb 2023-02-17 02:01:22,953 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676599282556.b16a80a118e9e9e6f4ef40d996157ccb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:22,953 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for b16a80a118e9e9e6f4ef40d996157ccb 2023-02-17 02:01:22,953 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for b16a80a118e9e9e6f4ef40d996157ccb 2023-02-17 02:01:22,954 INFO [StoreOpener-b16a80a118e9e9e6f4ef40d996157ccb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region b16a80a118e9e9e6f4ef40d996157ccb 2023-02-17 02:01:22,956 DEBUG [StoreOpener-b16a80a118e9e9e6f4ef40d996157ccb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/hbase/namespace/b16a80a118e9e9e6f4ef40d996157ccb/info 2023-02-17 02:01:22,956 DEBUG [StoreOpener-b16a80a118e9e9e6f4ef40d996157ccb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/hbase/namespace/b16a80a118e9e9e6f4ef40d996157ccb/info 2023-02-17 02:01:22,956 INFO [StoreOpener-b16a80a118e9e9e6f4ef40d996157ccb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b16a80a118e9e9e6f4ef40d996157ccb columnFamilyName info 2023-02-17 02:01:22,957 INFO [StoreOpener-b16a80a118e9e9e6f4ef40d996157ccb-1] regionserver.HStore(310): Store=b16a80a118e9e9e6f4ef40d996157ccb/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:22,958 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/hbase/namespace/b16a80a118e9e9e6f4ef40d996157ccb 2023-02-17 02:01:22,958 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/hbase/namespace/b16a80a118e9e9e6f4ef40d996157ccb 2023-02-17 02:01:22,962 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for b16a80a118e9e9e6f4ef40d996157ccb 2023-02-17 02:01:22,968 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/hbase/namespace/b16a80a118e9e9e6f4ef40d996157ccb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 02:01:22,969 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened b16a80a118e9e9e6f4ef40d996157ccb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59342438, jitterRate=-0.11572876572608948}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-17 02:01:22,969 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for b16a80a118e9e9e6f4ef40d996157ccb: 2023-02-17 02:01:22,970 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676599282556.b16a80a118e9e9e6f4ef40d996157ccb., pid=6, masterSystemTime=1676599282919 2023-02-17 02:01:22,974 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676599282556.b16a80a118e9e9e6f4ef40d996157ccb. 2023-02-17 02:01:22,974 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676599282556.b16a80a118e9e9e6f4ef40d996157ccb. 2023-02-17 02:01:22,974 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=b16a80a118e9e9e6f4ef40d996157ccb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42015,1676599281872 2023-02-17 02:01:22,974 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676599282556.b16a80a118e9e9e6f4ef40d996157ccb.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676599282974"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676599282974"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676599282974"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676599282974"}]},"ts":"1676599282974"} 2023-02-17 02:01:22,978 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-17 02:01:22,978 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure b16a80a118e9e9e6f4ef40d996157ccb, server=jenkins-hbase4.apache.org,42015,1676599281872 in 209 msec 2023-02-17 02:01:22,980 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-17 02:01:22,980 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=b16a80a118e9e9e6f4ef40d996157ccb, ASSIGN in 370 msec 2023-02-17 02:01:22,981 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-17 02:01:22,981 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676599282981"}]},"ts":"1676599282981"} 2023-02-17 02:01:22,983 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-17 02:01:22,986 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-17 02:01:22,987 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 429 msec 2023-02-17 02:01:23,059 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-17 02:01:23,062 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-17 02:01:23,062 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 02:01:23,067 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-17 02:01:23,076 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-17 02:01:23,080 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 12 msec 2023-02-17 02:01:23,090 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-17 02:01:23,099 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-17 02:01:23,103 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 13 msec 2023-02-17 02:01:23,115 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-17 02:01:23,118 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-17 02:01:23,118 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.175sec 2023-02-17 02:01:23,119 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-17 02:01:23,119 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-17 02:01:23,119 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-17 02:01:23,119 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36043,1676599281810-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-17 02:01:23,119 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36043,1676599281810-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-17 02:01:23,121 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-17 02:01:23,134 DEBUG [Listener at localhost/46551] zookeeper.ReadOnlyZKClient(139): Connect 0x56249e02 to 127.0.0.1:62873 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 02:01:23,147 DEBUG [Listener at localhost/46551] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@241b9dd6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 02:01:23,149 DEBUG [hconnection-0x6ae69468-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 02:01:23,152 INFO [RS-EventLoopGroup-7-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57646, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 02:01:23,153 INFO [Listener at localhost/46551] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,36043,1676599281810 2023-02-17 02:01:23,153 DEBUG [Listener at localhost/46551] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-17 02:01:23,156 DEBUG [Listener at localhost/46551] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-17 02:01:23,164 INFO [RS-EventLoopGroup-6-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50462, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-17 02:01:23,168 INFO [Listener at localhost/46551] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-17 02:01:23,168 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36043] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-17 02:01:23,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36043] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-17 02:01:23,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36043] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 77 connection: 172.31.14.131:50462 deadline: 1676599343168, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-17 02:01:23,170 INFO [Listener at localhost/46551] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-17 02:01:23,173 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36043] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-17 02:01:23,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36043] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-17 02:01:23,177 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-17 02:01:23,177 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36043] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-17 02:01:23,178 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-17 02:01:23,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36043] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 02:01:23,189 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/.tmp/data/default/testWithMapReduce/6fd84418026599548312cefaa7aa3bbe 2023-02-17 02:01:23,189 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/.tmp/data/default/testWithMapReduce/2320e8050ac479d9cc2f8e39be1d5e17 2023-02-17 02:01:23,189 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/.tmp/data/default/testWithMapReduce/2700e21ceee9ee6242041ee38fc8cdfa 2023-02-17 02:01:23,189 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/.tmp/data/default/testWithMapReduce/d0c39439e95718da09586626dbdd1981 2023-02-17 02:01:23,189 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/.tmp/data/default/testWithMapReduce/76fb71705f76672ea40ce0d3b7341303 2023-02-17 02:01:23,189 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/.tmp/data/default/testWithMapReduce/3e671049091ae20efb4f185e13c8e87d 2023-02-17 02:01:23,189 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/.tmp/data/default/testWithMapReduce/6014956a2b3f63abad8cd3b17629b80c 2023-02-17 02:01:23,190 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/.tmp/data/default/testWithMapReduce/0ac77707fded7da956ea2eaff472f1e5 2023-02-17 02:01:23,190 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/.tmp/data/default/testWithMapReduce/6fd84418026599548312cefaa7aa3bbe empty. 2023-02-17 02:01:23,190 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/.tmp/data/default/testWithMapReduce/2320e8050ac479d9cc2f8e39be1d5e17 empty. 2023-02-17 02:01:23,190 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/.tmp/data/default/testWithMapReduce/d0c39439e95718da09586626dbdd1981 empty. 2023-02-17 02:01:23,190 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/.tmp/data/default/testWithMapReduce/0ac77707fded7da956ea2eaff472f1e5 empty. 2023-02-17 02:01:23,190 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/.tmp/data/default/testWithMapReduce/6fd84418026599548312cefaa7aa3bbe 2023-02-17 02:01:23,190 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/.tmp/data/default/testWithMapReduce/c087f3b958f194282116d4bdcb846998 2023-02-17 02:01:23,191 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/.tmp/data/default/testWithMapReduce/2700e21ceee9ee6242041ee38fc8cdfa empty. 2023-02-17 02:01:23,191 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/.tmp/data/default/testWithMapReduce/d0c39439e95718da09586626dbdd1981 2023-02-17 02:01:23,190 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/.tmp/data/default/testWithMapReduce/2320e8050ac479d9cc2f8e39be1d5e17 2023-02-17 02:01:23,191 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/.tmp/data/default/testWithMapReduce/5b902d43bfac9401fc39fb36d68d8226 2023-02-17 02:01:23,191 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/.tmp/data/default/testWithMapReduce/6014956a2b3f63abad8cd3b17629b80c empty. 2023-02-17 02:01:23,191 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/.tmp/data/default/testWithMapReduce/3e671049091ae20efb4f185e13c8e87d empty. 2023-02-17 02:01:23,191 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/.tmp/data/default/testWithMapReduce/76fb71705f76672ea40ce0d3b7341303 empty. 2023-02-17 02:01:23,191 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/.tmp/data/default/testWithMapReduce/c087f3b958f194282116d4bdcb846998 empty. 2023-02-17 02:01:23,191 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/.tmp/data/default/testWithMapReduce/2700e21ceee9ee6242041ee38fc8cdfa 2023-02-17 02:01:23,192 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/.tmp/data/default/testWithMapReduce/0ac77707fded7da956ea2eaff472f1e5 2023-02-17 02:01:23,192 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/.tmp/data/default/testWithMapReduce/5b902d43bfac9401fc39fb36d68d8226 empty. 2023-02-17 02:01:23,192 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/.tmp/data/default/testWithMapReduce/c087f3b958f194282116d4bdcb846998 2023-02-17 02:01:23,192 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/.tmp/data/default/testWithMapReduce/3e671049091ae20efb4f185e13c8e87d 2023-02-17 02:01:23,192 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/.tmp/data/default/testWithMapReduce/76fb71705f76672ea40ce0d3b7341303 2023-02-17 02:01:23,192 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/.tmp/data/default/testWithMapReduce/6014956a2b3f63abad8cd3b17629b80c 2023-02-17 02:01:23,192 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/.tmp/data/default/testWithMapReduce/5b902d43bfac9401fc39fb36d68d8226 2023-02-17 02:01:23,192 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-17 02:01:23,203 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-17 02:01:23,205 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => d0c39439e95718da09586626dbdd1981, NAME => 'testWithMapReduce,d\x84\x84,1676599283172.d0c39439e95718da09586626dbdd1981.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/.tmp 2023-02-17 02:01:23,206 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 6fd84418026599548312cefaa7aa3bbe, NAME => 'testWithMapReduce,,1676599283172.6fd84418026599548312cefaa7aa3bbe.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/.tmp 2023-02-17 02:01:23,206 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 76fb71705f76672ea40ce0d3b7341303, NAME => 'testWithMapReduce,aaa,1676599283172.76fb71705f76672ea40ce0d3b7341303.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/.tmp 2023-02-17 02:01:23,233 INFO [RS:1;jenkins-hbase4:37987] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37987%2C1676599281907, suffix=, logDir=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/WALs/jenkins-hbase4.apache.org,37987,1676599281907, archiveDir=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/oldWALs, maxLogs=32 2023-02-17 02:01:23,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36043] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 02:01:23,290 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41363,DS-2cf1e9d8-a66f-48d9-97b4-ab85b7c5cd21,DISK] 2023-02-17 02:01:23,290 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40969,DS-faad23f7-05c5-4975-a5fd-86be57dbbf30,DISK] 2023-02-17 02:01:23,293 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676599283172.6fd84418026599548312cefaa7aa3bbe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:23,293 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 6fd84418026599548312cefaa7aa3bbe, disabling compactions & flushes 2023-02-17 02:01:23,293 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676599283172.6fd84418026599548312cefaa7aa3bbe. 2023-02-17 02:01:23,293 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676599283172.6fd84418026599548312cefaa7aa3bbe. 2023-02-17 02:01:23,293 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676599283172.6fd84418026599548312cefaa7aa3bbe. after waiting 0 ms 2023-02-17 02:01:23,293 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676599283172.6fd84418026599548312cefaa7aa3bbe. 2023-02-17 02:01:23,293 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676599283172.6fd84418026599548312cefaa7aa3bbe. 2023-02-17 02:01:23,293 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 6fd84418026599548312cefaa7aa3bbe: 2023-02-17 02:01:23,293 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676599283172.76fb71705f76672ea40ce0d3b7341303.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:23,294 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 76fb71705f76672ea40ce0d3b7341303, disabling compactions & flushes 2023-02-17 02:01:23,294 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 2700e21ceee9ee6242041ee38fc8cdfa, NAME => 'testWithMapReduce,g\xA7\xA7,1676599283172.2700e21ceee9ee6242041ee38fc8cdfa.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/.tmp 2023-02-17 02:01:23,294 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676599283172.76fb71705f76672ea40ce0d3b7341303. 2023-02-17 02:01:23,294 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676599283172.76fb71705f76672ea40ce0d3b7341303. 2023-02-17 02:01:23,294 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676599283172.76fb71705f76672ea40ce0d3b7341303. after waiting 0 ms 2023-02-17 02:01:23,294 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676599283172.76fb71705f76672ea40ce0d3b7341303. 2023-02-17 02:01:23,294 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676599283172.76fb71705f76672ea40ce0d3b7341303. 2023-02-17 02:01:23,294 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 76fb71705f76672ea40ce0d3b7341303: 2023-02-17 02:01:23,295 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 2320e8050ac479d9cc2f8e39be1d5e17, NAME => 'testWithMapReduce,j\xCA\xCA,1676599283172.2320e8050ac479d9cc2f8e39be1d5e17.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/.tmp 2023-02-17 02:01:23,295 INFO [RS:1;jenkins-hbase4:37987] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/WALs/jenkins-hbase4.apache.org,37987,1676599281907/jenkins-hbase4.apache.org%2C37987%2C1676599281907.1676599283234 2023-02-17 02:01:23,295 DEBUG [RS:1;jenkins-hbase4:37987] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40969,DS-faad23f7-05c5-4975-a5fd-86be57dbbf30,DISK], DatanodeInfoWithStorage[127.0.0.1:41363,DS-2cf1e9d8-a66f-48d9-97b4-ab85b7c5cd21,DISK]] 2023-02-17 02:01:23,295 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676599283172.d0c39439e95718da09586626dbdd1981.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:23,295 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing d0c39439e95718da09586626dbdd1981, disabling compactions & flushes 2023-02-17 02:01:23,295 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676599283172.d0c39439e95718da09586626dbdd1981. 2023-02-17 02:01:23,295 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676599283172.d0c39439e95718da09586626dbdd1981. 2023-02-17 02:01:23,296 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676599283172.d0c39439e95718da09586626dbdd1981. after waiting 0 ms 2023-02-17 02:01:23,296 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676599283172.d0c39439e95718da09586626dbdd1981. 2023-02-17 02:01:23,296 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676599283172.d0c39439e95718da09586626dbdd1981. 2023-02-17 02:01:23,296 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for d0c39439e95718da09586626dbdd1981: 2023-02-17 02:01:23,296 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 3e671049091ae20efb4f185e13c8e87d, NAME => 'testWithMapReduce,m\xED\xED,1676599283172.3e671049091ae20efb4f185e13c8e87d.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/.tmp 2023-02-17 02:01:23,307 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676599283172.2700e21ceee9ee6242041ee38fc8cdfa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:23,307 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 2700e21ceee9ee6242041ee38fc8cdfa, disabling compactions & flushes 2023-02-17 02:01:23,307 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676599283172.2700e21ceee9ee6242041ee38fc8cdfa. 2023-02-17 02:01:23,307 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676599283172.2700e21ceee9ee6242041ee38fc8cdfa. 2023-02-17 02:01:23,308 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676599283172.2700e21ceee9ee6242041ee38fc8cdfa. after waiting 0 ms 2023-02-17 02:01:23,308 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676599283172.2700e21ceee9ee6242041ee38fc8cdfa. 2023-02-17 02:01:23,308 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676599283172.2700e21ceee9ee6242041ee38fc8cdfa. 2023-02-17 02:01:23,308 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 2700e21ceee9ee6242041ee38fc8cdfa: 2023-02-17 02:01:23,308 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 6014956a2b3f63abad8cd3b17629b80c, NAME => 'testWithMapReduce,q\x11\x10,1676599283172.6014956a2b3f63abad8cd3b17629b80c.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/.tmp 2023-02-17 02:01:23,309 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676599283172.2320e8050ac479d9cc2f8e39be1d5e17.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:23,309 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 2320e8050ac479d9cc2f8e39be1d5e17, disabling compactions & flushes 2023-02-17 02:01:23,309 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676599283172.2320e8050ac479d9cc2f8e39be1d5e17. 2023-02-17 02:01:23,309 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676599283172.2320e8050ac479d9cc2f8e39be1d5e17. 2023-02-17 02:01:23,309 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676599283172.2320e8050ac479d9cc2f8e39be1d5e17. after waiting 0 ms 2023-02-17 02:01:23,309 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676599283172.2320e8050ac479d9cc2f8e39be1d5e17. 2023-02-17 02:01:23,309 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676599283172.2320e8050ac479d9cc2f8e39be1d5e17. 2023-02-17 02:01:23,309 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 2320e8050ac479d9cc2f8e39be1d5e17: 2023-02-17 02:01:23,309 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 0ac77707fded7da956ea2eaff472f1e5, NAME => 'testWithMapReduce,t43,1676599283172.0ac77707fded7da956ea2eaff472f1e5.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/.tmp 2023-02-17 02:01:23,312 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676599283172.3e671049091ae20efb4f185e13c8e87d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:23,313 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 3e671049091ae20efb4f185e13c8e87d, disabling compactions & flushes 2023-02-17 02:01:23,313 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676599283172.3e671049091ae20efb4f185e13c8e87d. 2023-02-17 02:01:23,313 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676599283172.3e671049091ae20efb4f185e13c8e87d. 2023-02-17 02:01:23,313 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676599283172.3e671049091ae20efb4f185e13c8e87d. after waiting 0 ms 2023-02-17 02:01:23,313 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676599283172.3e671049091ae20efb4f185e13c8e87d. 2023-02-17 02:01:23,313 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676599283172.3e671049091ae20efb4f185e13c8e87d. 2023-02-17 02:01:23,313 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 3e671049091ae20efb4f185e13c8e87d: 2023-02-17 02:01:23,313 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => c087f3b958f194282116d4bdcb846998, NAME => 'testWithMapReduce,wWV,1676599283172.c087f3b958f194282116d4bdcb846998.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/.tmp 2023-02-17 02:01:23,323 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676599283172.6014956a2b3f63abad8cd3b17629b80c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:23,323 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 6014956a2b3f63abad8cd3b17629b80c, disabling compactions & flushes 2023-02-17 02:01:23,323 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676599283172.6014956a2b3f63abad8cd3b17629b80c. 2023-02-17 02:01:23,323 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676599283172.6014956a2b3f63abad8cd3b17629b80c. 2023-02-17 02:01:23,323 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676599283172.6014956a2b3f63abad8cd3b17629b80c. after waiting 0 ms 2023-02-17 02:01:23,323 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676599283172.6014956a2b3f63abad8cd3b17629b80c. 2023-02-17 02:01:23,324 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676599283172.6014956a2b3f63abad8cd3b17629b80c. 2023-02-17 02:01:23,324 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 6014956a2b3f63abad8cd3b17629b80c: 2023-02-17 02:01:23,324 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 5b902d43bfac9401fc39fb36d68d8226, NAME => 'testWithMapReduce,zz{,1676599283172.5b902d43bfac9401fc39fb36d68d8226.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/.tmp 2023-02-17 02:01:23,328 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676599283172.0ac77707fded7da956ea2eaff472f1e5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:23,328 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 0ac77707fded7da956ea2eaff472f1e5, disabling compactions & flushes 2023-02-17 02:01:23,328 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676599283172.0ac77707fded7da956ea2eaff472f1e5. 2023-02-17 02:01:23,328 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676599283172.0ac77707fded7da956ea2eaff472f1e5. 2023-02-17 02:01:23,328 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676599283172.0ac77707fded7da956ea2eaff472f1e5. after waiting 0 ms 2023-02-17 02:01:23,328 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676599283172.0ac77707fded7da956ea2eaff472f1e5. 2023-02-17 02:01:23,328 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676599283172.0ac77707fded7da956ea2eaff472f1e5. 2023-02-17 02:01:23,329 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 0ac77707fded7da956ea2eaff472f1e5: 2023-02-17 02:01:23,329 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676599283172.c087f3b958f194282116d4bdcb846998.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:23,329 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing c087f3b958f194282116d4bdcb846998, disabling compactions & flushes 2023-02-17 02:01:23,329 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676599283172.c087f3b958f194282116d4bdcb846998. 2023-02-17 02:01:23,329 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676599283172.c087f3b958f194282116d4bdcb846998. 2023-02-17 02:01:23,329 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676599283172.c087f3b958f194282116d4bdcb846998. after waiting 0 ms 2023-02-17 02:01:23,329 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676599283172.c087f3b958f194282116d4bdcb846998. 2023-02-17 02:01:23,329 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676599283172.c087f3b958f194282116d4bdcb846998. 2023-02-17 02:01:23,329 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for c087f3b958f194282116d4bdcb846998: 2023-02-17 02:01:23,334 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676599283172.5b902d43bfac9401fc39fb36d68d8226.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:23,334 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 5b902d43bfac9401fc39fb36d68d8226, disabling compactions & flushes 2023-02-17 02:01:23,334 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676599283172.5b902d43bfac9401fc39fb36d68d8226. 2023-02-17 02:01:23,334 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676599283172.5b902d43bfac9401fc39fb36d68d8226. 2023-02-17 02:01:23,334 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676599283172.5b902d43bfac9401fc39fb36d68d8226. after waiting 0 ms 2023-02-17 02:01:23,334 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676599283172.5b902d43bfac9401fc39fb36d68d8226. 2023-02-17 02:01:23,334 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676599283172.5b902d43bfac9401fc39fb36d68d8226. 2023-02-17 02:01:23,334 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 5b902d43bfac9401fc39fb36d68d8226: 2023-02-17 02:01:23,337 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-17 02:01:23,338 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676599283172.6fd84418026599548312cefaa7aa3bbe.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676599283338"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676599283338"}]},"ts":"1676599283338"} 2023-02-17 02:01:23,338 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676599283172.76fb71705f76672ea40ce0d3b7341303.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676599283338"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676599283338"}]},"ts":"1676599283338"} 2023-02-17 02:01:23,338 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676599283172.d0c39439e95718da09586626dbdd1981.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676599283338"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676599283338"}]},"ts":"1676599283338"} 2023-02-17 02:01:23,339 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676599283172.2700e21ceee9ee6242041ee38fc8cdfa.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676599283338"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676599283338"}]},"ts":"1676599283338"} 2023-02-17 02:01:23,339 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676599283172.2320e8050ac479d9cc2f8e39be1d5e17.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676599283338"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676599283338"}]},"ts":"1676599283338"} 2023-02-17 02:01:23,339 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676599283172.3e671049091ae20efb4f185e13c8e87d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676599283338"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676599283338"}]},"ts":"1676599283338"} 2023-02-17 02:01:23,339 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676599283172.6014956a2b3f63abad8cd3b17629b80c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676599283338"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676599283338"}]},"ts":"1676599283338"} 2023-02-17 02:01:23,339 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676599283172.0ac77707fded7da956ea2eaff472f1e5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676599283338"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676599283338"}]},"ts":"1676599283338"} 2023-02-17 02:01:23,339 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676599283172.c087f3b958f194282116d4bdcb846998.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676599283338"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676599283338"}]},"ts":"1676599283338"} 2023-02-17 02:01:23,339 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676599283172.5b902d43bfac9401fc39fb36d68d8226.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676599283338"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676599283338"}]},"ts":"1676599283338"} 2023-02-17 02:01:23,345 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-17 02:01:23,346 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-17 02:01:23,346 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676599283346"}]},"ts":"1676599283346"} 2023-02-17 02:01:23,348 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-17 02:01:23,351 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-17 02:01:23,359 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-17 02:01:23,359 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-17 02:01:23,359 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-17 02:01:23,359 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=6fd84418026599548312cefaa7aa3bbe, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=76fb71705f76672ea40ce0d3b7341303, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=d0c39439e95718da09586626dbdd1981, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=2700e21ceee9ee6242041ee38fc8cdfa, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=2320e8050ac479d9cc2f8e39be1d5e17, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=3e671049091ae20efb4f185e13c8e87d, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=6014956a2b3f63abad8cd3b17629b80c, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=0ac77707fded7da956ea2eaff472f1e5, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=c087f3b958f194282116d4bdcb846998, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=5b902d43bfac9401fc39fb36d68d8226, ASSIGN}] 2023-02-17 02:01:23,362 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=2700e21ceee9ee6242041ee38fc8cdfa, ASSIGN 2023-02-17 02:01:23,362 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=76fb71705f76672ea40ce0d3b7341303, ASSIGN 2023-02-17 02:01:23,362 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=d0c39439e95718da09586626dbdd1981, ASSIGN 2023-02-17 02:01:23,362 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=6fd84418026599548312cefaa7aa3bbe, ASSIGN 2023-02-17 02:01:23,363 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=2700e21ceee9ee6242041ee38fc8cdfa, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37987,1676599281907; forceNewPlan=false, retain=false 2023-02-17 02:01:23,363 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=76fb71705f76672ea40ce0d3b7341303, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37987,1676599281907; forceNewPlan=false, retain=false 2023-02-17 02:01:23,363 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=d0c39439e95718da09586626dbdd1981, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42015,1676599281872; forceNewPlan=false, retain=false 2023-02-17 02:01:23,364 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=6fd84418026599548312cefaa7aa3bbe, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42015,1676599281872; forceNewPlan=false, retain=false 2023-02-17 02:01:23,364 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=5b902d43bfac9401fc39fb36d68d8226, ASSIGN 2023-02-17 02:01:23,365 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=c087f3b958f194282116d4bdcb846998, ASSIGN 2023-02-17 02:01:23,365 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=6014956a2b3f63abad8cd3b17629b80c, ASSIGN 2023-02-17 02:01:23,365 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=0ac77707fded7da956ea2eaff472f1e5, ASSIGN 2023-02-17 02:01:23,365 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=3e671049091ae20efb4f185e13c8e87d, ASSIGN 2023-02-17 02:01:23,366 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=5b902d43bfac9401fc39fb36d68d8226, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37987,1676599281907; forceNewPlan=false, retain=false 2023-02-17 02:01:23,366 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=c087f3b958f194282116d4bdcb846998, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42015,1676599281872; forceNewPlan=false, retain=false 2023-02-17 02:01:23,366 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=6014956a2b3f63abad8cd3b17629b80c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42015,1676599281872; forceNewPlan=false, retain=false 2023-02-17 02:01:23,367 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=0ac77707fded7da956ea2eaff472f1e5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37987,1676599281907; forceNewPlan=false, retain=false 2023-02-17 02:01:23,367 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=2320e8050ac479d9cc2f8e39be1d5e17, ASSIGN 2023-02-17 02:01:23,367 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=3e671049091ae20efb4f185e13c8e87d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37987,1676599281907; forceNewPlan=false, retain=false 2023-02-17 02:01:23,368 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=2320e8050ac479d9cc2f8e39be1d5e17, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42015,1676599281872; forceNewPlan=false, retain=false 2023-02-17 02:01:23,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36043] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 02:01:23,513 INFO [jenkins-hbase4:36043] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-17 02:01:23,517 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=6014956a2b3f63abad8cd3b17629b80c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42015,1676599281872 2023-02-17 02:01:23,517 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=6fd84418026599548312cefaa7aa3bbe, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42015,1676599281872 2023-02-17 02:01:23,518 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676599283172.6014956a2b3f63abad8cd3b17629b80c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676599283517"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676599283517"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676599283517"}]},"ts":"1676599283517"} 2023-02-17 02:01:23,517 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=2320e8050ac479d9cc2f8e39be1d5e17, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42015,1676599281872 2023-02-17 02:01:23,517 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=c087f3b958f194282116d4bdcb846998, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42015,1676599281872 2023-02-17 02:01:23,517 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=d0c39439e95718da09586626dbdd1981, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42015,1676599281872 2023-02-17 02:01:23,518 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676599283172.c087f3b958f194282116d4bdcb846998.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676599283517"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676599283517"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676599283517"}]},"ts":"1676599283517"} 2023-02-17 02:01:23,518 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676599283172.2320e8050ac479d9cc2f8e39be1d5e17.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676599283517"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676599283517"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676599283517"}]},"ts":"1676599283517"} 2023-02-17 02:01:23,518 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676599283172.6fd84418026599548312cefaa7aa3bbe.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676599283517"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676599283517"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676599283517"}]},"ts":"1676599283517"} 2023-02-17 02:01:23,518 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676599283172.d0c39439e95718da09586626dbdd1981.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676599283517"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676599283517"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676599283517"}]},"ts":"1676599283517"} 2023-02-17 02:01:23,520 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=17, state=RUNNABLE; OpenRegionProcedure 6014956a2b3f63abad8cd3b17629b80c, server=jenkins-hbase4.apache.org,42015,1676599281872}] 2023-02-17 02:01:23,521 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=19, state=RUNNABLE; OpenRegionProcedure c087f3b958f194282116d4bdcb846998, server=jenkins-hbase4.apache.org,42015,1676599281872}] 2023-02-17 02:01:23,522 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=15, state=RUNNABLE; OpenRegionProcedure 2320e8050ac479d9cc2f8e39be1d5e17, server=jenkins-hbase4.apache.org,42015,1676599281872}] 2023-02-17 02:01:23,524 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=11, state=RUNNABLE; OpenRegionProcedure 6fd84418026599548312cefaa7aa3bbe, server=jenkins-hbase4.apache.org,42015,1676599281872}] 2023-02-17 02:01:23,524 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=2700e21ceee9ee6242041ee38fc8cdfa, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37987,1676599281907 2023-02-17 02:01:23,525 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676599283172.2700e21ceee9ee6242041ee38fc8cdfa.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676599283524"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676599283524"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676599283524"}]},"ts":"1676599283524"} 2023-02-17 02:01:23,526 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=3e671049091ae20efb4f185e13c8e87d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37987,1676599281907 2023-02-17 02:01:23,527 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676599283172.3e671049091ae20efb4f185e13c8e87d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676599283526"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676599283526"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676599283526"}]},"ts":"1676599283526"} 2023-02-17 02:01:23,527 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=13, state=RUNNABLE; OpenRegionProcedure d0c39439e95718da09586626dbdd1981, server=jenkins-hbase4.apache.org,42015,1676599281872}] 2023-02-17 02:01:23,528 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=5b902d43bfac9401fc39fb36d68d8226, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37987,1676599281907 2023-02-17 02:01:23,529 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676599283172.5b902d43bfac9401fc39fb36d68d8226.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676599283528"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676599283528"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676599283528"}]},"ts":"1676599283528"} 2023-02-17 02:01:23,531 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=14, state=RUNNABLE; OpenRegionProcedure 2700e21ceee9ee6242041ee38fc8cdfa, server=jenkins-hbase4.apache.org,37987,1676599281907}] 2023-02-17 02:01:23,533 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=0ac77707fded7da956ea2eaff472f1e5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37987,1676599281907 2023-02-17 02:01:23,533 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676599283172.0ac77707fded7da956ea2eaff472f1e5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676599283533"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676599283533"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676599283533"}]},"ts":"1676599283533"} 2023-02-17 02:01:23,535 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=76fb71705f76672ea40ce0d3b7341303, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37987,1676599281907 2023-02-17 02:01:23,535 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=16, state=RUNNABLE; OpenRegionProcedure 3e671049091ae20efb4f185e13c8e87d, server=jenkins-hbase4.apache.org,37987,1676599281907}] 2023-02-17 02:01:23,535 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676599283172.76fb71705f76672ea40ce0d3b7341303.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676599283535"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676599283535"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676599283535"}]},"ts":"1676599283535"} 2023-02-17 02:01:23,536 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=20, state=RUNNABLE; OpenRegionProcedure 5b902d43bfac9401fc39fb36d68d8226, server=jenkins-hbase4.apache.org,37987,1676599281907}] 2023-02-17 02:01:23,537 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=18, state=RUNNABLE; OpenRegionProcedure 0ac77707fded7da956ea2eaff472f1e5, server=jenkins-hbase4.apache.org,37987,1676599281907}] 2023-02-17 02:01:23,539 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=12, state=RUNNABLE; OpenRegionProcedure 76fb71705f76672ea40ce0d3b7341303, server=jenkins-hbase4.apache.org,37987,1676599281907}] 2023-02-17 02:01:23,676 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1676599283172.d0c39439e95718da09586626dbdd1981. 2023-02-17 02:01:23,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d0c39439e95718da09586626dbdd1981, NAME => 'testWithMapReduce,d\x84\x84,1676599283172.d0c39439e95718da09586626dbdd1981.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-17 02:01:23,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce d0c39439e95718da09586626dbdd1981 2023-02-17 02:01:23,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676599283172.d0c39439e95718da09586626dbdd1981.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:23,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for d0c39439e95718da09586626dbdd1981 2023-02-17 02:01:23,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for d0c39439e95718da09586626dbdd1981 2023-02-17 02:01:23,678 INFO [StoreOpener-d0c39439e95718da09586626dbdd1981-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d0c39439e95718da09586626dbdd1981 2023-02-17 02:01:23,680 DEBUG [StoreOpener-d0c39439e95718da09586626dbdd1981-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/d0c39439e95718da09586626dbdd1981/f1 2023-02-17 02:01:23,680 DEBUG [StoreOpener-d0c39439e95718da09586626dbdd1981-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/d0c39439e95718da09586626dbdd1981/f1 2023-02-17 02:01:23,680 INFO [StoreOpener-d0c39439e95718da09586626dbdd1981-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d0c39439e95718da09586626dbdd1981 columnFamilyName f1 2023-02-17 02:01:23,681 INFO [StoreOpener-d0c39439e95718da09586626dbdd1981-1] regionserver.HStore(310): Store=d0c39439e95718da09586626dbdd1981/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:23,681 INFO [StoreOpener-d0c39439e95718da09586626dbdd1981-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d0c39439e95718da09586626dbdd1981 2023-02-17 02:01:23,682 DEBUG [StoreOpener-d0c39439e95718da09586626dbdd1981-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/d0c39439e95718da09586626dbdd1981/f2 2023-02-17 02:01:23,682 DEBUG [StoreOpener-d0c39439e95718da09586626dbdd1981-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/d0c39439e95718da09586626dbdd1981/f2 2023-02-17 02:01:23,683 INFO [StoreOpener-d0c39439e95718da09586626dbdd1981-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d0c39439e95718da09586626dbdd1981 columnFamilyName f2 2023-02-17 02:01:23,683 INFO [StoreOpener-d0c39439e95718da09586626dbdd1981-1] regionserver.HStore(310): Store=d0c39439e95718da09586626dbdd1981/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:23,684 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,37987,1676599281907 2023-02-17 02:01:23,684 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/d0c39439e95718da09586626dbdd1981 2023-02-17 02:01:23,684 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-17 02:01:23,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/d0c39439e95718da09586626dbdd1981 2023-02-17 02:01:23,688 INFO [RS-EventLoopGroup-8-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57348, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-17 02:01:23,689 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 02:01:23,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for d0c39439e95718da09586626dbdd1981 2023-02-17 02:01:23,691 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1676599283172.0ac77707fded7da956ea2eaff472f1e5. 2023-02-17 02:01:23,691 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 0ac77707fded7da956ea2eaff472f1e5, NAME => 'testWithMapReduce,t43,1676599283172.0ac77707fded7da956ea2eaff472f1e5.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-17 02:01:23,692 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 0ac77707fded7da956ea2eaff472f1e5 2023-02-17 02:01:23,692 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676599283172.0ac77707fded7da956ea2eaff472f1e5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:23,692 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 0ac77707fded7da956ea2eaff472f1e5 2023-02-17 02:01:23,692 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 0ac77707fded7da956ea2eaff472f1e5 2023-02-17 02:01:23,693 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/d0c39439e95718da09586626dbdd1981/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 02:01:23,694 INFO [StoreOpener-0ac77707fded7da956ea2eaff472f1e5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0ac77707fded7da956ea2eaff472f1e5 2023-02-17 02:01:23,694 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened d0c39439e95718da09586626dbdd1981; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74648787, jitterRate=0.1123536080121994}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 02:01:23,694 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for d0c39439e95718da09586626dbdd1981: 2023-02-17 02:01:23,695 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1676599283172.d0c39439e95718da09586626dbdd1981., pid=25, masterSystemTime=1676599283672 2023-02-17 02:01:23,695 DEBUG [StoreOpener-0ac77707fded7da956ea2eaff472f1e5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/0ac77707fded7da956ea2eaff472f1e5/f1 2023-02-17 02:01:23,695 DEBUG [StoreOpener-0ac77707fded7da956ea2eaff472f1e5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/0ac77707fded7da956ea2eaff472f1e5/f1 2023-02-17 02:01:23,695 INFO [StoreOpener-0ac77707fded7da956ea2eaff472f1e5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0ac77707fded7da956ea2eaff472f1e5 columnFamilyName f1 2023-02-17 02:01:23,696 INFO [StoreOpener-0ac77707fded7da956ea2eaff472f1e5-1] regionserver.HStore(310): Store=0ac77707fded7da956ea2eaff472f1e5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:23,696 INFO [StoreOpener-0ac77707fded7da956ea2eaff472f1e5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0ac77707fded7da956ea2eaff472f1e5 2023-02-17 02:01:23,697 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1676599283172.d0c39439e95718da09586626dbdd1981. 2023-02-17 02:01:23,697 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1676599283172.d0c39439e95718da09586626dbdd1981. 2023-02-17 02:01:23,697 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1676599283172.c087f3b958f194282116d4bdcb846998. 2023-02-17 02:01:23,697 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=d0c39439e95718da09586626dbdd1981, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42015,1676599281872 2023-02-17 02:01:23,697 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c087f3b958f194282116d4bdcb846998, NAME => 'testWithMapReduce,wWV,1676599283172.c087f3b958f194282116d4bdcb846998.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-17 02:01:23,697 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1676599283172.d0c39439e95718da09586626dbdd1981.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676599283697"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676599283697"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676599283697"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676599283697"}]},"ts":"1676599283697"} 2023-02-17 02:01:23,697 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce c087f3b958f194282116d4bdcb846998 2023-02-17 02:01:23,697 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676599283172.c087f3b958f194282116d4bdcb846998.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:23,697 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for c087f3b958f194282116d4bdcb846998 2023-02-17 02:01:23,697 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for c087f3b958f194282116d4bdcb846998 2023-02-17 02:01:23,698 DEBUG [StoreOpener-0ac77707fded7da956ea2eaff472f1e5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/0ac77707fded7da956ea2eaff472f1e5/f2 2023-02-17 02:01:23,698 DEBUG [StoreOpener-0ac77707fded7da956ea2eaff472f1e5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/0ac77707fded7da956ea2eaff472f1e5/f2 2023-02-17 02:01:23,698 INFO [StoreOpener-0ac77707fded7da956ea2eaff472f1e5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0ac77707fded7da956ea2eaff472f1e5 columnFamilyName f2 2023-02-17 02:01:23,699 INFO [StoreOpener-c087f3b958f194282116d4bdcb846998-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c087f3b958f194282116d4bdcb846998 2023-02-17 02:01:23,699 INFO [StoreOpener-0ac77707fded7da956ea2eaff472f1e5-1] regionserver.HStore(310): Store=0ac77707fded7da956ea2eaff472f1e5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:23,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/0ac77707fded7da956ea2eaff472f1e5 2023-02-17 02:01:23,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/0ac77707fded7da956ea2eaff472f1e5 2023-02-17 02:01:23,700 DEBUG [StoreOpener-c087f3b958f194282116d4bdcb846998-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/c087f3b958f194282116d4bdcb846998/f1 2023-02-17 02:01:23,700 DEBUG [StoreOpener-c087f3b958f194282116d4bdcb846998-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/c087f3b958f194282116d4bdcb846998/f1 2023-02-17 02:01:23,701 INFO [StoreOpener-c087f3b958f194282116d4bdcb846998-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c087f3b958f194282116d4bdcb846998 columnFamilyName f1 2023-02-17 02:01:23,701 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=13 2023-02-17 02:01:23,701 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=13, state=SUCCESS; OpenRegionProcedure d0c39439e95718da09586626dbdd1981, server=jenkins-hbase4.apache.org,42015,1676599281872 in 172 msec 2023-02-17 02:01:23,702 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=d0c39439e95718da09586626dbdd1981, ASSIGN in 342 msec 2023-02-17 02:01:23,702 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 02:01:23,703 INFO [StoreOpener-c087f3b958f194282116d4bdcb846998-1] regionserver.HStore(310): Store=c087f3b958f194282116d4bdcb846998/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:23,703 INFO [StoreOpener-c087f3b958f194282116d4bdcb846998-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c087f3b958f194282116d4bdcb846998 2023-02-17 02:01:23,704 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 0ac77707fded7da956ea2eaff472f1e5 2023-02-17 02:01:23,704 DEBUG [StoreOpener-c087f3b958f194282116d4bdcb846998-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/c087f3b958f194282116d4bdcb846998/f2 2023-02-17 02:01:23,704 DEBUG [StoreOpener-c087f3b958f194282116d4bdcb846998-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/c087f3b958f194282116d4bdcb846998/f2 2023-02-17 02:01:23,705 INFO [StoreOpener-c087f3b958f194282116d4bdcb846998-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c087f3b958f194282116d4bdcb846998 columnFamilyName f2 2023-02-17 02:01:23,705 INFO [StoreOpener-c087f3b958f194282116d4bdcb846998-1] regionserver.HStore(310): Store=c087f3b958f194282116d4bdcb846998/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:23,707 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/c087f3b958f194282116d4bdcb846998 2023-02-17 02:01:23,707 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/0ac77707fded7da956ea2eaff472f1e5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 02:01:23,707 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/c087f3b958f194282116d4bdcb846998 2023-02-17 02:01:23,707 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 0ac77707fded7da956ea2eaff472f1e5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72863297, jitterRate=0.08574773371219635}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 02:01:23,707 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 0ac77707fded7da956ea2eaff472f1e5: 2023-02-17 02:01:23,708 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1676599283172.0ac77707fded7da956ea2eaff472f1e5., pid=29, masterSystemTime=1676599283684 2023-02-17 02:01:23,711 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 02:01:23,712 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1676599283172.0ac77707fded7da956ea2eaff472f1e5. 2023-02-17 02:01:23,712 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1676599283172.0ac77707fded7da956ea2eaff472f1e5. 2023-02-17 02:01:23,712 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1676599283172.5b902d43bfac9401fc39fb36d68d8226. 2023-02-17 02:01:23,712 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 5b902d43bfac9401fc39fb36d68d8226, NAME => 'testWithMapReduce,zz{,1676599283172.5b902d43bfac9401fc39fb36d68d8226.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-17 02:01:23,713 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=0ac77707fded7da956ea2eaff472f1e5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37987,1676599281907 2023-02-17 02:01:23,713 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 5b902d43bfac9401fc39fb36d68d8226 2023-02-17 02:01:23,713 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1676599283172.0ac77707fded7da956ea2eaff472f1e5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676599283712"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676599283712"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676599283712"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676599283712"}]},"ts":"1676599283712"} 2023-02-17 02:01:23,713 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676599283172.5b902d43bfac9401fc39fb36d68d8226.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:23,713 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for c087f3b958f194282116d4bdcb846998 2023-02-17 02:01:23,713 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 5b902d43bfac9401fc39fb36d68d8226 2023-02-17 02:01:23,713 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 5b902d43bfac9401fc39fb36d68d8226 2023-02-17 02:01:23,714 INFO [StoreOpener-5b902d43bfac9401fc39fb36d68d8226-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5b902d43bfac9401fc39fb36d68d8226 2023-02-17 02:01:23,715 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/c087f3b958f194282116d4bdcb846998/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 02:01:23,716 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened c087f3b958f194282116d4bdcb846998; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68877180, jitterRate=0.026349961757659912}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 02:01:23,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for c087f3b958f194282116d4bdcb846998: 2023-02-17 02:01:23,716 DEBUG [StoreOpener-5b902d43bfac9401fc39fb36d68d8226-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/5b902d43bfac9401fc39fb36d68d8226/f1 2023-02-17 02:01:23,716 DEBUG [StoreOpener-5b902d43bfac9401fc39fb36d68d8226-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/5b902d43bfac9401fc39fb36d68d8226/f1 2023-02-17 02:01:23,716 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=18 2023-02-17 02:01:23,716 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=18, state=SUCCESS; OpenRegionProcedure 0ac77707fded7da956ea2eaff472f1e5, server=jenkins-hbase4.apache.org,37987,1676599281907 in 177 msec 2023-02-17 02:01:23,717 INFO [StoreOpener-5b902d43bfac9401fc39fb36d68d8226-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5b902d43bfac9401fc39fb36d68d8226 columnFamilyName f1 2023-02-17 02:01:23,717 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1676599283172.c087f3b958f194282116d4bdcb846998., pid=22, masterSystemTime=1676599283672 2023-02-17 02:01:23,717 INFO [StoreOpener-5b902d43bfac9401fc39fb36d68d8226-1] regionserver.HStore(310): Store=5b902d43bfac9401fc39fb36d68d8226/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:23,718 INFO [StoreOpener-5b902d43bfac9401fc39fb36d68d8226-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5b902d43bfac9401fc39fb36d68d8226 2023-02-17 02:01:23,718 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=0ac77707fded7da956ea2eaff472f1e5, ASSIGN in 357 msec 2023-02-17 02:01:23,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1676599283172.c087f3b958f194282116d4bdcb846998. 2023-02-17 02:01:23,719 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1676599283172.c087f3b958f194282116d4bdcb846998. 2023-02-17 02:01:23,719 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1676599283172.2320e8050ac479d9cc2f8e39be1d5e17. 2023-02-17 02:01:23,719 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=c087f3b958f194282116d4bdcb846998, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42015,1676599281872 2023-02-17 02:01:23,719 DEBUG [StoreOpener-5b902d43bfac9401fc39fb36d68d8226-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/5b902d43bfac9401fc39fb36d68d8226/f2 2023-02-17 02:01:23,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 2320e8050ac479d9cc2f8e39be1d5e17, NAME => 'testWithMapReduce,j\xCA\xCA,1676599283172.2320e8050ac479d9cc2f8e39be1d5e17.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-17 02:01:23,719 DEBUG [StoreOpener-5b902d43bfac9401fc39fb36d68d8226-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/5b902d43bfac9401fc39fb36d68d8226/f2 2023-02-17 02:01:23,719 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1676599283172.c087f3b958f194282116d4bdcb846998.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676599283719"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676599283719"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676599283719"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676599283719"}]},"ts":"1676599283719"} 2023-02-17 02:01:23,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 2320e8050ac479d9cc2f8e39be1d5e17 2023-02-17 02:01:23,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676599283172.2320e8050ac479d9cc2f8e39be1d5e17.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:23,720 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 2320e8050ac479d9cc2f8e39be1d5e17 2023-02-17 02:01:23,720 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 2320e8050ac479d9cc2f8e39be1d5e17 2023-02-17 02:01:23,720 INFO [StoreOpener-5b902d43bfac9401fc39fb36d68d8226-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5b902d43bfac9401fc39fb36d68d8226 columnFamilyName f2 2023-02-17 02:01:23,720 INFO [StoreOpener-5b902d43bfac9401fc39fb36d68d8226-1] regionserver.HStore(310): Store=5b902d43bfac9401fc39fb36d68d8226/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:23,721 INFO [StoreOpener-2320e8050ac479d9cc2f8e39be1d5e17-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2320e8050ac479d9cc2f8e39be1d5e17 2023-02-17 02:01:23,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/5b902d43bfac9401fc39fb36d68d8226 2023-02-17 02:01:23,722 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/5b902d43bfac9401fc39fb36d68d8226 2023-02-17 02:01:23,722 DEBUG [StoreOpener-2320e8050ac479d9cc2f8e39be1d5e17-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/2320e8050ac479d9cc2f8e39be1d5e17/f1 2023-02-17 02:01:23,722 DEBUG [StoreOpener-2320e8050ac479d9cc2f8e39be1d5e17-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/2320e8050ac479d9cc2f8e39be1d5e17/f1 2023-02-17 02:01:23,723 INFO [StoreOpener-2320e8050ac479d9cc2f8e39be1d5e17-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2320e8050ac479d9cc2f8e39be1d5e17 columnFamilyName f1 2023-02-17 02:01:23,723 INFO [StoreOpener-2320e8050ac479d9cc2f8e39be1d5e17-1] regionserver.HStore(310): Store=2320e8050ac479d9cc2f8e39be1d5e17/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:23,724 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=19 2023-02-17 02:01:23,724 INFO [StoreOpener-2320e8050ac479d9cc2f8e39be1d5e17-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2320e8050ac479d9cc2f8e39be1d5e17 2023-02-17 02:01:23,724 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=19, state=SUCCESS; OpenRegionProcedure c087f3b958f194282116d4bdcb846998, server=jenkins-hbase4.apache.org,42015,1676599281872 in 200 msec 2023-02-17 02:01:23,724 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 02:01:23,725 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=c087f3b958f194282116d4bdcb846998, ASSIGN in 365 msec 2023-02-17 02:01:23,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 5b902d43bfac9401fc39fb36d68d8226 2023-02-17 02:01:23,727 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/5b902d43bfac9401fc39fb36d68d8226/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 02:01:23,728 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 5b902d43bfac9401fc39fb36d68d8226; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68927751, jitterRate=0.027103528380393982}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 02:01:23,728 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 5b902d43bfac9401fc39fb36d68d8226: 2023-02-17 02:01:23,728 DEBUG [StoreOpener-2320e8050ac479d9cc2f8e39be1d5e17-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/2320e8050ac479d9cc2f8e39be1d5e17/f2 2023-02-17 02:01:23,728 DEBUG [StoreOpener-2320e8050ac479d9cc2f8e39be1d5e17-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/2320e8050ac479d9cc2f8e39be1d5e17/f2 2023-02-17 02:01:23,729 INFO [StoreOpener-2320e8050ac479d9cc2f8e39be1d5e17-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2320e8050ac479d9cc2f8e39be1d5e17 columnFamilyName f2 2023-02-17 02:01:23,729 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1676599283172.5b902d43bfac9401fc39fb36d68d8226., pid=28, masterSystemTime=1676599283684 2023-02-17 02:01:23,729 INFO [StoreOpener-2320e8050ac479d9cc2f8e39be1d5e17-1] regionserver.HStore(310): Store=2320e8050ac479d9cc2f8e39be1d5e17/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:23,730 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/2320e8050ac479d9cc2f8e39be1d5e17 2023-02-17 02:01:23,730 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1676599283172.5b902d43bfac9401fc39fb36d68d8226. 2023-02-17 02:01:23,730 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1676599283172.5b902d43bfac9401fc39fb36d68d8226. 2023-02-17 02:01:23,730 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1676599283172.2700e21ceee9ee6242041ee38fc8cdfa. 2023-02-17 02:01:23,730 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/2320e8050ac479d9cc2f8e39be1d5e17 2023-02-17 02:01:23,731 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 2700e21ceee9ee6242041ee38fc8cdfa, NAME => 'testWithMapReduce,g\xA7\xA7,1676599283172.2700e21ceee9ee6242041ee38fc8cdfa.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-17 02:01:23,731 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 2700e21ceee9ee6242041ee38fc8cdfa 2023-02-17 02:01:23,731 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=5b902d43bfac9401fc39fb36d68d8226, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37987,1676599281907 2023-02-17 02:01:23,731 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676599283172.2700e21ceee9ee6242041ee38fc8cdfa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:23,731 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 2700e21ceee9ee6242041ee38fc8cdfa 2023-02-17 02:01:23,731 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1676599283172.5b902d43bfac9401fc39fb36d68d8226.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676599283731"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676599283731"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676599283731"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676599283731"}]},"ts":"1676599283731"} 2023-02-17 02:01:23,731 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 2700e21ceee9ee6242041ee38fc8cdfa 2023-02-17 02:01:23,733 INFO [StoreOpener-2700e21ceee9ee6242041ee38fc8cdfa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2700e21ceee9ee6242041ee38fc8cdfa 2023-02-17 02:01:23,733 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 02:01:23,734 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 2320e8050ac479d9cc2f8e39be1d5e17 2023-02-17 02:01:23,734 DEBUG [StoreOpener-2700e21ceee9ee6242041ee38fc8cdfa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/2700e21ceee9ee6242041ee38fc8cdfa/f1 2023-02-17 02:01:23,734 DEBUG [StoreOpener-2700e21ceee9ee6242041ee38fc8cdfa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/2700e21ceee9ee6242041ee38fc8cdfa/f1 2023-02-17 02:01:23,735 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=20 2023-02-17 02:01:23,735 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=20, state=SUCCESS; OpenRegionProcedure 5b902d43bfac9401fc39fb36d68d8226, server=jenkins-hbase4.apache.org,37987,1676599281907 in 197 msec 2023-02-17 02:01:23,735 INFO [StoreOpener-2700e21ceee9ee6242041ee38fc8cdfa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2700e21ceee9ee6242041ee38fc8cdfa columnFamilyName f1 2023-02-17 02:01:23,736 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=5b902d43bfac9401fc39fb36d68d8226, ASSIGN in 376 msec 2023-02-17 02:01:23,736 INFO [StoreOpener-2700e21ceee9ee6242041ee38fc8cdfa-1] regionserver.HStore(310): Store=2700e21ceee9ee6242041ee38fc8cdfa/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:23,736 INFO [StoreOpener-2700e21ceee9ee6242041ee38fc8cdfa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2700e21ceee9ee6242041ee38fc8cdfa 2023-02-17 02:01:23,737 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/2320e8050ac479d9cc2f8e39be1d5e17/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 02:01:23,737 DEBUG [StoreOpener-2700e21ceee9ee6242041ee38fc8cdfa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/2700e21ceee9ee6242041ee38fc8cdfa/f2 2023-02-17 02:01:23,737 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 2320e8050ac479d9cc2f8e39be1d5e17; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65585422, jitterRate=-0.02270105481147766}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 02:01:23,737 DEBUG [StoreOpener-2700e21ceee9ee6242041ee38fc8cdfa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/2700e21ceee9ee6242041ee38fc8cdfa/f2 2023-02-17 02:01:23,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 2320e8050ac479d9cc2f8e39be1d5e17: 2023-02-17 02:01:23,738 INFO [StoreOpener-2700e21ceee9ee6242041ee38fc8cdfa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2700e21ceee9ee6242041ee38fc8cdfa columnFamilyName f2 2023-02-17 02:01:23,738 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1676599283172.2320e8050ac479d9cc2f8e39be1d5e17., pid=23, masterSystemTime=1676599283672 2023-02-17 02:01:23,738 INFO [StoreOpener-2700e21ceee9ee6242041ee38fc8cdfa-1] regionserver.HStore(310): Store=2700e21ceee9ee6242041ee38fc8cdfa/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:23,739 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/2700e21ceee9ee6242041ee38fc8cdfa 2023-02-17 02:01:23,740 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/2700e21ceee9ee6242041ee38fc8cdfa 2023-02-17 02:01:23,740 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1676599283172.2320e8050ac479d9cc2f8e39be1d5e17. 2023-02-17 02:01:23,740 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1676599283172.2320e8050ac479d9cc2f8e39be1d5e17. 2023-02-17 02:01:23,740 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1676599283172.6014956a2b3f63abad8cd3b17629b80c. 2023-02-17 02:01:23,741 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 6014956a2b3f63abad8cd3b17629b80c, NAME => 'testWithMapReduce,q\x11\x10,1676599283172.6014956a2b3f63abad8cd3b17629b80c.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-17 02:01:23,741 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=2320e8050ac479d9cc2f8e39be1d5e17, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42015,1676599281872 2023-02-17 02:01:23,741 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1676599283172.2320e8050ac479d9cc2f8e39be1d5e17.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676599283741"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676599283741"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676599283741"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676599283741"}]},"ts":"1676599283741"} 2023-02-17 02:01:23,741 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 6014956a2b3f63abad8cd3b17629b80c 2023-02-17 02:01:23,741 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676599283172.6014956a2b3f63abad8cd3b17629b80c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:23,741 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 6014956a2b3f63abad8cd3b17629b80c 2023-02-17 02:01:23,741 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 6014956a2b3f63abad8cd3b17629b80c 2023-02-17 02:01:23,743 INFO [StoreOpener-6014956a2b3f63abad8cd3b17629b80c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 6014956a2b3f63abad8cd3b17629b80c 2023-02-17 02:01:23,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 02:01:23,745 DEBUG [StoreOpener-6014956a2b3f63abad8cd3b17629b80c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/6014956a2b3f63abad8cd3b17629b80c/f1 2023-02-17 02:01:23,745 DEBUG [StoreOpener-6014956a2b3f63abad8cd3b17629b80c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/6014956a2b3f63abad8cd3b17629b80c/f1 2023-02-17 02:01:23,745 INFO [StoreOpener-6014956a2b3f63abad8cd3b17629b80c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6014956a2b3f63abad8cd3b17629b80c columnFamilyName f1 2023-02-17 02:01:23,745 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=15 2023-02-17 02:01:23,745 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=15, state=SUCCESS; OpenRegionProcedure 2320e8050ac479d9cc2f8e39be1d5e17, server=jenkins-hbase4.apache.org,42015,1676599281872 in 221 msec 2023-02-17 02:01:23,746 INFO [StoreOpener-6014956a2b3f63abad8cd3b17629b80c-1] regionserver.HStore(310): Store=6014956a2b3f63abad8cd3b17629b80c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:23,746 INFO [StoreOpener-6014956a2b3f63abad8cd3b17629b80c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 6014956a2b3f63abad8cd3b17629b80c 2023-02-17 02:01:23,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 2700e21ceee9ee6242041ee38fc8cdfa 2023-02-17 02:01:23,747 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=2320e8050ac479d9cc2f8e39be1d5e17, ASSIGN in 386 msec 2023-02-17 02:01:23,748 DEBUG [StoreOpener-6014956a2b3f63abad8cd3b17629b80c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/6014956a2b3f63abad8cd3b17629b80c/f2 2023-02-17 02:01:23,748 DEBUG [StoreOpener-6014956a2b3f63abad8cd3b17629b80c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/6014956a2b3f63abad8cd3b17629b80c/f2 2023-02-17 02:01:23,748 INFO [StoreOpener-6014956a2b3f63abad8cd3b17629b80c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6014956a2b3f63abad8cd3b17629b80c columnFamilyName f2 2023-02-17 02:01:23,749 INFO [StoreOpener-6014956a2b3f63abad8cd3b17629b80c-1] regionserver.HStore(310): Store=6014956a2b3f63abad8cd3b17629b80c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:23,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/6014956a2b3f63abad8cd3b17629b80c 2023-02-17 02:01:23,753 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/6014956a2b3f63abad8cd3b17629b80c 2023-02-17 02:01:23,753 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/2700e21ceee9ee6242041ee38fc8cdfa/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 02:01:23,754 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 2700e21ceee9ee6242041ee38fc8cdfa; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74592693, jitterRate=0.11151774227619171}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 02:01:23,754 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 2700e21ceee9ee6242041ee38fc8cdfa: 2023-02-17 02:01:23,755 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1676599283172.2700e21ceee9ee6242041ee38fc8cdfa., pid=26, masterSystemTime=1676599283684 2023-02-17 02:01:23,756 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 02:01:23,757 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1676599283172.2700e21ceee9ee6242041ee38fc8cdfa. 2023-02-17 02:01:23,757 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1676599283172.2700e21ceee9ee6242041ee38fc8cdfa. 2023-02-17 02:01:23,757 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1676599283172.76fb71705f76672ea40ce0d3b7341303. 2023-02-17 02:01:23,757 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=2700e21ceee9ee6242041ee38fc8cdfa, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37987,1676599281907 2023-02-17 02:01:23,757 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 76fb71705f76672ea40ce0d3b7341303, NAME => 'testWithMapReduce,aaa,1676599283172.76fb71705f76672ea40ce0d3b7341303.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-17 02:01:23,758 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1676599283172.2700e21ceee9ee6242041ee38fc8cdfa.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676599283757"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676599283757"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676599283757"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676599283757"}]},"ts":"1676599283757"} 2023-02-17 02:01:23,758 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 76fb71705f76672ea40ce0d3b7341303 2023-02-17 02:01:23,758 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676599283172.76fb71705f76672ea40ce0d3b7341303.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:23,758 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 76fb71705f76672ea40ce0d3b7341303 2023-02-17 02:01:23,758 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 76fb71705f76672ea40ce0d3b7341303 2023-02-17 02:01:23,758 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 6014956a2b3f63abad8cd3b17629b80c 2023-02-17 02:01:23,774 INFO [StoreOpener-76fb71705f76672ea40ce0d3b7341303-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 76fb71705f76672ea40ce0d3b7341303 2023-02-17 02:01:23,776 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/6014956a2b3f63abad8cd3b17629b80c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 02:01:23,776 DEBUG [StoreOpener-76fb71705f76672ea40ce0d3b7341303-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/76fb71705f76672ea40ce0d3b7341303/f1 2023-02-17 02:01:23,777 DEBUG [StoreOpener-76fb71705f76672ea40ce0d3b7341303-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/76fb71705f76672ea40ce0d3b7341303/f1 2023-02-17 02:01:23,777 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 6014956a2b3f63abad8cd3b17629b80c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60150930, jitterRate=-0.1036812961101532}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 02:01:23,777 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 6014956a2b3f63abad8cd3b17629b80c: 2023-02-17 02:01:23,777 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=14 2023-02-17 02:01:23,777 INFO [StoreOpener-76fb71705f76672ea40ce0d3b7341303-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 76fb71705f76672ea40ce0d3b7341303 columnFamilyName f1 2023-02-17 02:01:23,777 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=14, state=SUCCESS; OpenRegionProcedure 2700e21ceee9ee6242041ee38fc8cdfa, server=jenkins-hbase4.apache.org,37987,1676599281907 in 245 msec 2023-02-17 02:01:23,778 INFO [StoreOpener-76fb71705f76672ea40ce0d3b7341303-1] regionserver.HStore(310): Store=76fb71705f76672ea40ce0d3b7341303/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:23,778 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1676599283172.6014956a2b3f63abad8cd3b17629b80c., pid=21, masterSystemTime=1676599283672 2023-02-17 02:01:23,778 INFO [StoreOpener-76fb71705f76672ea40ce0d3b7341303-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 76fb71705f76672ea40ce0d3b7341303 2023-02-17 02:01:23,780 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=2700e21ceee9ee6242041ee38fc8cdfa, ASSIGN in 418 msec 2023-02-17 02:01:23,780 DEBUG [StoreOpener-76fb71705f76672ea40ce0d3b7341303-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/76fb71705f76672ea40ce0d3b7341303/f2 2023-02-17 02:01:23,780 DEBUG [StoreOpener-76fb71705f76672ea40ce0d3b7341303-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/76fb71705f76672ea40ce0d3b7341303/f2 2023-02-17 02:01:23,780 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1676599283172.6014956a2b3f63abad8cd3b17629b80c. 2023-02-17 02:01:23,780 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1676599283172.6014956a2b3f63abad8cd3b17629b80c. 2023-02-17 02:01:23,780 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676599283172.6fd84418026599548312cefaa7aa3bbe. 2023-02-17 02:01:23,780 INFO [StoreOpener-76fb71705f76672ea40ce0d3b7341303-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 76fb71705f76672ea40ce0d3b7341303 columnFamilyName f2 2023-02-17 02:01:23,780 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 6fd84418026599548312cefaa7aa3bbe, NAME => 'testWithMapReduce,,1676599283172.6fd84418026599548312cefaa7aa3bbe.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-17 02:01:23,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 6fd84418026599548312cefaa7aa3bbe 2023-02-17 02:01:23,781 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=6014956a2b3f63abad8cd3b17629b80c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42015,1676599281872 2023-02-17 02:01:23,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676599283172.6fd84418026599548312cefaa7aa3bbe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:23,781 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1676599283172.6014956a2b3f63abad8cd3b17629b80c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676599283781"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676599283781"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676599283781"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676599283781"}]},"ts":"1676599283781"} 2023-02-17 02:01:23,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 6fd84418026599548312cefaa7aa3bbe 2023-02-17 02:01:23,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 6fd84418026599548312cefaa7aa3bbe 2023-02-17 02:01:23,781 INFO [StoreOpener-76fb71705f76672ea40ce0d3b7341303-1] regionserver.HStore(310): Store=76fb71705f76672ea40ce0d3b7341303/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:23,783 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/76fb71705f76672ea40ce0d3b7341303 2023-02-17 02:01:23,783 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/76fb71705f76672ea40ce0d3b7341303 2023-02-17 02:01:23,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36043] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 02:01:23,786 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=17 2023-02-17 02:01:23,786 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=17, state=SUCCESS; OpenRegionProcedure 6014956a2b3f63abad8cd3b17629b80c, server=jenkins-hbase4.apache.org,42015,1676599281872 in 263 msec 2023-02-17 02:01:23,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 02:01:23,787 INFO [StoreOpener-6fd84418026599548312cefaa7aa3bbe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 6fd84418026599548312cefaa7aa3bbe 2023-02-17 02:01:23,788 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=6014956a2b3f63abad8cd3b17629b80c, ASSIGN in 427 msec 2023-02-17 02:01:23,788 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 76fb71705f76672ea40ce0d3b7341303 2023-02-17 02:01:23,788 DEBUG [StoreOpener-6fd84418026599548312cefaa7aa3bbe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/6fd84418026599548312cefaa7aa3bbe/f1 2023-02-17 02:01:23,788 DEBUG [StoreOpener-6fd84418026599548312cefaa7aa3bbe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/6fd84418026599548312cefaa7aa3bbe/f1 2023-02-17 02:01:23,789 INFO [StoreOpener-6fd84418026599548312cefaa7aa3bbe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6fd84418026599548312cefaa7aa3bbe columnFamilyName f1 2023-02-17 02:01:23,789 INFO [StoreOpener-6fd84418026599548312cefaa7aa3bbe-1] regionserver.HStore(310): Store=6fd84418026599548312cefaa7aa3bbe/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:23,789 INFO [StoreOpener-6fd84418026599548312cefaa7aa3bbe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 6fd84418026599548312cefaa7aa3bbe 2023-02-17 02:01:23,791 DEBUG [StoreOpener-6fd84418026599548312cefaa7aa3bbe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/6fd84418026599548312cefaa7aa3bbe/f2 2023-02-17 02:01:23,791 DEBUG [StoreOpener-6fd84418026599548312cefaa7aa3bbe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/6fd84418026599548312cefaa7aa3bbe/f2 2023-02-17 02:01:23,791 INFO [StoreOpener-6fd84418026599548312cefaa7aa3bbe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6fd84418026599548312cefaa7aa3bbe columnFamilyName f2 2023-02-17 02:01:23,792 INFO [StoreOpener-6fd84418026599548312cefaa7aa3bbe-1] regionserver.HStore(310): Store=6fd84418026599548312cefaa7aa3bbe/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:23,792 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/76fb71705f76672ea40ce0d3b7341303/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 02:01:23,792 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/6fd84418026599548312cefaa7aa3bbe 2023-02-17 02:01:23,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/6fd84418026599548312cefaa7aa3bbe 2023-02-17 02:01:23,793 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 76fb71705f76672ea40ce0d3b7341303; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68323449, jitterRate=0.018098726868629456}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 02:01:23,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 76fb71705f76672ea40ce0d3b7341303: 2023-02-17 02:01:23,794 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1676599283172.76fb71705f76672ea40ce0d3b7341303., pid=30, masterSystemTime=1676599283684 2023-02-17 02:01:23,796 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 02:01:23,796 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1676599283172.76fb71705f76672ea40ce0d3b7341303. 2023-02-17 02:01:23,796 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1676599283172.76fb71705f76672ea40ce0d3b7341303. 2023-02-17 02:01:23,796 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=76fb71705f76672ea40ce0d3b7341303, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37987,1676599281907 2023-02-17 02:01:23,796 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1676599283172.3e671049091ae20efb4f185e13c8e87d. 2023-02-17 02:01:23,796 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1676599283172.76fb71705f76672ea40ce0d3b7341303.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676599283796"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676599283796"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676599283796"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676599283796"}]},"ts":"1676599283796"} 2023-02-17 02:01:23,796 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3e671049091ae20efb4f185e13c8e87d, NAME => 'testWithMapReduce,m\xED\xED,1676599283172.3e671049091ae20efb4f185e13c8e87d.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-17 02:01:23,797 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 3e671049091ae20efb4f185e13c8e87d 2023-02-17 02:01:23,797 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676599283172.3e671049091ae20efb4f185e13c8e87d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:23,797 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 3e671049091ae20efb4f185e13c8e87d 2023-02-17 02:01:23,797 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 3e671049091ae20efb4f185e13c8e87d 2023-02-17 02:01:23,797 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 6fd84418026599548312cefaa7aa3bbe 2023-02-17 02:01:23,798 INFO [StoreOpener-3e671049091ae20efb4f185e13c8e87d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3e671049091ae20efb4f185e13c8e87d 2023-02-17 02:01:23,800 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/6fd84418026599548312cefaa7aa3bbe/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 02:01:23,800 DEBUG [StoreOpener-3e671049091ae20efb4f185e13c8e87d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/3e671049091ae20efb4f185e13c8e87d/f1 2023-02-17 02:01:23,800 DEBUG [StoreOpener-3e671049091ae20efb4f185e13c8e87d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/3e671049091ae20efb4f185e13c8e87d/f1 2023-02-17 02:01:23,800 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 6fd84418026599548312cefaa7aa3bbe; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73179438, jitterRate=0.09045860171318054}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 02:01:23,800 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 6fd84418026599548312cefaa7aa3bbe: 2023-02-17 02:01:23,801 INFO [StoreOpener-3e671049091ae20efb4f185e13c8e87d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3e671049091ae20efb4f185e13c8e87d columnFamilyName f1 2023-02-17 02:01:23,801 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=12 2023-02-17 02:01:23,801 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=12, state=SUCCESS; OpenRegionProcedure 76fb71705f76672ea40ce0d3b7341303, server=jenkins-hbase4.apache.org,37987,1676599281907 in 260 msec 2023-02-17 02:01:23,801 INFO [StoreOpener-3e671049091ae20efb4f185e13c8e87d-1] regionserver.HStore(310): Store=3e671049091ae20efb4f185e13c8e87d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:23,801 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676599283172.6fd84418026599548312cefaa7aa3bbe., pid=24, masterSystemTime=1676599283672 2023-02-17 02:01:23,801 INFO [StoreOpener-3e671049091ae20efb4f185e13c8e87d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3e671049091ae20efb4f185e13c8e87d 2023-02-17 02:01:23,803 DEBUG [StoreOpener-3e671049091ae20efb4f185e13c8e87d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/3e671049091ae20efb4f185e13c8e87d/f2 2023-02-17 02:01:23,803 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=76fb71705f76672ea40ce0d3b7341303, ASSIGN in 442 msec 2023-02-17 02:01:23,803 DEBUG [StoreOpener-3e671049091ae20efb4f185e13c8e87d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/3e671049091ae20efb4f185e13c8e87d/f2 2023-02-17 02:01:23,803 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676599283172.6fd84418026599548312cefaa7aa3bbe. 2023-02-17 02:01:23,803 INFO [StoreOpener-3e671049091ae20efb4f185e13c8e87d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3e671049091ae20efb4f185e13c8e87d columnFamilyName f2 2023-02-17 02:01:23,803 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676599283172.6fd84418026599548312cefaa7aa3bbe. 2023-02-17 02:01:23,803 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=6fd84418026599548312cefaa7aa3bbe, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42015,1676599281872 2023-02-17 02:01:23,804 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676599283172.6fd84418026599548312cefaa7aa3bbe.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676599283803"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676599283803"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676599283803"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676599283803"}]},"ts":"1676599283803"} 2023-02-17 02:01:23,804 INFO [StoreOpener-3e671049091ae20efb4f185e13c8e87d-1] regionserver.HStore(310): Store=3e671049091ae20efb4f185e13c8e87d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:23,805 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/3e671049091ae20efb4f185e13c8e87d 2023-02-17 02:01:23,805 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/3e671049091ae20efb4f185e13c8e87d 2023-02-17 02:01:23,807 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=11 2023-02-17 02:01:23,807 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=11, state=SUCCESS; OpenRegionProcedure 6fd84418026599548312cefaa7aa3bbe, server=jenkins-hbase4.apache.org,42015,1676599281872 in 281 msec 2023-02-17 02:01:23,808 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 02:01:23,809 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=6fd84418026599548312cefaa7aa3bbe, ASSIGN in 448 msec 2023-02-17 02:01:23,809 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 3e671049091ae20efb4f185e13c8e87d 2023-02-17 02:01:23,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/3e671049091ae20efb4f185e13c8e87d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 02:01:23,812 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 3e671049091ae20efb4f185e13c8e87d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74880375, jitterRate=0.11580453813076019}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 02:01:23,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 3e671049091ae20efb4f185e13c8e87d: 2023-02-17 02:01:23,813 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1676599283172.3e671049091ae20efb4f185e13c8e87d., pid=27, masterSystemTime=1676599283684 2023-02-17 02:01:23,814 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1676599283172.3e671049091ae20efb4f185e13c8e87d. 2023-02-17 02:01:23,814 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1676599283172.3e671049091ae20efb4f185e13c8e87d. 2023-02-17 02:01:23,815 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=3e671049091ae20efb4f185e13c8e87d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37987,1676599281907 2023-02-17 02:01:23,815 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1676599283172.3e671049091ae20efb4f185e13c8e87d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676599283814"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676599283814"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676599283814"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676599283814"}]},"ts":"1676599283814"} 2023-02-17 02:01:23,818 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=16 2023-02-17 02:01:23,818 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=16, state=SUCCESS; OpenRegionProcedure 3e671049091ae20efb4f185e13c8e87d, server=jenkins-hbase4.apache.org,37987,1676599281907 in 281 msec 2023-02-17 02:01:23,819 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=10 2023-02-17 02:01:23,819 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=3e671049091ae20efb4f185e13c8e87d, ASSIGN in 459 msec 2023-02-17 02:01:23,820 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-17 02:01:23,820 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676599283820"}]},"ts":"1676599283820"} 2023-02-17 02:01:23,821 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-17 02:01:23,825 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-17 02:01:23,826 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 652 msec 2023-02-17 02:01:24,275 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-17 02:01:24,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36043] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 02:01:24,286 INFO [Listener at localhost/46551] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-17 02:01:24,287 DEBUG [Listener at localhost/46551] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-17 02:01:24,287 INFO [Listener at localhost/46551] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-17 02:01:24,293 INFO [Listener at localhost/46551] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-17 02:01:24,294 INFO [Listener at localhost/46551] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-17 02:01:24,294 INFO [Listener at localhost/46551] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-17 02:01:24,294 INFO [Listener at localhost/46551] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-17 02:01:24,393 DEBUG [hconnection-0x6ae69468-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 02:01:24,428 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57362, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 02:01:24,441 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42015] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,d\x84\x84,1676599283172.d0c39439e95718da09586626dbdd1981. 2023-02-17 02:01:24,442 WARN [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37987] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676599283172.76fb71705f76672ea40ce0d3b7341303. 2023-02-17 02:01:24,622 INFO [Listener at localhost/46551] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-17 02:01:24,623 INFO [Listener at localhost/46551] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-17 02:01:24,624 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36043] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-17 02:01:24,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36043] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676599284624 (current time:1676599284624). 2023-02-17 02:01:24,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36043] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-17 02:01:24,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36043] zookeeper.ReadOnlyZKClient(139): Connect 0x340b935f to 127.0.0.1:62873 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 02:01:24,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36043] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5815764c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 02:01:24,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36043] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 02:01:24,637 INFO [RS-EventLoopGroup-7-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56754, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 02:01:24,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36043] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x340b935f to 127.0.0.1:62873 2023-02-17 02:01:24,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36043] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 02:01:24,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36043] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-17 02:01:24,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36043] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-17 02:01:24,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36043] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-17 02:01:24,644 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-17 02:01:24,645 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676599884645 2023-02-17 02:01:24,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36043] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-17 02:01:24,645 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-17 02:01:24,648 DEBUG [Listener at localhost/46551] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-17 02:01:24,648 DEBUG [Listener at localhost/46551] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-17 02:01:24,649 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-17 02:01:24,649 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-17 02:01:24,650 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 7 msec 2023-02-17 02:01:24,651 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-17 02:01:24,651 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676599884651 2023-02-17 02:01:24,664 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:24,665 INFO [(jenkins-hbase4.apache.org,36043,1676599281810)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' 2023-02-17 02:01:24,665 DEBUG [(jenkins-hbase4.apache.org,36043,1676599281810)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-17 02:01:24,666 DEBUG [(jenkins-hbase4.apache.org,36043,1676599281810)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' 2023-02-17 02:01:24,666 DEBUG [(jenkins-hbase4.apache.org,36043,1676599281810)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion', kicking off acquire phase on members. 2023-02-17 02:01:24,666 DEBUG [(jenkins-hbase4.apache.org,36043,1676599281810)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:24,666 DEBUG [(jenkins-hbase4.apache.org,36043,1676599281810)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:24,668 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): regionserver:42015-0x1006002b2390001, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 02:01:24,668 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): regionserver:37987-0x1006002b2390002, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 02:01:24,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 02:01:24,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 02:01:24,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 02:01:24,668 DEBUG [(jenkins-hbase4.apache.org,36043,1676599281810)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,37987,1676599281907 2023-02-17 02:01:24,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 02:01:24,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:24,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:24,669 DEBUG [(jenkins-hbase4.apache.org,36043,1676599281810)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,37987,1676599281907 2023-02-17 02:01:24,669 DEBUG [(jenkins-hbase4.apache.org,36043,1676599281810)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,42015,1676599281872 2023-02-17 02:01:24,669 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42015-0x1006002b2390001, quorum=127.0.0.1:62873, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:24,669 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37987-0x1006002b2390002, quorum=127.0.0.1:62873, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:24,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-17 02:01:24,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:24,669 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-17 02:01:24,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-17 02:01:24,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:24,670 DEBUG [(jenkins-hbase4.apache.org,36043,1676599281810)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,42015,1676599281872 2023-02-17 02:01:24,670 DEBUG [(jenkins-hbase4.apache.org,36043,1676599281810)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-17 02:01:24,670 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-17 02:01:24,670 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:24,670 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:24,670 DEBUG [member: 'jenkins-hbase4.apache.org,42015,1676599281872' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-17 02:01:24,670 DEBUG [member: 'jenkins-hbase4.apache.org,42015,1676599281872' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-17 02:01:24,676 DEBUG [member: 'jenkins-hbase4.apache.org,42015,1676599281872' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-17 02:01:24,677 DEBUG [member: 'jenkins-hbase4.apache.org,37987,1676599281907' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-17 02:01:24,677 DEBUG [member: 'jenkins-hbase4.apache.org,37987,1676599281907' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-17 02:01:24,677 DEBUG [member: 'jenkins-hbase4.apache.org,42015,1676599281872' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-17 02:01:24,678 DEBUG [member: 'jenkins-hbase4.apache.org,37987,1676599281907' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-17 02:01:24,678 DEBUG [member: 'jenkins-hbase4.apache.org,37987,1676599281907' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-17 02:01:24,678 DEBUG [member: 'jenkins-hbase4.apache.org,42015,1676599281872' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42015,1676599281872' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-17 02:01:24,678 DEBUG [member: 'jenkins-hbase4.apache.org,37987,1676599281907' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37987,1676599281907' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-17 02:01:24,681 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,37987,1676599281907 2023-02-17 02:01:24,681 DEBUG [member: 'jenkins-hbase4.apache.org,37987,1676599281907' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:24,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,37987,1676599281907 2023-02-17 02:01:24,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 02:01:24,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-17 02:01:24,682 DEBUG [member: 'jenkins-hbase4.apache.org,37987,1676599281907' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37987-0x1006002b2390002, quorum=127.0.0.1:62873, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:24,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 02:01:24,682 DEBUG [member: 'jenkins-hbase4.apache.org,37987,1676599281907' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 02:01:24,682 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,42015,1676599281872 2023-02-17 02:01:24,682 DEBUG [member: 'jenkins-hbase4.apache.org,42015,1676599281872' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:24,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 02:01:24,683 DEBUG [member: 'jenkins-hbase4.apache.org,42015,1676599281872' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42015-0x1006002b2390001, quorum=127.0.0.1:62873, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:24,683 DEBUG [member: 'jenkins-hbase4.apache.org,42015,1676599281872' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 02:01:24,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:24,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42015,1676599281872 2023-02-17 02:01:24,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37987,1676599281907 2023-02-17 02:01:24,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 02:01:24,685 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37987,1676599281907' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-17 02:01:24,685 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@14ad599e[Count = 1] remaining members to acquire global barrier 2023-02-17 02:01:24,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,42015,1676599281872 2023-02-17 02:01:24,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 02:01:24,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-17 02:01:24,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 02:01:24,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 02:01:24,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:24,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42015,1676599281872 2023-02-17 02:01:24,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37987,1676599281907 2023-02-17 02:01:24,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 02:01:24,688 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42015,1676599281872' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-17 02:01:24,689 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@14ad599e[Count = 0] remaining members to acquire global barrier 2023-02-17 02:01:24,689 DEBUG [(jenkins-hbase4.apache.org,36043,1676599281810)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'in-barrier' execution. 2023-02-17 02:01:24,689 DEBUG [(jenkins-hbase4.apache.org,36043,1676599281810)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:24,690 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): regionserver:42015-0x1006002b2390001, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:24,690 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): regionserver:37987-0x1006002b2390002, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:24,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:24,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:24,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:24,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:24,690 DEBUG [(jenkins-hbase4.apache.org,36043,1676599281810)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,37987,1676599281907 2023-02-17 02:01:24,691 DEBUG [(jenkins-hbase4.apache.org,36043,1676599281810)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,42015,1676599281872 2023-02-17 02:01:24,691 DEBUG [(jenkins-hbase4.apache.org,36043,1676599281810)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-17 02:01:24,692 DEBUG [member: 'jenkins-hbase4.apache.org,37987,1676599281907' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-17 02:01:24,692 DEBUG [member: 'jenkins-hbase4.apache.org,42015,1676599281872' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-17 02:01:24,696 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1676599283172.3e671049091ae20efb4f185e13c8e87d. 2023-02-17 02:01:24,696 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1676599283172.3e671049091ae20efb4f185e13c8e87d. started... 2023-02-17 02:01:24,700 INFO [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 3e671049091ae20efb4f185e13c8e87d 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-17 02:01:24,701 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1676599283172.5b902d43bfac9401fc39fb36d68d8226. 2023-02-17 02:01:24,701 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1676599283172.5b902d43bfac9401fc39fb36d68d8226. started... 2023-02-17 02:01:24,704 DEBUG [member: 'jenkins-hbase4.apache.org,37987,1676599281907' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-17 02:01:24,707 DEBUG [member: 'jenkins-hbase4.apache.org,37987,1676599281907' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-17 02:01:24,706 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1676599283172.d0c39439e95718da09586626dbdd1981. 2023-02-17 02:01:24,706 DEBUG [member: 'jenkins-hbase4.apache.org,42015,1676599281872' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-17 02:01:24,708 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1676599283172.0ac77707fded7da956ea2eaff472f1e5. 2023-02-17 02:01:24,705 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676599283172.6fd84418026599548312cefaa7aa3bbe. 2023-02-17 02:01:24,708 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1676599283172.0ac77707fded7da956ea2eaff472f1e5. started... 2023-02-17 02:01:24,705 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 5b902d43bfac9401fc39fb36d68d8226: 2023-02-17 02:01:24,708 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676599283172.6fd84418026599548312cefaa7aa3bbe. started... 2023-02-17 02:01:24,708 DEBUG [member: 'jenkins-hbase4.apache.org,42015,1676599281872' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-17 02:01:24,708 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1676599283172.d0c39439e95718da09586626dbdd1981. started... 2023-02-17 02:01:24,708 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1676599283172.5b902d43bfac9401fc39fb36d68d8226.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:24,708 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1676599283172.2320e8050ac479d9cc2f8e39be1d5e17. 2023-02-17 02:01:24,708 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 02:01:24,708 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676599283172.2320e8050ac479d9cc2f8e39be1d5e17. started... 2023-02-17 02:01:24,708 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-17 02:01:24,708 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-17 02:01:24,713 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 6fd84418026599548312cefaa7aa3bbe: 2023-02-17 02:01:24,713 INFO [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 0ac77707fded7da956ea2eaff472f1e5 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-17 02:01:24,713 INFO [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-0] regionserver.HRegion(2744): Flushing d0c39439e95718da09586626dbdd1981 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-17 02:01:24,713 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676599283172.6fd84418026599548312cefaa7aa3bbe.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:24,713 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 02:01:24,713 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-17 02:01:24,713 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-17 02:01:24,713 INFO [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 2320e8050ac479d9cc2f8e39be1d5e17 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-17 02:01:24,751 DEBUG [Listener at localhost/46551] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-17 02:01:24,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36043] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-17 02:01:24,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36043] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-17 02:01:24,753 DEBUG [Listener at localhost/46551] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-17 02:01:24,760 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1676599283172.5b902d43bfac9401fc39fb36d68d8226. completed. 2023-02-17 02:01:24,760 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1676599283172.5b902d43bfac9401fc39fb36d68d8226. 2023-02-17 02:01:24,760 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1676599283172.2700e21ceee9ee6242041ee38fc8cdfa. 2023-02-17 02:01:24,760 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676599283172.2700e21ceee9ee6242041ee38fc8cdfa. started... 2023-02-17 02:01:24,761 DEBUG [member: 'jenkins-hbase4.apache.org,37987,1676599281907' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-17 02:01:24,770 INFO [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 2700e21ceee9ee6242041ee38fc8cdfa 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-17 02:01:24,796 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676599283172.6fd84418026599548312cefaa7aa3bbe. completed. 2023-02-17 02:01:24,797 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676599283172.6fd84418026599548312cefaa7aa3bbe. 2023-02-17 02:01:24,797 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1676599283172.c087f3b958f194282116d4bdcb846998. 2023-02-17 02:01:24,797 DEBUG [member: 'jenkins-hbase4.apache.org,42015,1676599281872' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-17 02:01:24,797 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1676599283172.c087f3b958f194282116d4bdcb846998. started... 2023-02-17 02:01:24,797 INFO [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-1] regionserver.HRegion(2744): Flushing c087f3b958f194282116d4bdcb846998 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-17 02:01:24,800 INFO [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/d0c39439e95718da09586626dbdd1981/.tmp/f1/cd0fe9cd085147fea9c2ec34a42ecd1b 2023-02-17 02:01:24,805 INFO [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/2320e8050ac479d9cc2f8e39be1d5e17/.tmp/f1/d4857bef8d7c415499bb951c3134619d 2023-02-17 02:01:24,856 INFO [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/2700e21ceee9ee6242041ee38fc8cdfa/.tmp/f1/3e69b14c8e634095b91687c9b144de10 2023-02-17 02:01:24,876 INFO [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/c087f3b958f194282116d4bdcb846998/.tmp/f1/98ec870aaabb42f9a6a2c32e566935d4 2023-02-17 02:01:24,905 INFO [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/d0c39439e95718da09586626dbdd1981/.tmp/f2/c20f6d6c1f9941a2a488560223a30b8d 2023-02-17 02:01:24,910 INFO [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/2700e21ceee9ee6242041ee38fc8cdfa/.tmp/f2/a4b492ef88ec46e982586e9fe090e72b 2023-02-17 02:01:24,911 INFO [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/2320e8050ac479d9cc2f8e39be1d5e17/.tmp/f2/fe31e0e76f5d42f0bdc0287b6ead1d1d 2023-02-17 02:01:24,917 INFO [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/c087f3b958f194282116d4bdcb846998/.tmp/f2/5b08c323ca4d4c02ba7b497e70601e82 2023-02-17 02:01:24,917 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/d0c39439e95718da09586626dbdd1981/.tmp/f1/cd0fe9cd085147fea9c2ec34a42ecd1b as hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/d0c39439e95718da09586626dbdd1981/f1/cd0fe9cd085147fea9c2ec34a42ecd1b 2023-02-17 02:01:24,918 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/2700e21ceee9ee6242041ee38fc8cdfa/.tmp/f1/3e69b14c8e634095b91687c9b144de10 as hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/2700e21ceee9ee6242041ee38fc8cdfa/f1/3e69b14c8e634095b91687c9b144de10 2023-02-17 02:01:24,924 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/2320e8050ac479d9cc2f8e39be1d5e17/.tmp/f1/d4857bef8d7c415499bb951c3134619d as hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/2320e8050ac479d9cc2f8e39be1d5e17/f1/d4857bef8d7c415499bb951c3134619d 2023-02-17 02:01:24,925 INFO [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/2700e21ceee9ee6242041ee38fc8cdfa/f1/3e69b14c8e634095b91687c9b144de10, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 02:01:24,925 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/c087f3b958f194282116d4bdcb846998/.tmp/f1/98ec870aaabb42f9a6a2c32e566935d4 as hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/c087f3b958f194282116d4bdcb846998/f1/98ec870aaabb42f9a6a2c32e566935d4 2023-02-17 02:01:24,925 INFO [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/d0c39439e95718da09586626dbdd1981/f1/cd0fe9cd085147fea9c2ec34a42ecd1b, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 02:01:24,926 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/2700e21ceee9ee6242041ee38fc8cdfa/.tmp/f2/a4b492ef88ec46e982586e9fe090e72b as hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/2700e21ceee9ee6242041ee38fc8cdfa/f2/a4b492ef88ec46e982586e9fe090e72b 2023-02-17 02:01:24,926 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/d0c39439e95718da09586626dbdd1981/.tmp/f2/c20f6d6c1f9941a2a488560223a30b8d as hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/d0c39439e95718da09586626dbdd1981/f2/c20f6d6c1f9941a2a488560223a30b8d 2023-02-17 02:01:24,933 INFO [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/2320e8050ac479d9cc2f8e39be1d5e17/f1/d4857bef8d7c415499bb951c3134619d, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 02:01:24,934 INFO [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/2700e21ceee9ee6242041ee38fc8cdfa/f2/a4b492ef88ec46e982586e9fe090e72b, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 02:01:24,934 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/2320e8050ac479d9cc2f8e39be1d5e17/.tmp/f2/fe31e0e76f5d42f0bdc0287b6ead1d1d as hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/2320e8050ac479d9cc2f8e39be1d5e17/f2/fe31e0e76f5d42f0bdc0287b6ead1d1d 2023-02-17 02:01:24,935 INFO [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 2700e21ceee9ee6242041ee38fc8cdfa in 165ms, sequenceid=5, compaction requested=false 2023-02-17 02:01:24,935 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-17 02:01:24,937 INFO [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/c087f3b958f194282116d4bdcb846998/f1/98ec870aaabb42f9a6a2c32e566935d4, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-17 02:01:24,938 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/c087f3b958f194282116d4bdcb846998/.tmp/f2/5b08c323ca4d4c02ba7b497e70601e82 as hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/c087f3b958f194282116d4bdcb846998/f2/5b08c323ca4d4c02ba7b497e70601e82 2023-02-17 02:01:24,940 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 2700e21ceee9ee6242041ee38fc8cdfa: 2023-02-17 02:01:24,940 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1676599283172.2700e21ceee9ee6242041ee38fc8cdfa.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:24,940 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 02:01:24,941 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/2700e21ceee9ee6242041ee38fc8cdfa/f1/3e69b14c8e634095b91687c9b144de10] hfiles 2023-02-17 02:01:24,941 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/2700e21ceee9ee6242041ee38fc8cdfa/f1/3e69b14c8e634095b91687c9b144de10 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:24,941 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/2700e21ceee9ee6242041ee38fc8cdfa/f2/a4b492ef88ec46e982586e9fe090e72b] hfiles 2023-02-17 02:01:24,941 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/2700e21ceee9ee6242041ee38fc8cdfa/f2/a4b492ef88ec46e982586e9fe090e72b for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:24,942 INFO [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/d0c39439e95718da09586626dbdd1981/f2/c20f6d6c1f9941a2a488560223a30b8d, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 02:01:24,944 INFO [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for d0c39439e95718da09586626dbdd1981 in 231ms, sequenceid=5, compaction requested=false 2023-02-17 02:01:24,945 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for d0c39439e95718da09586626dbdd1981: 2023-02-17 02:01:24,945 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1676599283172.d0c39439e95718da09586626dbdd1981.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:24,946 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 02:01:24,946 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/d0c39439e95718da09586626dbdd1981/f1/cd0fe9cd085147fea9c2ec34a42ecd1b] hfiles 2023-02-17 02:01:24,946 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/d0c39439e95718da09586626dbdd1981/f1/cd0fe9cd085147fea9c2ec34a42ecd1b for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:24,946 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/d0c39439e95718da09586626dbdd1981/f2/c20f6d6c1f9941a2a488560223a30b8d] hfiles 2023-02-17 02:01:24,946 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/d0c39439e95718da09586626dbdd1981/f2/c20f6d6c1f9941a2a488560223a30b8d for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:24,953 INFO [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/c087f3b958f194282116d4bdcb846998/f2/5b08c323ca4d4c02ba7b497e70601e82, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-17 02:01:24,953 INFO [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/2320e8050ac479d9cc2f8e39be1d5e17/f2/fe31e0e76f5d42f0bdc0287b6ead1d1d, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 02:01:24,954 DEBUG [Listener at localhost/46551] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-17 02:01:24,954 INFO [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 2320e8050ac479d9cc2f8e39be1d5e17 in 241ms, sequenceid=5, compaction requested=false 2023-02-17 02:01:24,954 INFO [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for c087f3b958f194282116d4bdcb846998 in 157ms, sequenceid=5, compaction requested=false 2023-02-17 02:01:24,955 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for c087f3b958f194282116d4bdcb846998: 2023-02-17 02:01:24,955 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1676599283172.c087f3b958f194282116d4bdcb846998.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:24,955 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 02:01:24,955 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/c087f3b958f194282116d4bdcb846998/f1/98ec870aaabb42f9a6a2c32e566935d4] hfiles 2023-02-17 02:01:24,955 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/c087f3b958f194282116d4bdcb846998/f1/98ec870aaabb42f9a6a2c32e566935d4 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:24,955 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/c087f3b958f194282116d4bdcb846998/f2/5b08c323ca4d4c02ba7b497e70601e82] hfiles 2023-02-17 02:01:24,955 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/c087f3b958f194282116d4bdcb846998/f2/5b08c323ca4d4c02ba7b497e70601e82 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:24,955 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 2320e8050ac479d9cc2f8e39be1d5e17: 2023-02-17 02:01:24,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36043] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-17 02:01:24,955 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1676599283172.2320e8050ac479d9cc2f8e39be1d5e17.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:24,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36043] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-17 02:01:24,956 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 02:01:24,956 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/2320e8050ac479d9cc2f8e39be1d5e17/f1/d4857bef8d7c415499bb951c3134619d] hfiles 2023-02-17 02:01:24,956 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/2320e8050ac479d9cc2f8e39be1d5e17/f1/d4857bef8d7c415499bb951c3134619d for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:24,956 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/2320e8050ac479d9cc2f8e39be1d5e17/f2/fe31e0e76f5d42f0bdc0287b6ead1d1d] hfiles 2023-02-17 02:01:24,956 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/2320e8050ac479d9cc2f8e39be1d5e17/f2/fe31e0e76f5d42f0bdc0287b6ead1d1d for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:24,956 DEBUG [Listener at localhost/46551] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-17 02:01:24,965 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676599283172.2700e21ceee9ee6242041ee38fc8cdfa. completed. 2023-02-17 02:01:24,965 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1676599283172.2700e21ceee9ee6242041ee38fc8cdfa. 2023-02-17 02:01:24,965 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1676599283172.76fb71705f76672ea40ce0d3b7341303. 2023-02-17 02:01:24,965 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1676599283172.76fb71705f76672ea40ce0d3b7341303. started... 2023-02-17 02:01:24,965 DEBUG [member: 'jenkins-hbase4.apache.org,37987,1676599281907' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-17 02:01:24,965 INFO [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 76fb71705f76672ea40ce0d3b7341303 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-17 02:01:24,984 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1676599283172.d0c39439e95718da09586626dbdd1981. completed. 2023-02-17 02:01:24,984 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1676599283172.d0c39439e95718da09586626dbdd1981. 2023-02-17 02:01:24,985 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1676599283172.6014956a2b3f63abad8cd3b17629b80c. 2023-02-17 02:01:24,985 DEBUG [member: 'jenkins-hbase4.apache.org,42015,1676599281872' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-17 02:01:24,985 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1676599283172.6014956a2b3f63abad8cd3b17629b80c. started... 2023-02-17 02:01:24,985 INFO [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 6014956a2b3f63abad8cd3b17629b80c 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-17 02:01:25,000 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1676599283172.c087f3b958f194282116d4bdcb846998. completed. 2023-02-17 02:01:25,000 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1676599283172.c087f3b958f194282116d4bdcb846998. 2023-02-17 02:01:25,000 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676599283172.2320e8050ac479d9cc2f8e39be1d5e17. completed. 2023-02-17 02:01:25,000 DEBUG [member: 'jenkins-hbase4.apache.org,42015,1676599281872' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-17 02:01:25,000 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1676599283172.2320e8050ac479d9cc2f8e39be1d5e17. 2023-02-17 02:01:25,000 DEBUG [member: 'jenkins-hbase4.apache.org,42015,1676599281872' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-17 02:01:25,011 INFO [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/76fb71705f76672ea40ce0d3b7341303/.tmp/f1/af5e460408ec47dab3b88d86382ee410 2023-02-17 02:01:25,014 INFO [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/6014956a2b3f63abad8cd3b17629b80c/.tmp/f1/27f79d882d924577bb88d5435c2114a9 2023-02-17 02:01:25,038 INFO [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/76fb71705f76672ea40ce0d3b7341303/.tmp/f2/3d5e3d58e0dd4468ba82bb6148cd9647 2023-02-17 02:01:25,045 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/76fb71705f76672ea40ce0d3b7341303/.tmp/f1/af5e460408ec47dab3b88d86382ee410 as hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/76fb71705f76672ea40ce0d3b7341303/f1/af5e460408ec47dab3b88d86382ee410 2023-02-17 02:01:25,050 INFO [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/76fb71705f76672ea40ce0d3b7341303/f1/af5e460408ec47dab3b88d86382ee410, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-17 02:01:25,051 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/76fb71705f76672ea40ce0d3b7341303/.tmp/f2/3d5e3d58e0dd4468ba82bb6148cd9647 as hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/76fb71705f76672ea40ce0d3b7341303/f2/3d5e3d58e0dd4468ba82bb6148cd9647 2023-02-17 02:01:25,056 INFO [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/6014956a2b3f63abad8cd3b17629b80c/.tmp/f2/ebb80d64719a40e7941f8b9b77e84bae 2023-02-17 02:01:25,059 INFO [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/76fb71705f76672ea40ce0d3b7341303/f2/3d5e3d58e0dd4468ba82bb6148cd9647, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-17 02:01:25,060 INFO [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 76fb71705f76672ea40ce0d3b7341303 in 95ms, sequenceid=5, compaction requested=false 2023-02-17 02:01:25,060 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 76fb71705f76672ea40ce0d3b7341303: 2023-02-17 02:01:25,061 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1676599283172.76fb71705f76672ea40ce0d3b7341303.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:25,061 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 02:01:25,061 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/76fb71705f76672ea40ce0d3b7341303/f1/af5e460408ec47dab3b88d86382ee410] hfiles 2023-02-17 02:01:25,061 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/76fb71705f76672ea40ce0d3b7341303/f1/af5e460408ec47dab3b88d86382ee410 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:25,061 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/76fb71705f76672ea40ce0d3b7341303/f2/3d5e3d58e0dd4468ba82bb6148cd9647] hfiles 2023-02-17 02:01:25,061 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/76fb71705f76672ea40ce0d3b7341303/f2/3d5e3d58e0dd4468ba82bb6148cd9647 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:25,064 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/6014956a2b3f63abad8cd3b17629b80c/.tmp/f1/27f79d882d924577bb88d5435c2114a9 as hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/6014956a2b3f63abad8cd3b17629b80c/f1/27f79d882d924577bb88d5435c2114a9 2023-02-17 02:01:25,071 INFO [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/6014956a2b3f63abad8cd3b17629b80c/f1/27f79d882d924577bb88d5435c2114a9, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 02:01:25,072 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/6014956a2b3f63abad8cd3b17629b80c/.tmp/f2/ebb80d64719a40e7941f8b9b77e84bae as hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/6014956a2b3f63abad8cd3b17629b80c/f2/ebb80d64719a40e7941f8b9b77e84bae 2023-02-17 02:01:25,074 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1676599283172.76fb71705f76672ea40ce0d3b7341303. completed. 2023-02-17 02:01:25,074 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1676599283172.76fb71705f76672ea40ce0d3b7341303. 2023-02-17 02:01:25,075 DEBUG [member: 'jenkins-hbase4.apache.org,37987,1676599281907' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-17 02:01:25,079 INFO [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/6014956a2b3f63abad8cd3b17629b80c/f2/ebb80d64719a40e7941f8b9b77e84bae, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 02:01:25,081 INFO [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 6014956a2b3f63abad8cd3b17629b80c in 95ms, sequenceid=5, compaction requested=false 2023-02-17 02:01:25,081 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 6014956a2b3f63abad8cd3b17629b80c: 2023-02-17 02:01:25,081 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1676599283172.6014956a2b3f63abad8cd3b17629b80c.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:25,081 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 02:01:25,081 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/6014956a2b3f63abad8cd3b17629b80c/f1/27f79d882d924577bb88d5435c2114a9] hfiles 2023-02-17 02:01:25,081 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/6014956a2b3f63abad8cd3b17629b80c/f1/27f79d882d924577bb88d5435c2114a9 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:25,081 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/6014956a2b3f63abad8cd3b17629b80c/f2/ebb80d64719a40e7941f8b9b77e84bae] hfiles 2023-02-17 02:01:25,081 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/6014956a2b3f63abad8cd3b17629b80c/f2/ebb80d64719a40e7941f8b9b77e84bae for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:25,100 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1676599283172.6014956a2b3f63abad8cd3b17629b80c. completed. 2023-02-17 02:01:25,100 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1676599283172.6014956a2b3f63abad8cd3b17629b80c. 2023-02-17 02:01:25,100 DEBUG [member: 'jenkins-hbase4.apache.org,42015,1676599281872' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-17 02:01:25,100 DEBUG [member: 'jenkins-hbase4.apache.org,42015,1676599281872' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-17 02:01:25,100 DEBUG [member: 'jenkins-hbase4.apache.org,42015,1676599281872' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42015,1676599281872 2023-02-17 02:01:25,100 DEBUG [member: 'jenkins-hbase4.apache.org,42015,1676599281872' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-17 02:01:25,101 DEBUG [member: 'jenkins-hbase4.apache.org,42015,1676599281872' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase4.apache.org,42015,1676599281872' in zk 2023-02-17 02:01:25,106 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,42015,1676599281872 2023-02-17 02:01:25,106 DEBUG [member: 'jenkins-hbase4.apache.org,42015,1676599281872' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-17 02:01:25,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,42015,1676599281872 2023-02-17 02:01:25,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 02:01:25,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-17 02:01:25,106 DEBUG [member: 'jenkins-hbase4.apache.org,42015,1676599281872' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 02:01:25,106 DEBUG [member: 'jenkins-hbase4.apache.org,42015,1676599281872' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-17 02:01:25,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 02:01:25,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 02:01:25,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:25,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42015,1676599281872 2023-02-17 02:01:25,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37987,1676599281907 2023-02-17 02:01:25,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 02:01:25,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:25,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42015,1676599281872 2023-02-17 02:01:25,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase4.apache.org,42015,1676599281872': 2023-02-17 02:01:25,111 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42015,1676599281872' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 1 more 2023-02-17 02:01:25,168 INFO [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/3e671049091ae20efb4f185e13c8e87d/.tmp/f1/55558ab6d7b54feeaca8cc93d2adb771 2023-02-17 02:01:25,197 INFO [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/0ac77707fded7da956ea2eaff472f1e5/.tmp/f1/af17d92e6eea4eda9e92df8e203f4b31 2023-02-17 02:01:25,200 INFO [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/3e671049091ae20efb4f185e13c8e87d/.tmp/f2/b7d3e51017ce4128be5cd682cec839b2 2023-02-17 02:01:25,208 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/3e671049091ae20efb4f185e13c8e87d/.tmp/f1/55558ab6d7b54feeaca8cc93d2adb771 as hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/3e671049091ae20efb4f185e13c8e87d/f1/55558ab6d7b54feeaca8cc93d2adb771 2023-02-17 02:01:25,214 INFO [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/3e671049091ae20efb4f185e13c8e87d/f1/55558ab6d7b54feeaca8cc93d2adb771, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 02:01:25,215 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/3e671049091ae20efb4f185e13c8e87d/.tmp/f2/b7d3e51017ce4128be5cd682cec839b2 as hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/3e671049091ae20efb4f185e13c8e87d/f2/b7d3e51017ce4128be5cd682cec839b2 2023-02-17 02:01:25,221 INFO [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/0ac77707fded7da956ea2eaff472f1e5/.tmp/f2/5a398bfa3b644ddb96cd9a14ab04516a 2023-02-17 02:01:25,221 INFO [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/3e671049091ae20efb4f185e13c8e87d/f2/b7d3e51017ce4128be5cd682cec839b2, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 02:01:25,222 INFO [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 3e671049091ae20efb4f185e13c8e87d in 522ms, sequenceid=5, compaction requested=false 2023-02-17 02:01:25,222 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 3e671049091ae20efb4f185e13c8e87d: 2023-02-17 02:01:25,223 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1676599283172.3e671049091ae20efb4f185e13c8e87d.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:25,223 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 02:01:25,223 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/3e671049091ae20efb4f185e13c8e87d/f1/55558ab6d7b54feeaca8cc93d2adb771] hfiles 2023-02-17 02:01:25,223 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/3e671049091ae20efb4f185e13c8e87d/f1/55558ab6d7b54feeaca8cc93d2adb771 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:25,223 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/3e671049091ae20efb4f185e13c8e87d/f2/b7d3e51017ce4128be5cd682cec839b2] hfiles 2023-02-17 02:01:25,223 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/3e671049091ae20efb4f185e13c8e87d/f2/b7d3e51017ce4128be5cd682cec839b2 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:25,228 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/0ac77707fded7da956ea2eaff472f1e5/.tmp/f1/af17d92e6eea4eda9e92df8e203f4b31 as hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/0ac77707fded7da956ea2eaff472f1e5/f1/af17d92e6eea4eda9e92df8e203f4b31 2023-02-17 02:01:25,233 INFO [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/0ac77707fded7da956ea2eaff472f1e5/f1/af17d92e6eea4eda9e92df8e203f4b31, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 02:01:25,234 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/0ac77707fded7da956ea2eaff472f1e5/.tmp/f2/5a398bfa3b644ddb96cd9a14ab04516a as hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/0ac77707fded7da956ea2eaff472f1e5/f2/5a398bfa3b644ddb96cd9a14ab04516a 2023-02-17 02:01:25,234 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1676599283172.3e671049091ae20efb4f185e13c8e87d. completed. 2023-02-17 02:01:25,235 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1676599283172.3e671049091ae20efb4f185e13c8e87d. 2023-02-17 02:01:25,235 DEBUG [member: 'jenkins-hbase4.apache.org,37987,1676599281907' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-17 02:01:25,240 INFO [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/0ac77707fded7da956ea2eaff472f1e5/f2/5a398bfa3b644ddb96cd9a14ab04516a, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 02:01:25,241 INFO [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 0ac77707fded7da956ea2eaff472f1e5 in 528ms, sequenceid=5, compaction requested=false 2023-02-17 02:01:25,241 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 0ac77707fded7da956ea2eaff472f1e5: 2023-02-17 02:01:25,241 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1676599283172.0ac77707fded7da956ea2eaff472f1e5.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:25,241 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 02:01:25,241 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/0ac77707fded7da956ea2eaff472f1e5/f1/af17d92e6eea4eda9e92df8e203f4b31] hfiles 2023-02-17 02:01:25,241 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/0ac77707fded7da956ea2eaff472f1e5/f1/af17d92e6eea4eda9e92df8e203f4b31 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:25,241 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/0ac77707fded7da956ea2eaff472f1e5/f2/5a398bfa3b644ddb96cd9a14ab04516a] hfiles 2023-02-17 02:01:25,241 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/0ac77707fded7da956ea2eaff472f1e5/f2/5a398bfa3b644ddb96cd9a14ab04516a for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:25,250 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1676599283172.0ac77707fded7da956ea2eaff472f1e5. completed. 2023-02-17 02:01:25,250 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1676599283172.0ac77707fded7da956ea2eaff472f1e5. 2023-02-17 02:01:25,250 DEBUG [member: 'jenkins-hbase4.apache.org,37987,1676599281907' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-17 02:01:25,250 DEBUG [member: 'jenkins-hbase4.apache.org,37987,1676599281907' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-17 02:01:25,250 DEBUG [member: 'jenkins-hbase4.apache.org,37987,1676599281907' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37987,1676599281907 2023-02-17 02:01:25,250 DEBUG [member: 'jenkins-hbase4.apache.org,37987,1676599281907' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-17 02:01:25,250 DEBUG [member: 'jenkins-hbase4.apache.org,37987,1676599281907' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase4.apache.org,37987,1676599281907' in zk 2023-02-17 02:01:25,253 DEBUG [member: 'jenkins-hbase4.apache.org,37987,1676599281907' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-17 02:01:25,253 DEBUG [member: 'jenkins-hbase4.apache.org,37987,1676599281907' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 02:01:25,253 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,37987,1676599281907 2023-02-17 02:01:25,253 DEBUG [member: 'jenkins-hbase4.apache.org,37987,1676599281907' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-17 02:01:25,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,37987,1676599281907 2023-02-17 02:01:25,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 02:01:25,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-17 02:01:25,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 02:01:25,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 02:01:25,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:25,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42015,1676599281872 2023-02-17 02:01:25,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37987,1676599281907 2023-02-17 02:01:25,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 02:01:25,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:25,256 DEBUG [Listener at localhost/46551] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-17 02:01:25,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42015,1676599281872 2023-02-17 02:01:25,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37987,1676599281907 2023-02-17 02:01:25,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36043] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-17 02:01:25,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36043] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-17 02:01:25,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase4.apache.org,37987,1676599281907': 2023-02-17 02:01:25,258 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37987,1676599281907' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 0 more 2023-02-17 02:01:25,258 INFO [(jenkins-hbase4.apache.org,36043,1676599281810)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' execution completed 2023-02-17 02:01:25,258 DEBUG [(jenkins-hbase4.apache.org,36043,1676599281810)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-17 02:01:25,258 DEBUG [(jenkins-hbase4.apache.org,36043,1676599281810)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-17 02:01:25,258 DEBUG [(jenkins-hbase4.apache.org,36043,1676599281810)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:25,258 INFO [(jenkins-hbase4.apache.org,36043,1676599281810)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceAndOfflineHBaseMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-17 02:01:25,258 DEBUG [Listener at localhost/46551] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-17 02:01:25,261 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): regionserver:37987-0x1006002b2390002, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:25,261 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:25,261 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): regionserver:37987-0x1006002b2390002, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 02:01:25,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:25,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 02:01:25,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-17 02:01:25,261 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): regionserver:42015-0x1006002b2390001, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:25,261 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:25,261 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:25,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:25,261 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): regionserver:42015-0x1006002b2390001, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 02:01:25,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:25,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 02:01:25,261 DEBUG [(jenkins-hbase4.apache.org,36043,1676599281810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,42015,1676599281872 2023-02-17 02:01:25,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 02:01:25,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 02:01:25,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 02:01:25,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:25,262 DEBUG [(jenkins-hbase4.apache.org,36043,1676599281810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,37987,1676599281907 2023-02-17 02:01:25,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 02:01:25,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:25,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 02:01:25,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:25,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:25,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42015,1676599281872 2023-02-17 02:01:25,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37987,1676599281907 2023-02-17 02:01:25,266 DEBUG [(jenkins-hbase4.apache.org,36043,1676599281810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,42015,1676599281872 2023-02-17 02:01:25,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 02:01:25,266 DEBUG [(jenkins-hbase4.apache.org,36043,1676599281810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,37987,1676599281907 2023-02-17 02:01:25,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:25,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42015,1676599281872 2023-02-17 02:01:25,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37987,1676599281907 2023-02-17 02:01:25,275 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): regionserver:37987-0x1006002b2390002, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 02:01:25,275 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): regionserver:42015-0x1006002b2390001, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 02:01:25,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 02:01:25,276 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:25,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 02:01:25,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 02:01:25,276 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): regionserver:42015-0x1006002b2390001, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 02:01:25,276 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): regionserver:37987-0x1006002b2390002, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 02:01:25,276 DEBUG [(jenkins-hbase4.apache.org,36043,1676599281810)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 02:01:25,276 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,37987,1676599281907 2023-02-17 02:01:25,276 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:25,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 02:01:25,277 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:25,277 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,42015,1676599281872 2023-02-17 02:01:25,277 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:25,277 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,37987,1676599281907 2023-02-17 02:01:25,277 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 02:01:25,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 02:01:25,277 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:25,278 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,42015,1676599281872 2023-02-17 02:01:25,278 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:25,278 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:25,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 02:01:25,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 02:01:25,278 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:25,318 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion to hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/.hbase-snapshot/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:25,339 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed 2023-02-17 02:01:25,339 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:25,340 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:25,340 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676599284645Consolidate snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1676599285276 (+631 ms)Loading Region manifests for testWithMapReduceAndOfflineHBaseMultiRegion at 1676599285277 (+1 ms)Writing data manifest for testWithMapReduceAndOfflineHBaseMultiRegion at 1676599285290 (+13 ms)Verifying snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1676599285301 (+11 ms)Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed at 1676599285339 (+38 ms) 2023-02-17 02:01:25,342 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-17 02:01:25,344 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 695 msec 2023-02-17 02:01:25,758 DEBUG [Listener at localhost/46551] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-17 02:01:25,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36043] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-17 02:01:25,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36043] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-17 02:01:25,760 INFO [Listener at localhost/46551] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-17 02:01:25,765 INFO [Listener at localhost/46551] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-17 02:01:25,774 INFO [Listener at localhost/46551] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-17 02:01:26,042 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42015] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,d\x84\x84,1676599283172.d0c39439e95718da09586626dbdd1981. 2023-02-17 02:01:26,048 WARN [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37987] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676599283172.76fb71705f76672ea40ce0d3b7341303. 2023-02-17 02:01:26,117 INFO [Listener at localhost/46551] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-17 02:01:26,125 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36043] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-17 02:01:26,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36043] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-17 02:01:26,129 INFO [(jenkins-hbase4.apache.org,36043,1676599281810)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-17 02:01:26,129 DEBUG [(jenkins-hbase4.apache.org,36043,1676599281810)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-17 02:01:26,130 DEBUG [(jenkins-hbase4.apache.org,36043,1676599281810)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-17 02:01:26,130 DEBUG [(jenkins-hbase4.apache.org,36043,1676599281810)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-17 02:01:26,131 DEBUG [(jenkins-hbase4.apache.org,36043,1676599281810)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 02:01:26,131 DEBUG [(jenkins-hbase4.apache.org,36043,1676599281810)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-17 02:01:26,164 DEBUG [(jenkins-hbase4.apache.org,36043,1676599281810)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,37987,1676599281907 2023-02-17 02:01:26,164 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): regionserver:42015-0x1006002b2390001, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 02:01:26,164 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): regionserver:37987-0x1006002b2390002, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 02:01:26,165 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 02:01:26,165 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 02:01:26,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 02:01:26,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 02:01:26,165 DEBUG [(jenkins-hbase4.apache.org,36043,1676599281810)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,37987,1676599281907 2023-02-17 02:01:26,165 DEBUG [(jenkins-hbase4.apache.org,36043,1676599281810)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42015,1676599281872 2023-02-17 02:01:26,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-17 02:01:26,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-17 02:01:26,165 DEBUG [(jenkins-hbase4.apache.org,36043,1676599281810)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42015,1676599281872 2023-02-17 02:01:26,165 DEBUG [(jenkins-hbase4.apache.org,36043,1676599281810)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-17 02:01:26,166 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37987-0x1006002b2390002, quorum=127.0.0.1:62873, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 02:01:26,166 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42015-0x1006002b2390001, quorum=127.0.0.1:62873, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 02:01:26,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-17 02:01:26,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-17 02:01:26,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-17 02:01:26,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-17 02:01:26,166 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-17 02:01:26,166 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-17 02:01:26,166 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-17 02:01:26,167 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-17 02:01:26,167 DEBUG [member: 'jenkins-hbase4.apache.org,42015,1676599281872' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-17 02:01:26,167 DEBUG [member: 'jenkins-hbase4.apache.org,42015,1676599281872' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-17 02:01:26,167 DEBUG [member: 'jenkins-hbase4.apache.org,37987,1676599281907' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-17 02:01:26,168 DEBUG [member: 'jenkins-hbase4.apache.org,42015,1676599281872' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-17 02:01:26,168 DEBUG [member: 'jenkins-hbase4.apache.org,37987,1676599281907' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-17 02:01:26,169 DEBUG [member: 'jenkins-hbase4.apache.org,37987,1676599281907' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-17 02:01:26,169 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1676599283172.d0c39439e95718da09586626dbdd1981. 2023-02-17 02:01:26,169 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676599283172.6fd84418026599548312cefaa7aa3bbe. 2023-02-17 02:01:26,169 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1676599283172.d0c39439e95718da09586626dbdd1981. started... 2023-02-17 02:01:26,169 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676599283172.6fd84418026599548312cefaa7aa3bbe. started... 2023-02-17 02:01:26,169 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 6fd84418026599548312cefaa7aa3bbe: 2023-02-17 02:01:26,169 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676599283172.6fd84418026599548312cefaa7aa3bbe. 2023-02-17 02:01:26,169 INFO [rs(jenkins-hbase4.apache.org,42015,1676599281872)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing d0c39439e95718da09586626dbdd1981 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-17 02:01:26,172 DEBUG [member: 'jenkins-hbase4.apache.org,42015,1676599281872' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-17 02:01:26,173 DEBUG [member: 'jenkins-hbase4.apache.org,42015,1676599281872' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-17 02:01:26,172 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1676599283172.3e671049091ae20efb4f185e13c8e87d. 2023-02-17 02:01:26,173 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1676599283172.c087f3b958f194282116d4bdcb846998. 2023-02-17 02:01:26,173 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1676599283172.0ac77707fded7da956ea2eaff472f1e5. 2023-02-17 02:01:26,173 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1676599283172.c087f3b958f194282116d4bdcb846998. started... 2023-02-17 02:01:26,173 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1676599283172.3e671049091ae20efb4f185e13c8e87d. started... 2023-02-17 02:01:26,173 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1676599283172.5b902d43bfac9401fc39fb36d68d8226. 2023-02-17 02:01:26,173 INFO [rs(jenkins-hbase4.apache.org,42015,1676599281872)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing c087f3b958f194282116d4bdcb846998 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-17 02:01:26,173 INFO [rs(jenkins-hbase4.apache.org,37987,1676599281907)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 3e671049091ae20efb4f185e13c8e87d 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-17 02:01:26,173 DEBUG [member: 'jenkins-hbase4.apache.org,37987,1676599281907' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-17 02:01:26,173 DEBUG [member: 'jenkins-hbase4.apache.org,37987,1676599281907' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-17 02:01:26,173 DEBUG [member: 'jenkins-hbase4.apache.org,42015,1676599281872' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-17 02:01:26,173 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1676599283172.5b902d43bfac9401fc39fb36d68d8226. started... 2023-02-17 02:01:26,173 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1676599283172.2320e8050ac479d9cc2f8e39be1d5e17. 2023-02-17 02:01:26,173 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 5b902d43bfac9401fc39fb36d68d8226: 2023-02-17 02:01:26,173 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1676599283172.0ac77707fded7da956ea2eaff472f1e5. started... 2023-02-17 02:01:26,173 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1676599283172.5b902d43bfac9401fc39fb36d68d8226. 2023-02-17 02:01:26,174 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1676599283172.2700e21ceee9ee6242041ee38fc8cdfa. 2023-02-17 02:01:26,174 DEBUG [member: 'jenkins-hbase4.apache.org,37987,1676599281907' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-17 02:01:26,174 INFO [rs(jenkins-hbase4.apache.org,37987,1676599281907)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 0ac77707fded7da956ea2eaff472f1e5 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-17 02:01:26,173 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1676599283172.2320e8050ac479d9cc2f8e39be1d5e17. started... 2023-02-17 02:01:26,174 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1676599283172.2700e21ceee9ee6242041ee38fc8cdfa. started... 2023-02-17 02:01:26,174 INFO [rs(jenkins-hbase4.apache.org,42015,1676599281872)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 2320e8050ac479d9cc2f8e39be1d5e17 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-17 02:01:26,174 INFO [rs(jenkins-hbase4.apache.org,37987,1676599281907)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 2700e21ceee9ee6242041ee38fc8cdfa 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-17 02:01:26,212 INFO [rs(jenkins-hbase4.apache.org,42015,1676599281872)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/d0c39439e95718da09586626dbdd1981/.tmp/f1/30a6867a787c4abbb837cbda9e5bb9c8 2023-02-17 02:01:26,216 INFO [rs(jenkins-hbase4.apache.org,37987,1676599281907)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/2700e21ceee9ee6242041ee38fc8cdfa/.tmp/f1/11efa123853f4ac9b33a2ec5d5354452 2023-02-17 02:01:26,231 INFO [rs(jenkins-hbase4.apache.org,42015,1676599281872)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/d0c39439e95718da09586626dbdd1981/.tmp/f2/0e686d6a339a483e8b70dc9e54437f68 2023-02-17 02:01:26,231 INFO [rs(jenkins-hbase4.apache.org,37987,1676599281907)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/2700e21ceee9ee6242041ee38fc8cdfa/.tmp/f2/bb9fb8371be3410685317d37dc139195 2023-02-17 02:01:26,237 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/2700e21ceee9ee6242041ee38fc8cdfa/.tmp/f1/11efa123853f4ac9b33a2ec5d5354452 as hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/2700e21ceee9ee6242041ee38fc8cdfa/f1/11efa123853f4ac9b33a2ec5d5354452 2023-02-17 02:01:26,237 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/d0c39439e95718da09586626dbdd1981/.tmp/f1/30a6867a787c4abbb837cbda9e5bb9c8 as hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/d0c39439e95718da09586626dbdd1981/f1/30a6867a787c4abbb837cbda9e5bb9c8 2023-02-17 02:01:26,242 INFO [rs(jenkins-hbase4.apache.org,37987,1676599281907)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/2700e21ceee9ee6242041ee38fc8cdfa/f1/11efa123853f4ac9b33a2ec5d5354452, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 02:01:26,243 INFO [rs(jenkins-hbase4.apache.org,42015,1676599281872)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/d0c39439e95718da09586626dbdd1981/f1/30a6867a787c4abbb837cbda9e5bb9c8, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 02:01:26,243 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/2700e21ceee9ee6242041ee38fc8cdfa/.tmp/f2/bb9fb8371be3410685317d37dc139195 as hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/2700e21ceee9ee6242041ee38fc8cdfa/f2/bb9fb8371be3410685317d37dc139195 2023-02-17 02:01:26,244 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/d0c39439e95718da09586626dbdd1981/.tmp/f2/0e686d6a339a483e8b70dc9e54437f68 as hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/d0c39439e95718da09586626dbdd1981/f2/0e686d6a339a483e8b70dc9e54437f68 2023-02-17 02:01:26,249 INFO [rs(jenkins-hbase4.apache.org,37987,1676599281907)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/2700e21ceee9ee6242041ee38fc8cdfa/f2/bb9fb8371be3410685317d37dc139195, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 02:01:26,250 INFO [rs(jenkins-hbase4.apache.org,42015,1676599281872)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/d0c39439e95718da09586626dbdd1981/f2/0e686d6a339a483e8b70dc9e54437f68, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 02:01:26,250 INFO [rs(jenkins-hbase4.apache.org,37987,1676599281907)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 2700e21ceee9ee6242041ee38fc8cdfa in 76ms, sequenceid=9, compaction requested=false 2023-02-17 02:01:26,251 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 2700e21ceee9ee6242041ee38fc8cdfa: 2023-02-17 02:01:26,251 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1676599283172.2700e21ceee9ee6242041ee38fc8cdfa. 2023-02-17 02:01:26,251 INFO [rs(jenkins-hbase4.apache.org,42015,1676599281872)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for d0c39439e95718da09586626dbdd1981 in 82ms, sequenceid=9, compaction requested=false 2023-02-17 02:01:26,251 DEBUG [member: 'jenkins-hbase4.apache.org,37987,1676599281907' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-17 02:01:26,251 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for d0c39439e95718da09586626dbdd1981: 2023-02-17 02:01:26,251 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1676599283172.76fb71705f76672ea40ce0d3b7341303. 2023-02-17 02:01:26,251 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1676599283172.d0c39439e95718da09586626dbdd1981. 2023-02-17 02:01:26,251 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1676599283172.76fb71705f76672ea40ce0d3b7341303. started... 2023-02-17 02:01:26,251 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1676599283172.6014956a2b3f63abad8cd3b17629b80c. 2023-02-17 02:01:26,251 DEBUG [member: 'jenkins-hbase4.apache.org,42015,1676599281872' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-17 02:01:26,251 INFO [rs(jenkins-hbase4.apache.org,37987,1676599281907)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 76fb71705f76672ea40ce0d3b7341303 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-17 02:01:26,251 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1676599283172.6014956a2b3f63abad8cd3b17629b80c. started... 2023-02-17 02:01:26,251 INFO [rs(jenkins-hbase4.apache.org,42015,1676599281872)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 6014956a2b3f63abad8cd3b17629b80c 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-17 02:01:26,269 INFO [rs(jenkins-hbase4.apache.org,37987,1676599281907)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/76fb71705f76672ea40ce0d3b7341303/.tmp/f1/327390476f384a268dff95a4575268b4 2023-02-17 02:01:26,271 INFO [rs(jenkins-hbase4.apache.org,42015,1676599281872)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/6014956a2b3f63abad8cd3b17629b80c/.tmp/f1/321dcff49d344228964cca7d8f45a2ec 2023-02-17 02:01:26,294 INFO [rs(jenkins-hbase4.apache.org,37987,1676599281907)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/76fb71705f76672ea40ce0d3b7341303/.tmp/f2/a144147125ed461e83e98f429550bad5 2023-02-17 02:01:26,299 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/76fb71705f76672ea40ce0d3b7341303/.tmp/f1/327390476f384a268dff95a4575268b4 as hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/76fb71705f76672ea40ce0d3b7341303/f1/327390476f384a268dff95a4575268b4 2023-02-17 02:01:26,304 INFO [rs(jenkins-hbase4.apache.org,37987,1676599281907)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/76fb71705f76672ea40ce0d3b7341303/f1/327390476f384a268dff95a4575268b4, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-17 02:01:26,305 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/76fb71705f76672ea40ce0d3b7341303/.tmp/f2/a144147125ed461e83e98f429550bad5 as hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/76fb71705f76672ea40ce0d3b7341303/f2/a144147125ed461e83e98f429550bad5 2023-02-17 02:01:26,310 INFO [rs(jenkins-hbase4.apache.org,37987,1676599281907)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/76fb71705f76672ea40ce0d3b7341303/f2/a144147125ed461e83e98f429550bad5, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-17 02:01:26,311 INFO [rs(jenkins-hbase4.apache.org,37987,1676599281907)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 76fb71705f76672ea40ce0d3b7341303 in 59ms, sequenceid=9, compaction requested=false 2023-02-17 02:01:26,311 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 76fb71705f76672ea40ce0d3b7341303: 2023-02-17 02:01:26,311 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1676599283172.76fb71705f76672ea40ce0d3b7341303. 2023-02-17 02:01:26,311 DEBUG [member: 'jenkins-hbase4.apache.org,37987,1676599281907' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-17 02:01:26,613 INFO [rs(jenkins-hbase4.apache.org,42015,1676599281872)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/c087f3b958f194282116d4bdcb846998/.tmp/f1/03eafd49fda041ed97180bc8eba07205 2023-02-17 02:01:26,616 INFO [rs(jenkins-hbase4.apache.org,37987,1676599281907)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/0ac77707fded7da956ea2eaff472f1e5/.tmp/f1/033a694bc2cc4129b023b68c0769c72d 2023-02-17 02:01:26,616 INFO [rs(jenkins-hbase4.apache.org,37987,1676599281907)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/3e671049091ae20efb4f185e13c8e87d/.tmp/f1/54a7268c30fa4b859344c4c394f0d2fe 2023-02-17 02:01:26,616 INFO [rs(jenkins-hbase4.apache.org,42015,1676599281872)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/2320e8050ac479d9cc2f8e39be1d5e17/.tmp/f1/7e77069d58ed4163a175470c42ae05c6 2023-02-17 02:01:26,633 INFO [rs(jenkins-hbase4.apache.org,37987,1676599281907)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/0ac77707fded7da956ea2eaff472f1e5/.tmp/f2/ad20a7b4efc0422984a5017abf3ea81b 2023-02-17 02:01:26,635 INFO [rs(jenkins-hbase4.apache.org,42015,1676599281872)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/c087f3b958f194282116d4bdcb846998/.tmp/f2/d3ec4fb4a51d4d7ba8a4ed421df74ccd 2023-02-17 02:01:26,636 INFO [rs(jenkins-hbase4.apache.org,42015,1676599281872)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/2320e8050ac479d9cc2f8e39be1d5e17/.tmp/f2/294307af946747db9c4bb7f678ba6309 2023-02-17 02:01:26,637 INFO [rs(jenkins-hbase4.apache.org,37987,1676599281907)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/3e671049091ae20efb4f185e13c8e87d/.tmp/f2/dcf443038c5042f28f9427fee6eef4c5 2023-02-17 02:01:26,641 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/0ac77707fded7da956ea2eaff472f1e5/.tmp/f1/033a694bc2cc4129b023b68c0769c72d as hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/0ac77707fded7da956ea2eaff472f1e5/f1/033a694bc2cc4129b023b68c0769c72d 2023-02-17 02:01:26,641 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/c087f3b958f194282116d4bdcb846998/.tmp/f1/03eafd49fda041ed97180bc8eba07205 as hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/c087f3b958f194282116d4bdcb846998/f1/03eafd49fda041ed97180bc8eba07205 2023-02-17 02:01:26,643 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/2320e8050ac479d9cc2f8e39be1d5e17/.tmp/f1/7e77069d58ed4163a175470c42ae05c6 as hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/2320e8050ac479d9cc2f8e39be1d5e17/f1/7e77069d58ed4163a175470c42ae05c6 2023-02-17 02:01:26,646 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/3e671049091ae20efb4f185e13c8e87d/.tmp/f1/54a7268c30fa4b859344c4c394f0d2fe as hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/3e671049091ae20efb4f185e13c8e87d/f1/54a7268c30fa4b859344c4c394f0d2fe 2023-02-17 02:01:26,647 INFO [rs(jenkins-hbase4.apache.org,37987,1676599281907)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/0ac77707fded7da956ea2eaff472f1e5/f1/033a694bc2cc4129b023b68c0769c72d, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 02:01:26,647 INFO [rs(jenkins-hbase4.apache.org,42015,1676599281872)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/c087f3b958f194282116d4bdcb846998/f1/03eafd49fda041ed97180bc8eba07205, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-17 02:01:26,648 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/0ac77707fded7da956ea2eaff472f1e5/.tmp/f2/ad20a7b4efc0422984a5017abf3ea81b as hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/0ac77707fded7da956ea2eaff472f1e5/f2/ad20a7b4efc0422984a5017abf3ea81b 2023-02-17 02:01:26,648 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/c087f3b958f194282116d4bdcb846998/.tmp/f2/d3ec4fb4a51d4d7ba8a4ed421df74ccd as hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/c087f3b958f194282116d4bdcb846998/f2/d3ec4fb4a51d4d7ba8a4ed421df74ccd 2023-02-17 02:01:26,648 INFO [rs(jenkins-hbase4.apache.org,42015,1676599281872)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/2320e8050ac479d9cc2f8e39be1d5e17/f1/7e77069d58ed4163a175470c42ae05c6, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 02:01:26,649 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/2320e8050ac479d9cc2f8e39be1d5e17/.tmp/f2/294307af946747db9c4bb7f678ba6309 as hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/2320e8050ac479d9cc2f8e39be1d5e17/f2/294307af946747db9c4bb7f678ba6309 2023-02-17 02:01:26,654 INFO [rs(jenkins-hbase4.apache.org,42015,1676599281872)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/c087f3b958f194282116d4bdcb846998/f2/d3ec4fb4a51d4d7ba8a4ed421df74ccd, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-17 02:01:26,654 INFO [rs(jenkins-hbase4.apache.org,42015,1676599281872)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/2320e8050ac479d9cc2f8e39be1d5e17/f2/294307af946747db9c4bb7f678ba6309, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 02:01:26,655 INFO [rs(jenkins-hbase4.apache.org,42015,1676599281872)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for c087f3b958f194282116d4bdcb846998 in 482ms, sequenceid=9, compaction requested=false 2023-02-17 02:01:26,655 INFO [rs(jenkins-hbase4.apache.org,42015,1676599281872)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 2320e8050ac479d9cc2f8e39be1d5e17 in 481ms, sequenceid=9, compaction requested=false 2023-02-17 02:01:26,655 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for c087f3b958f194282116d4bdcb846998: 2023-02-17 02:01:26,655 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 2320e8050ac479d9cc2f8e39be1d5e17: 2023-02-17 02:01:26,655 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1676599283172.c087f3b958f194282116d4bdcb846998. 2023-02-17 02:01:26,655 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1676599283172.2320e8050ac479d9cc2f8e39be1d5e17. 2023-02-17 02:01:26,655 DEBUG [member: 'jenkins-hbase4.apache.org,42015,1676599281872' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-17 02:01:26,655 DEBUG [member: 'jenkins-hbase4.apache.org,42015,1676599281872' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-17 02:01:26,661 INFO [rs(jenkins-hbase4.apache.org,37987,1676599281907)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/3e671049091ae20efb4f185e13c8e87d/f1/54a7268c30fa4b859344c4c394f0d2fe, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 02:01:26,661 INFO [rs(jenkins-hbase4.apache.org,37987,1676599281907)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/0ac77707fded7da956ea2eaff472f1e5/f2/ad20a7b4efc0422984a5017abf3ea81b, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 02:01:26,662 INFO [rs(jenkins-hbase4.apache.org,37987,1676599281907)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 0ac77707fded7da956ea2eaff472f1e5 in 488ms, sequenceid=9, compaction requested=false 2023-02-17 02:01:26,662 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/3e671049091ae20efb4f185e13c8e87d/.tmp/f2/dcf443038c5042f28f9427fee6eef4c5 as hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/3e671049091ae20efb4f185e13c8e87d/f2/dcf443038c5042f28f9427fee6eef4c5 2023-02-17 02:01:26,662 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 0ac77707fded7da956ea2eaff472f1e5: 2023-02-17 02:01:26,662 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1676599283172.0ac77707fded7da956ea2eaff472f1e5. 2023-02-17 02:01:26,662 DEBUG [member: 'jenkins-hbase4.apache.org,37987,1676599281907' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-17 02:01:26,667 INFO [rs(jenkins-hbase4.apache.org,37987,1676599281907)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/3e671049091ae20efb4f185e13c8e87d/f2/dcf443038c5042f28f9427fee6eef4c5, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 02:01:26,668 INFO [rs(jenkins-hbase4.apache.org,37987,1676599281907)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 3e671049091ae20efb4f185e13c8e87d in 495ms, sequenceid=9, compaction requested=false 2023-02-17 02:01:26,668 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 3e671049091ae20efb4f185e13c8e87d: 2023-02-17 02:01:26,668 DEBUG [rs(jenkins-hbase4.apache.org,37987,1676599281907)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1676599283172.3e671049091ae20efb4f185e13c8e87d. 2023-02-17 02:01:26,668 DEBUG [member: 'jenkins-hbase4.apache.org,37987,1676599281907' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-17 02:01:26,668 DEBUG [member: 'jenkins-hbase4.apache.org,37987,1676599281907' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-17 02:01:26,668 DEBUG [member: 'jenkins-hbase4.apache.org,37987,1676599281907' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37987,1676599281907 2023-02-17 02:01:26,668 DEBUG [member: 'jenkins-hbase4.apache.org,37987,1676599281907' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-17 02:01:26,668 DEBUG [member: 'jenkins-hbase4.apache.org,37987,1676599281907' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37987,1676599281907' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-17 02:01:26,694 INFO [rs(jenkins-hbase4.apache.org,42015,1676599281872)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/6014956a2b3f63abad8cd3b17629b80c/.tmp/f2/2b2c7608b537482d970678d400b238b4 2023-02-17 02:01:26,700 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/6014956a2b3f63abad8cd3b17629b80c/.tmp/f1/321dcff49d344228964cca7d8f45a2ec as hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/6014956a2b3f63abad8cd3b17629b80c/f1/321dcff49d344228964cca7d8f45a2ec 2023-02-17 02:01:26,705 INFO [rs(jenkins-hbase4.apache.org,42015,1676599281872)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/6014956a2b3f63abad8cd3b17629b80c/f1/321dcff49d344228964cca7d8f45a2ec, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 02:01:26,706 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/6014956a2b3f63abad8cd3b17629b80c/.tmp/f2/2b2c7608b537482d970678d400b238b4 as hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/6014956a2b3f63abad8cd3b17629b80c/f2/2b2c7608b537482d970678d400b238b4 2023-02-17 02:01:26,711 INFO [rs(jenkins-hbase4.apache.org,42015,1676599281872)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/6014956a2b3f63abad8cd3b17629b80c/f2/2b2c7608b537482d970678d400b238b4, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 02:01:26,711 INFO [rs(jenkins-hbase4.apache.org,42015,1676599281872)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 6014956a2b3f63abad8cd3b17629b80c in 460ms, sequenceid=9, compaction requested=false 2023-02-17 02:01:26,712 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 6014956a2b3f63abad8cd3b17629b80c: 2023-02-17 02:01:26,712 DEBUG [rs(jenkins-hbase4.apache.org,42015,1676599281872)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1676599283172.6014956a2b3f63abad8cd3b17629b80c. 2023-02-17 02:01:26,712 DEBUG [member: 'jenkins-hbase4.apache.org,42015,1676599281872' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-17 02:01:26,712 DEBUG [member: 'jenkins-hbase4.apache.org,42015,1676599281872' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-17 02:01:26,712 DEBUG [member: 'jenkins-hbase4.apache.org,42015,1676599281872' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42015,1676599281872 2023-02-17 02:01:26,712 DEBUG [member: 'jenkins-hbase4.apache.org,42015,1676599281872' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-17 02:01:26,712 DEBUG [member: 'jenkins-hbase4.apache.org,42015,1676599281872' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42015,1676599281872' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-17 02:01:26,718 DEBUG [member: 'jenkins-hbase4.apache.org,37987,1676599281907' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 02:01:26,718 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,37987,1676599281907 2023-02-17 02:01:26,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,37987,1676599281907 2023-02-17 02:01:26,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 02:01:26,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-17 02:01:26,779 DEBUG [member: 'jenkins-hbase4.apache.org,42015,1676599281872' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 02:01:26,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 02:01:26,779 DEBUG [member: 'jenkins-hbase4.apache.org,37987,1676599281907' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37987-0x1006002b2390002, quorum=127.0.0.1:62873, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 02:01:26,779 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42015,1676599281872 2023-02-17 02:01:26,779 DEBUG [member: 'jenkins-hbase4.apache.org,37987,1676599281907' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 02:01:26,780 DEBUG [member: 'jenkins-hbase4.apache.org,42015,1676599281872' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42015-0x1006002b2390001, quorum=127.0.0.1:62873, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 02:01:26,780 DEBUG [member: 'jenkins-hbase4.apache.org,42015,1676599281872' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 02:01:26,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 02:01:26,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-17 02:01:26,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42015,1676599281872 2023-02-17 02:01:26,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37987,1676599281907 2023-02-17 02:01:26,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 02:01:26,781 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37987,1676599281907' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-17 02:01:26,781 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1092cfd3[Count = 1] remaining members to acquire global barrier 2023-02-17 02:01:26,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42015,1676599281872 2023-02-17 02:01:26,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 02:01:26,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-17 02:01:26,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 02:01:26,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 02:01:26,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-17 02:01:26,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42015,1676599281872 2023-02-17 02:01:26,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37987,1676599281907 2023-02-17 02:01:26,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 02:01:26,783 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42015,1676599281872' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-17 02:01:26,783 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1092cfd3[Count = 0] remaining members to acquire global barrier 2023-02-17 02:01:26,783 DEBUG [(jenkins-hbase4.apache.org,36043,1676599281810)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-17 02:01:26,783 DEBUG [(jenkins-hbase4.apache.org,36043,1676599281810)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 02:01:26,833 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): regionserver:37987-0x1006002b2390002, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 02:01:26,833 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): regionserver:42015-0x1006002b2390001, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 02:01:26,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 02:01:26,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 02:01:26,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 02:01:26,834 DEBUG [(jenkins-hbase4.apache.org,36043,1676599281810)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,37987,1676599281907 2023-02-17 02:01:26,834 DEBUG [member: 'jenkins-hbase4.apache.org,42015,1676599281872' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-17 02:01:26,834 DEBUG [member: 'jenkins-hbase4.apache.org,42015,1676599281872' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-17 02:01:26,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 02:01:26,834 DEBUG [member: 'jenkins-hbase4.apache.org,42015,1676599281872' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,42015,1676599281872' in zk 2023-02-17 02:01:26,834 DEBUG [member: 'jenkins-hbase4.apache.org,37987,1676599281907' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-17 02:01:26,834 DEBUG [member: 'jenkins-hbase4.apache.org,37987,1676599281907' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-17 02:01:26,834 DEBUG [member: 'jenkins-hbase4.apache.org,37987,1676599281907' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,37987,1676599281907' in zk 2023-02-17 02:01:26,834 DEBUG [(jenkins-hbase4.apache.org,36043,1676599281810)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,42015,1676599281872 2023-02-17 02:01:26,834 DEBUG [(jenkins-hbase4.apache.org,36043,1676599281810)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-17 02:01:26,895 DEBUG [member: 'jenkins-hbase4.apache.org,42015,1676599281872' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-17 02:01:26,895 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,42015,1676599281872 2023-02-17 02:01:26,895 DEBUG [member: 'jenkins-hbase4.apache.org,42015,1676599281872' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 02:01:26,895 DEBUG [member: 'jenkins-hbase4.apache.org,42015,1676599281872' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-17 02:01:26,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,42015,1676599281872 2023-02-17 02:01:26,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 02:01:26,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-17 02:01:26,964 DEBUG [member: 'jenkins-hbase4.apache.org,37987,1676599281907' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-17 02:01:26,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 02:01:26,964 DEBUG [member: 'jenkins-hbase4.apache.org,37987,1676599281907' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 02:01:26,964 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,37987,1676599281907 2023-02-17 02:01:26,964 DEBUG [member: 'jenkins-hbase4.apache.org,37987,1676599281907' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-17 02:01:26,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 02:01:26,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-17 02:01:26,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42015,1676599281872 2023-02-17 02:01:26,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37987,1676599281907 2023-02-17 02:01:26,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 02:01:26,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-17 02:01:26,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42015,1676599281872 2023-02-17 02:01:26,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37987,1676599281907 2023-02-17 02:01:26,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,42015,1676599281872': 2023-02-17 02:01:26,969 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42015,1676599281872' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-17 02:01:26,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,37987,1676599281907 2023-02-17 02:01:26,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 02:01:26,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-17 02:01:26,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 02:01:26,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 02:01:26,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-17 02:01:26,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42015,1676599281872 2023-02-17 02:01:26,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37987,1676599281907 2023-02-17 02:01:26,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 02:01:26,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-17 02:01:26,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42015,1676599281872 2023-02-17 02:01:26,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37987,1676599281907 2023-02-17 02:01:26,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,37987,1676599281907': 2023-02-17 02:01:26,973 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37987,1676599281907' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-17 02:01:26,973 INFO [(jenkins-hbase4.apache.org,36043,1676599281810)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-17 02:01:26,973 DEBUG [(jenkins-hbase4.apache.org,36043,1676599281810)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-17 02:01:26,973 DEBUG [(jenkins-hbase4.apache.org,36043,1676599281810)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-17 02:01:26,973 DEBUG [(jenkins-hbase4.apache.org,36043,1676599281810)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-17 02:01:26,973 INFO [(jenkins-hbase4.apache.org,36043,1676599281810)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-17 02:01:27,033 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 02:01:27,033 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): regionserver:42015-0x1006002b2390001, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 02:01:27,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 02:01:27,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 02:01:27,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-17 02:01:27,033 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): regionserver:37987-0x1006002b2390002, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 02:01:27,034 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 02:01:27,034 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 02:01:27,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 02:01:27,034 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): regionserver:42015-0x1006002b2390001, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 02:01:27,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 02:01:27,034 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): regionserver:37987-0x1006002b2390002, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 02:01:27,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 02:01:27,035 DEBUG [(jenkins-hbase4.apache.org,36043,1676599281810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42015,1676599281872 2023-02-17 02:01:27,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 02:01:27,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 02:01:27,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 02:01:27,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 02:01:27,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-17 02:01:27,035 DEBUG [(jenkins-hbase4.apache.org,36043,1676599281810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,37987,1676599281907 2023-02-17 02:01:27,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 02:01:27,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 02:01:27,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 02:01:27,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-17 02:01:27,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42015,1676599281872 2023-02-17 02:01:27,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37987,1676599281907 2023-02-17 02:01:27,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 02:01:27,037 DEBUG [(jenkins-hbase4.apache.org,36043,1676599281810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,42015,1676599281872 2023-02-17 02:01:27,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-17 02:01:27,038 DEBUG [(jenkins-hbase4.apache.org,36043,1676599281810)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,37987,1676599281907 2023-02-17 02:01:27,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42015,1676599281872 2023-02-17 02:01:27,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37987,1676599281907 2023-02-17 02:01:27,118 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,37987,1676599281907 2023-02-17 02:01:27,118 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-17 02:01:27,119 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): regionserver:37987-0x1006002b2390002, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 02:01:27,119 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): regionserver:42015-0x1006002b2390001, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 02:01:27,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 02:01:27,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 02:01:27,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 02:01:27,119 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): regionserver:42015-0x1006002b2390001, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 02:01:27,119 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42015,1676599281872 2023-02-17 02:01:27,119 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): regionserver:37987-0x1006002b2390002, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 02:01:27,119 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-17 02:01:27,119 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36043] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-17 02:01:27,119 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36043] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-17 02:01:27,119 DEBUG [(jenkins-hbase4.apache.org,36043,1676599281810)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 02:01:27,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 02:01:27,119 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,37987,1676599281907 2023-02-17 02:01:27,120 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 02:01:27,121 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,42015,1676599281872 2023-02-17 02:01:27,121 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 02:01:27,121 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 02:01:27,121 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 02:01:27,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 02:01:27,121 DEBUG [Listener at localhost/46551] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-17 02:01:27,121 DEBUG [Listener at localhost/46551] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-17 02:01:27,121 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 02:01:27,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 02:01:27,221 DEBUG [Listener at localhost/46551] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-17 02:01:27,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36043] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-17 02:01:27,223 INFO [Listener at localhost/46551] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-17 02:01:27,225 DEBUG [Listener at localhost/46551] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x56249e02 to 127.0.0.1:62873 2023-02-17 02:01:27,225 DEBUG [Listener at localhost/46551] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 02:01:27,225 DEBUG [Listener at localhost/46551] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-17 02:01:27,225 DEBUG [Listener at localhost/46551] util.JVMClusterUtil(257): Found active master hash=1045836275, stopped=false 2023-02-17 02:01:27,225 INFO [Listener at localhost/46551] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,36043,1676599281810 2023-02-17 02:01:27,410 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): regionserver:37987-0x1006002b2390002, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-17 02:01:27,410 INFO [Listener at localhost/46551] procedure2.ProcedureExecutor(629): Stopping 2023-02-17 02:01:27,410 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): regionserver:42015-0x1006002b2390001, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-17 02:01:27,410 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-17 02:01:27,412 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 02:01:27,412 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37987-0x1006002b2390002, quorum=127.0.0.1:62873, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 02:01:27,412 DEBUG [Listener at localhost/46551] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1087185d to 127.0.0.1:62873 2023-02-17 02:01:27,412 DEBUG [Listener at localhost/46551] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 02:01:27,412 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 02:01:27,412 INFO [Listener at localhost/46551] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,42015,1676599281872' ***** 2023-02-17 02:01:27,412 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42015-0x1006002b2390001, quorum=127.0.0.1:62873, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 02:01:27,412 INFO [Listener at localhost/46551] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-17 02:01:27,413 INFO [Listener at localhost/46551] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,37987,1676599281907' ***** 2023-02-17 02:01:27,413 INFO [Listener at localhost/46551] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-17 02:01:27,413 INFO [RS:0;jenkins-hbase4:42015] regionserver.HeapMemoryManager(220): Stopping 2023-02-17 02:01:27,413 INFO [RS:1;jenkins-hbase4:37987] regionserver.HeapMemoryManager(220): Stopping 2023-02-17 02:01:27,413 INFO [RS:0;jenkins-hbase4:42015] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-17 02:01:27,413 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-17 02:01:27,413 INFO [RS:0;jenkins-hbase4:42015] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-17 02:01:27,413 INFO [RS:1;jenkins-hbase4:37987] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-17 02:01:27,413 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-17 02:01:27,414 INFO [RS:1;jenkins-hbase4:37987] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-17 02:01:27,414 INFO [RS:0;jenkins-hbase4:42015] regionserver.HRegionServer(3304): Received CLOSE for b16a80a118e9e9e6f4ef40d996157ccb 2023-02-17 02:01:27,415 INFO [RS:1;jenkins-hbase4:37987] regionserver.HRegionServer(3304): Received CLOSE for 3e671049091ae20efb4f185e13c8e87d 2023-02-17 02:01:27,415 INFO [RS:0;jenkins-hbase4:42015] regionserver.HRegionServer(3304): Received CLOSE for d0c39439e95718da09586626dbdd1981 2023-02-17 02:01:27,415 INFO [RS:0;jenkins-hbase4:42015] regionserver.HRegionServer(3304): Received CLOSE for 6fd84418026599548312cefaa7aa3bbe 2023-02-17 02:01:27,415 INFO [RS:0;jenkins-hbase4:42015] regionserver.HRegionServer(3304): Received CLOSE for 2320e8050ac479d9cc2f8e39be1d5e17 2023-02-17 02:01:27,415 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing b16a80a118e9e9e6f4ef40d996157ccb, disabling compactions & flushes 2023-02-17 02:01:27,415 INFO [RS:0;jenkins-hbase4:42015] regionserver.HRegionServer(3304): Received CLOSE for c087f3b958f194282116d4bdcb846998 2023-02-17 02:01:27,415 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676599282556.b16a80a118e9e9e6f4ef40d996157ccb. 2023-02-17 02:01:27,415 INFO [RS:0;jenkins-hbase4:42015] regionserver.HRegionServer(3304): Received CLOSE for 6014956a2b3f63abad8cd3b17629b80c 2023-02-17 02:01:27,416 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676599282556.b16a80a118e9e9e6f4ef40d996157ccb. 2023-02-17 02:01:27,416 INFO [RS:0;jenkins-hbase4:42015] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,42015,1676599281872 2023-02-17 02:01:27,416 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676599282556.b16a80a118e9e9e6f4ef40d996157ccb. after waiting 0 ms 2023-02-17 02:01:27,416 DEBUG [RS:0;jenkins-hbase4:42015] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x162b01c5 to 127.0.0.1:62873 2023-02-17 02:01:27,416 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676599282556.b16a80a118e9e9e6f4ef40d996157ccb. 2023-02-17 02:01:27,416 DEBUG [RS:0;jenkins-hbase4:42015] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 02:01:27,416 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing b16a80a118e9e9e6f4ef40d996157ccb 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-17 02:01:27,416 INFO [RS:0;jenkins-hbase4:42015] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-17 02:01:27,416 INFO [RS:0;jenkins-hbase4:42015] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-17 02:01:27,416 INFO [RS:0;jenkins-hbase4:42015] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-17 02:01:27,416 INFO [RS:0;jenkins-hbase4:42015] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-17 02:01:27,418 INFO [RS:1;jenkins-hbase4:37987] regionserver.HRegionServer(3304): Received CLOSE for 5b902d43bfac9401fc39fb36d68d8226 2023-02-17 02:01:27,418 INFO [RS:0;jenkins-hbase4:42015] regionserver.HRegionServer(1475): Waiting on 7 regions to close 2023-02-17 02:01:27,418 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 3e671049091ae20efb4f185e13c8e87d, disabling compactions & flushes 2023-02-17 02:01:27,418 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-17 02:01:27,418 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676599283172.3e671049091ae20efb4f185e13c8e87d. 2023-02-17 02:01:27,418 DEBUG [RS:0;jenkins-hbase4:42015] regionserver.HRegionServer(1479): Online Regions={b16a80a118e9e9e6f4ef40d996157ccb=hbase:namespace,,1676599282556.b16a80a118e9e9e6f4ef40d996157ccb., d0c39439e95718da09586626dbdd1981=testWithMapReduce,d\x84\x84,1676599283172.d0c39439e95718da09586626dbdd1981., 6fd84418026599548312cefaa7aa3bbe=testWithMapReduce,,1676599283172.6fd84418026599548312cefaa7aa3bbe., 2320e8050ac479d9cc2f8e39be1d5e17=testWithMapReduce,j\xCA\xCA,1676599283172.2320e8050ac479d9cc2f8e39be1d5e17., 1588230740=hbase:meta,,1.1588230740, c087f3b958f194282116d4bdcb846998=testWithMapReduce,wWV,1676599283172.c087f3b958f194282116d4bdcb846998., 6014956a2b3f63abad8cd3b17629b80c=testWithMapReduce,q\x11\x10,1676599283172.6014956a2b3f63abad8cd3b17629b80c.} 2023-02-17 02:01:27,418 INFO [RS:1;jenkins-hbase4:37987] regionserver.HRegionServer(3304): Received CLOSE for 0ac77707fded7da956ea2eaff472f1e5 2023-02-17 02:01:27,418 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676599283172.3e671049091ae20efb4f185e13c8e87d. 2023-02-17 02:01:27,418 INFO [RS:1;jenkins-hbase4:37987] regionserver.HRegionServer(3304): Received CLOSE for 2700e21ceee9ee6242041ee38fc8cdfa 2023-02-17 02:01:27,418 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-17 02:01:27,418 INFO [RS:1;jenkins-hbase4:37987] regionserver.HRegionServer(3304): Received CLOSE for 76fb71705f76672ea40ce0d3b7341303 2023-02-17 02:01:27,418 DEBUG [RS:0;jenkins-hbase4:42015] regionserver.HRegionServer(1505): Waiting on 1588230740, 2320e8050ac479d9cc2f8e39be1d5e17, 6014956a2b3f63abad8cd3b17629b80c, 6fd84418026599548312cefaa7aa3bbe, b16a80a118e9e9e6f4ef40d996157ccb, c087f3b958f194282116d4bdcb846998, d0c39439e95718da09586626dbdd1981 2023-02-17 02:01:27,418 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676599283172.3e671049091ae20efb4f185e13c8e87d. after waiting 0 ms 2023-02-17 02:01:27,418 INFO [RS:1;jenkins-hbase4:37987] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,37987,1676599281907 2023-02-17 02:01:27,418 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-17 02:01:27,418 DEBUG [RS:1;jenkins-hbase4:37987] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x48e5bfe1 to 127.0.0.1:62873 2023-02-17 02:01:27,418 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-17 02:01:27,418 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676599283172.3e671049091ae20efb4f185e13c8e87d. 2023-02-17 02:01:27,419 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-17 02:01:27,419 DEBUG [RS:1;jenkins-hbase4:37987] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 02:01:27,419 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=13.95 KB heapSize=23.05 KB 2023-02-17 02:01:27,419 INFO [RS:1;jenkins-hbase4:37987] regionserver.HRegionServer(1475): Waiting on 5 regions to close 2023-02-17 02:01:27,419 DEBUG [RS:1;jenkins-hbase4:37987] regionserver.HRegionServer(1479): Online Regions={3e671049091ae20efb4f185e13c8e87d=testWithMapReduce,m\xED\xED,1676599283172.3e671049091ae20efb4f185e13c8e87d., 5b902d43bfac9401fc39fb36d68d8226=testWithMapReduce,zz{,1676599283172.5b902d43bfac9401fc39fb36d68d8226., 0ac77707fded7da956ea2eaff472f1e5=testWithMapReduce,t43,1676599283172.0ac77707fded7da956ea2eaff472f1e5., 2700e21ceee9ee6242041ee38fc8cdfa=testWithMapReduce,g\xA7\xA7,1676599283172.2700e21ceee9ee6242041ee38fc8cdfa., 76fb71705f76672ea40ce0d3b7341303=testWithMapReduce,aaa,1676599283172.76fb71705f76672ea40ce0d3b7341303.} 2023-02-17 02:01:27,419 DEBUG [RS:1;jenkins-hbase4:37987] regionserver.HRegionServer(1505): Waiting on 0ac77707fded7da956ea2eaff472f1e5, 2700e21ceee9ee6242041ee38fc8cdfa, 3e671049091ae20efb4f185e13c8e87d, 5b902d43bfac9401fc39fb36d68d8226, 76fb71705f76672ea40ce0d3b7341303 2023-02-17 02:01:27,442 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-17 02:01:27,442 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-17 02:01:27,454 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/3e671049091ae20efb4f185e13c8e87d/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 02:01:27,455 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676599283172.3e671049091ae20efb4f185e13c8e87d. 2023-02-17 02:01:27,455 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 3e671049091ae20efb4f185e13c8e87d: 2023-02-17 02:01:27,455 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,m\xED\xED,1676599283172.3e671049091ae20efb4f185e13c8e87d. 2023-02-17 02:01:27,456 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 5b902d43bfac9401fc39fb36d68d8226, disabling compactions & flushes 2023-02-17 02:01:27,456 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676599283172.5b902d43bfac9401fc39fb36d68d8226. 2023-02-17 02:01:27,456 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676599283172.5b902d43bfac9401fc39fb36d68d8226. 2023-02-17 02:01:27,456 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676599283172.5b902d43bfac9401fc39fb36d68d8226. after waiting 0 ms 2023-02-17 02:01:27,456 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676599283172.5b902d43bfac9401fc39fb36d68d8226. 2023-02-17 02:01:27,468 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/hbase/namespace/b16a80a118e9e9e6f4ef40d996157ccb/.tmp/info/4e146e19012d4540af16b96b72ae0add 2023-02-17 02:01:27,468 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/5b902d43bfac9401fc39fb36d68d8226/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-17 02:01:27,470 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676599283172.5b902d43bfac9401fc39fb36d68d8226. 2023-02-17 02:01:27,470 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=13.76 KB at sequenceid=32 (bloomFilter=false), to=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/hbase/meta/1588230740/.tmp/info/206bd046b2014bf2b2bace6eb5933d93 2023-02-17 02:01:27,470 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 5b902d43bfac9401fc39fb36d68d8226: 2023-02-17 02:01:27,470 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,zz{,1676599283172.5b902d43bfac9401fc39fb36d68d8226. 2023-02-17 02:01:27,470 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 0ac77707fded7da956ea2eaff472f1e5, disabling compactions & flushes 2023-02-17 02:01:27,470 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676599283172.0ac77707fded7da956ea2eaff472f1e5. 2023-02-17 02:01:27,470 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676599283172.0ac77707fded7da956ea2eaff472f1e5. 2023-02-17 02:01:27,471 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676599283172.0ac77707fded7da956ea2eaff472f1e5. after waiting 0 ms 2023-02-17 02:01:27,471 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676599283172.0ac77707fded7da956ea2eaff472f1e5. 2023-02-17 02:01:27,480 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/0ac77707fded7da956ea2eaff472f1e5/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 02:01:27,480 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/hbase/namespace/b16a80a118e9e9e6f4ef40d996157ccb/.tmp/info/4e146e19012d4540af16b96b72ae0add as hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/hbase/namespace/b16a80a118e9e9e6f4ef40d996157ccb/info/4e146e19012d4540af16b96b72ae0add 2023-02-17 02:01:27,482 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676599283172.0ac77707fded7da956ea2eaff472f1e5. 2023-02-17 02:01:27,482 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 0ac77707fded7da956ea2eaff472f1e5: 2023-02-17 02:01:27,482 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,t43,1676599283172.0ac77707fded7da956ea2eaff472f1e5. 2023-02-17 02:01:27,482 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 2700e21ceee9ee6242041ee38fc8cdfa, disabling compactions & flushes 2023-02-17 02:01:27,482 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676599283172.2700e21ceee9ee6242041ee38fc8cdfa. 2023-02-17 02:01:27,482 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676599283172.2700e21ceee9ee6242041ee38fc8cdfa. 2023-02-17 02:01:27,482 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676599283172.2700e21ceee9ee6242041ee38fc8cdfa. after waiting 0 ms 2023-02-17 02:01:27,482 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676599283172.2700e21ceee9ee6242041ee38fc8cdfa. 2023-02-17 02:01:27,493 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/hbase/namespace/b16a80a118e9e9e6f4ef40d996157ccb/info/4e146e19012d4540af16b96b72ae0add, entries=2, sequenceid=6, filesize=4.8 K 2023-02-17 02:01:27,500 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for b16a80a118e9e9e6f4ef40d996157ccb in 84ms, sequenceid=6, compaction requested=false 2023-02-17 02:01:27,500 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-17 02:01:27,501 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/2700e21ceee9ee6242041ee38fc8cdfa/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 02:01:27,504 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676599283172.2700e21ceee9ee6242041ee38fc8cdfa. 2023-02-17 02:01:27,504 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 2700e21ceee9ee6242041ee38fc8cdfa: 2023-02-17 02:01:27,504 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,g\xA7\xA7,1676599283172.2700e21ceee9ee6242041ee38fc8cdfa. 2023-02-17 02:01:27,504 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 76fb71705f76672ea40ce0d3b7341303, disabling compactions & flushes 2023-02-17 02:01:27,504 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676599283172.76fb71705f76672ea40ce0d3b7341303. 2023-02-17 02:01:27,504 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676599283172.76fb71705f76672ea40ce0d3b7341303. 2023-02-17 02:01:27,504 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676599283172.76fb71705f76672ea40ce0d3b7341303. after waiting 0 ms 2023-02-17 02:01:27,504 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676599283172.76fb71705f76672ea40ce0d3b7341303. 2023-02-17 02:01:27,513 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/hbase/namespace/b16a80a118e9e9e6f4ef40d996157ccb/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-17 02:01:27,515 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=192 B at sequenceid=32 (bloomFilter=false), to=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/hbase/meta/1588230740/.tmp/table/d8f0b7b9503f49e7bbfd2a2d6c283458 2023-02-17 02:01:27,521 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676599282556.b16a80a118e9e9e6f4ef40d996157ccb. 2023-02-17 02:01:27,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for b16a80a118e9e9e6f4ef40d996157ccb: 2023-02-17 02:01:27,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676599282556.b16a80a118e9e9e6f4ef40d996157ccb. 2023-02-17 02:01:27,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing d0c39439e95718da09586626dbdd1981, disabling compactions & flushes 2023-02-17 02:01:27,521 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676599283172.d0c39439e95718da09586626dbdd1981. 2023-02-17 02:01:27,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676599283172.d0c39439e95718da09586626dbdd1981. 2023-02-17 02:01:27,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676599283172.d0c39439e95718da09586626dbdd1981. after waiting 0 ms 2023-02-17 02:01:27,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676599283172.d0c39439e95718da09586626dbdd1981. 2023-02-17 02:01:27,524 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/76fb71705f76672ea40ce0d3b7341303/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 02:01:27,526 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676599283172.76fb71705f76672ea40ce0d3b7341303. 2023-02-17 02:01:27,526 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 76fb71705f76672ea40ce0d3b7341303: 2023-02-17 02:01:27,526 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,aaa,1676599283172.76fb71705f76672ea40ce0d3b7341303. 2023-02-17 02:01:27,527 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/hbase/meta/1588230740/.tmp/info/206bd046b2014bf2b2bace6eb5933d93 as hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/hbase/meta/1588230740/info/206bd046b2014bf2b2bace6eb5933d93 2023-02-17 02:01:27,527 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/d0c39439e95718da09586626dbdd1981/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 02:01:27,529 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676599283172.d0c39439e95718da09586626dbdd1981. 2023-02-17 02:01:27,529 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for d0c39439e95718da09586626dbdd1981: 2023-02-17 02:01:27,529 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,d\x84\x84,1676599283172.d0c39439e95718da09586626dbdd1981. 2023-02-17 02:01:27,529 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 6fd84418026599548312cefaa7aa3bbe, disabling compactions & flushes 2023-02-17 02:01:27,529 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676599283172.6fd84418026599548312cefaa7aa3bbe. 2023-02-17 02:01:27,529 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676599283172.6fd84418026599548312cefaa7aa3bbe. 2023-02-17 02:01:27,529 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676599283172.6fd84418026599548312cefaa7aa3bbe. after waiting 0 ms 2023-02-17 02:01:27,529 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676599283172.6fd84418026599548312cefaa7aa3bbe. 2023-02-17 02:01:27,532 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/6fd84418026599548312cefaa7aa3bbe/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-17 02:01:27,535 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676599283172.6fd84418026599548312cefaa7aa3bbe. 2023-02-17 02:01:27,535 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 6fd84418026599548312cefaa7aa3bbe: 2023-02-17 02:01:27,535 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,,1676599283172.6fd84418026599548312cefaa7aa3bbe. 2023-02-17 02:01:27,535 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 2320e8050ac479d9cc2f8e39be1d5e17, disabling compactions & flushes 2023-02-17 02:01:27,535 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676599283172.2320e8050ac479d9cc2f8e39be1d5e17. 2023-02-17 02:01:27,535 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676599283172.2320e8050ac479d9cc2f8e39be1d5e17. 2023-02-17 02:01:27,535 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676599283172.2320e8050ac479d9cc2f8e39be1d5e17. after waiting 0 ms 2023-02-17 02:01:27,535 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676599283172.2320e8050ac479d9cc2f8e39be1d5e17. 2023-02-17 02:01:27,535 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/hbase/meta/1588230740/info/206bd046b2014bf2b2bace6eb5933d93, entries=110, sequenceid=32, filesize=18.7 K 2023-02-17 02:01:27,536 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/hbase/meta/1588230740/.tmp/table/d8f0b7b9503f49e7bbfd2a2d6c283458 as hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/hbase/meta/1588230740/table/d8f0b7b9503f49e7bbfd2a2d6c283458 2023-02-17 02:01:27,541 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/hbase/meta/1588230740/table/d8f0b7b9503f49e7bbfd2a2d6c283458, entries=4, sequenceid=32, filesize=4.8 K 2023-02-17 02:01:27,541 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~13.95 KB/14280, heapSize ~22.77 KB/23312, currentSize=0 B/0 for 1588230740 in 122ms, sequenceid=32, compaction requested=false 2023-02-17 02:01:27,541 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-17 02:01:27,543 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/2320e8050ac479d9cc2f8e39be1d5e17/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 02:01:27,544 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676599283172.2320e8050ac479d9cc2f8e39be1d5e17. 2023-02-17 02:01:27,544 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 2320e8050ac479d9cc2f8e39be1d5e17: 2023-02-17 02:01:27,544 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,j\xCA\xCA,1676599283172.2320e8050ac479d9cc2f8e39be1d5e17. 2023-02-17 02:01:27,544 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing c087f3b958f194282116d4bdcb846998, disabling compactions & flushes 2023-02-17 02:01:27,544 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676599283172.c087f3b958f194282116d4bdcb846998. 2023-02-17 02:01:27,544 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676599283172.c087f3b958f194282116d4bdcb846998. 2023-02-17 02:01:27,544 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676599283172.c087f3b958f194282116d4bdcb846998. after waiting 0 ms 2023-02-17 02:01:27,545 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676599283172.c087f3b958f194282116d4bdcb846998. 2023-02-17 02:01:27,553 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/hbase/meta/1588230740/recovered.edits/35.seqid, newMaxSeqId=35, maxSeqId=1 2023-02-17 02:01:27,553 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-17 02:01:27,554 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-17 02:01:27,554 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-17 02:01:27,554 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-17 02:01:27,556 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/c087f3b958f194282116d4bdcb846998/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 02:01:27,556 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676599283172.c087f3b958f194282116d4bdcb846998. 2023-02-17 02:01:27,556 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for c087f3b958f194282116d4bdcb846998: 2023-02-17 02:01:27,557 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,wWV,1676599283172.c087f3b958f194282116d4bdcb846998. 2023-02-17 02:01:27,558 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 6014956a2b3f63abad8cd3b17629b80c, disabling compactions & flushes 2023-02-17 02:01:27,558 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676599283172.6014956a2b3f63abad8cd3b17629b80c. 2023-02-17 02:01:27,558 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676599283172.6014956a2b3f63abad8cd3b17629b80c. 2023-02-17 02:01:27,558 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676599283172.6014956a2b3f63abad8cd3b17629b80c. after waiting 0 ms 2023-02-17 02:01:27,558 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676599283172.6014956a2b3f63abad8cd3b17629b80c. 2023-02-17 02:01:27,562 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/data/default/testWithMapReduce/6014956a2b3f63abad8cd3b17629b80c/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 02:01:27,563 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676599283172.6014956a2b3f63abad8cd3b17629b80c. 2023-02-17 02:01:27,563 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 6014956a2b3f63abad8cd3b17629b80c: 2023-02-17 02:01:27,563 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,q\x11\x10,1676599283172.6014956a2b3f63abad8cd3b17629b80c. 2023-02-17 02:01:27,618 INFO [RS:0;jenkins-hbase4:42015] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,42015,1676599281872; all regions closed. 2023-02-17 02:01:27,619 INFO [RS:1;jenkins-hbase4:37987] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,37987,1676599281907; all regions closed. 2023-02-17 02:01:27,623 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/WALs/jenkins-hbase4.apache.org,37987,1676599281907/jenkins-hbase4.apache.org%2C37987%2C1676599281907.1676599283234 not finished, retry = 0 2023-02-17 02:01:27,625 DEBUG [RS:0;jenkins-hbase4:42015] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/oldWALs 2023-02-17 02:01:27,625 INFO [RS:0;jenkins-hbase4:42015] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42015%2C1676599281872.meta:.meta(num 1676599282492) 2023-02-17 02:01:27,630 DEBUG [RS:0;jenkins-hbase4:42015] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/oldWALs 2023-02-17 02:01:27,630 INFO [RS:0;jenkins-hbase4:42015] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42015%2C1676599281872:(num 1676599282926) 2023-02-17 02:01:27,631 DEBUG [RS:0;jenkins-hbase4:42015] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 02:01:27,631 INFO [RS:0;jenkins-hbase4:42015] regionserver.LeaseManager(133): Closed leases 2023-02-17 02:01:27,631 INFO [RS:0;jenkins-hbase4:42015] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-17 02:01:27,631 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-17 02:01:27,632 INFO [RS:0;jenkins-hbase4:42015] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42015 2023-02-17 02:01:27,726 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): regionserver:42015-0x1006002b2390001, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42015,1676599281872 2023-02-17 02:01:27,726 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 02:01:27,726 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): regionserver:37987-0x1006002b2390002, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42015,1676599281872 2023-02-17 02:01:27,726 ERROR [Listener at localhost/46551-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@698f54de rejected from java.util.concurrent.ThreadPoolExecutor@6db0dd37[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 02:01:27,726 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): regionserver:37987-0x1006002b2390002, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 02:01:27,726 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): regionserver:42015-0x1006002b2390001, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 02:01:27,726 ERROR [Listener at localhost/46551-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@aea2f3a rejected from java.util.concurrent.ThreadPoolExecutor@6db0dd37[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 02:01:27,726 DEBUG [RS:1;jenkins-hbase4:37987] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/oldWALs 2023-02-17 02:01:27,726 INFO [RS:1;jenkins-hbase4:37987] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37987%2C1676599281907:(num 1676599283234) 2023-02-17 02:01:27,726 DEBUG [RS:1;jenkins-hbase4:37987] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 02:01:27,726 INFO [RS:1;jenkins-hbase4:37987] regionserver.LeaseManager(133): Closed leases 2023-02-17 02:01:27,727 INFO [RS:1;jenkins-hbase4:37987] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-17 02:01:27,727 INFO [RS:1;jenkins-hbase4:37987] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-17 02:01:27,727 INFO [RS:1;jenkins-hbase4:37987] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-17 02:01:27,727 INFO [RS:1;jenkins-hbase4:37987] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-17 02:01:27,727 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-17 02:01:27,728 INFO [RS:1;jenkins-hbase4:37987] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37987 2023-02-17 02:01:27,818 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,42015,1676599281872] 2023-02-17 02:01:27,818 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,42015,1676599281872; numProcessing=1 2023-02-17 02:01:27,880 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 02:01:27,880 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): regionserver:37987-0x1006002b2390002, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37987,1676599281907 2023-02-17 02:01:27,880 ERROR [Listener at localhost/46551-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3cdee6af rejected from java.util.concurrent.ThreadPoolExecutor@38e165ec[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 02:01:27,918 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): regionserver:42015-0x1006002b2390001, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 02:01:27,918 INFO [RS:0;jenkins-hbase4:42015] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,42015,1676599281872; zookeeper connection closed. 2023-02-17 02:01:27,918 ERROR [Listener at localhost/46551-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@72629c75 rejected from java.util.concurrent.ThreadPoolExecutor@6db0dd37[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 02:01:27,918 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4c474b3] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4c474b3 2023-02-17 02:01:27,918 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): regionserver:42015-0x1006002b2390001, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 02:01:27,919 ERROR [Listener at localhost/46551-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@13d5d47c rejected from java.util.concurrent.ThreadPoolExecutor@6db0dd37[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 02:01:27,933 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,42015,1676599281872 already deleted, retry=false 2023-02-17 02:01:27,933 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,42015,1676599281872 expired; onlineServers=1 2023-02-17 02:01:27,995 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,37987,1676599281907] 2023-02-17 02:01:27,995 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,37987,1676599281907; numProcessing=2 2023-02-17 02:01:28,065 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,37987,1676599281907 already deleted, retry=false 2023-02-17 02:01:28,065 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,37987,1676599281907 expired; onlineServers=0 2023-02-17 02:01:28,065 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,36043,1676599281810' ***** 2023-02-17 02:01:28,065 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-17 02:01:28,066 DEBUG [M:0;jenkins-hbase4:36043] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7f6b3bc8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-17 02:01:28,066 INFO [M:0;jenkins-hbase4:36043] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,36043,1676599281810 2023-02-17 02:01:28,066 INFO [M:0;jenkins-hbase4:36043] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,36043,1676599281810; all regions closed. 2023-02-17 02:01:28,066 DEBUG [M:0;jenkins-hbase4:36043] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 02:01:28,066 DEBUG [M:0;jenkins-hbase4:36043] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-17 02:01:28,066 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-17 02:01:28,067 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676599282107] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676599282107,5,FailOnTimeoutGroup] 2023-02-17 02:01:28,067 DEBUG [M:0;jenkins-hbase4:36043] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-17 02:01:28,067 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676599282106] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676599282106,5,FailOnTimeoutGroup] 2023-02-17 02:01:28,069 INFO [M:0;jenkins-hbase4:36043] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-17 02:01:28,069 INFO [M:0;jenkins-hbase4:36043] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-17 02:01:28,069 INFO [M:0;jenkins-hbase4:36043] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-17 02:01:28,069 DEBUG [M:0;jenkins-hbase4:36043] master.HMaster(1512): Stopping service threads 2023-02-17 02:01:28,069 INFO [M:0;jenkins-hbase4:36043] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-17 02:01:28,070 ERROR [M:0;jenkins-hbase4:36043] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-17 02:01:28,070 INFO [M:0;jenkins-hbase4:36043] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-17 02:01:28,070 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-17 02:01:28,096 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): regionserver:37987-0x1006002b2390002, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 02:01:28,096 INFO [RS:1;jenkins-hbase4:37987] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,37987,1676599281907; zookeeper connection closed. 2023-02-17 02:01:28,096 ERROR [Listener at localhost/46551-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7f4605a rejected from java.util.concurrent.ThreadPoolExecutor@38e165ec[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 02:01:28,096 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@3ebcdb59] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@3ebcdb59 2023-02-17 02:01:28,096 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): regionserver:37987-0x1006002b2390002, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 02:01:28,096 ERROR [Listener at localhost/46551-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7f29c7e6 rejected from java.util.concurrent.ThreadPoolExecutor@38e165ec[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 02:01:28,096 INFO [Listener at localhost/46551] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-17 02:01:28,149 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-17 02:01:28,149 DEBUG [M:0;jenkins-hbase4:36043] zookeeper.ZKUtil(398): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-17 02:01:28,149 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 02:01:28,149 WARN [M:0;jenkins-hbase4:36043] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-17 02:01:28,149 INFO [M:0;jenkins-hbase4:36043] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-17 02:01:28,150 INFO [M:0;jenkins-hbase4:36043] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-17 02:01:28,150 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 02:01:28,150 DEBUG [M:0;jenkins-hbase4:36043] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-17 02:01:28,150 INFO [M:0;jenkins-hbase4:36043] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 02:01:28,150 DEBUG [M:0;jenkins-hbase4:36043] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 02:01:28,151 DEBUG [M:0;jenkins-hbase4:36043] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-17 02:01:28,151 DEBUG [M:0;jenkins-hbase4:36043] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 02:01:28,151 INFO [M:0;jenkins-hbase4:36043] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=100.95 KB heapSize=120.63 KB 2023-02-17 02:01:28,161 INFO [M:0;jenkins-hbase4:36043] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=100.95 KB at sequenceid=218 (bloomFilter=true), to=hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/1111d0116be749b988306e9b24369af9 2023-02-17 02:01:28,167 DEBUG [M:0;jenkins-hbase4:36043] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/1111d0116be749b988306e9b24369af9 as hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/1111d0116be749b988306e9b24369af9 2023-02-17 02:01:28,172 INFO [M:0;jenkins-hbase4:36043] regionserver.HStore(1080): Added hdfs://localhost:36619/user/jenkins/test-data/c9fa9aa0-aa41-c5ea-70c9-5c1771c03239/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/1111d0116be749b988306e9b24369af9, entries=31, sequenceid=218, filesize=9.0 K 2023-02-17 02:01:28,173 INFO [M:0;jenkins-hbase4:36043] regionserver.HRegion(2947): Finished flush of dataSize ~100.95 KB/103374, heapSize ~120.62 KB/123512, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 22ms, sequenceid=218, compaction requested=false 2023-02-17 02:01:28,180 INFO [M:0;jenkins-hbase4:36043] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 02:01:28,180 DEBUG [M:0;jenkins-hbase4:36043] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-17 02:01:28,185 INFO [M:0;jenkins-hbase4:36043] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-17 02:01:28,185 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-17 02:01:28,186 INFO [M:0;jenkins-hbase4:36043] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36043 2023-02-17 02:01:28,318 DEBUG [M:0;jenkins-hbase4:36043] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,36043,1676599281810 already deleted, retry=false 2023-02-17 02:01:28,495 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 02:01:28,495 INFO [M:0;jenkins-hbase4:36043] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,36043,1676599281810; zookeeper connection closed. 2023-02-17 02:01:28,495 ERROR [Listener at localhost/46551-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5035aa8b rejected from java.util.concurrent.ThreadPoolExecutor@540a3455[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 02:01:28,496 DEBUG [Listener at localhost/46551-EventThread] zookeeper.ZKWatcher(600): master:36043-0x1006002b2390000, quorum=127.0.0.1:62873, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 02:01:28,496 ERROR [Listener at localhost/46551-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5dcfcec3 rejected from java.util.concurrent.ThreadPoolExecutor@540a3455[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 02:01:28,597 DEBUG [Listener at localhost/46551] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1b0266e-bab7-2139-00bf-960e9cca3a54/hadoop-768767057353010297.jar 2023-02-17 02:01:28,601 INFO [Listener at localhost/46551] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1676599284624 type: FLUSH version: 2 ttl: 0 2023-02-17 02:01:28,601 DEBUG [Listener at localhost/46551] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:36619/user/jenkins/test-data/e42fbbaf-2fbf-3bc7-220c-4ace9dd84d78/testWithMapReduceAndOfflineHBaseMultiRegion/87bdb44d-c6d1-47cd-9aa3-68b079f8a6f6/data/default/testWithMapReduce 2023-02-17 02:01:28,602 INFO [Listener at localhost/46551] snapshot.RestoreSnapshotHelper(239): region to add: 3e671049091ae20efb4f185e13c8e87d 2023-02-17 02:01:28,602 INFO [Listener at localhost/46551] snapshot.RestoreSnapshotHelper(239): region to add: 5b902d43bfac9401fc39fb36d68d8226 2023-02-17 02:01:28,602 INFO [Listener at localhost/46551] snapshot.RestoreSnapshotHelper(239): region to add: d0c39439e95718da09586626dbdd1981 2023-02-17 02:01:28,602 INFO [Listener at localhost/46551] snapshot.RestoreSnapshotHelper(239): region to add: 6fd84418026599548312cefaa7aa3bbe 2023-02-17 02:01:28,602 INFO [Listener at localhost/46551] snapshot.RestoreSnapshotHelper(239): region to add: 2320e8050ac479d9cc2f8e39be1d5e17 2023-02-17 02:01:28,602 INFO [Listener at localhost/46551] snapshot.RestoreSnapshotHelper(239): region to add: 0ac77707fded7da956ea2eaff472f1e5 2023-02-17 02:01:28,602 INFO [Listener at localhost/46551] snapshot.RestoreSnapshotHelper(239): region to add: c087f3b958f194282116d4bdcb846998 2023-02-17 02:01:28,602 INFO [Listener at localhost/46551] snapshot.RestoreSnapshotHelper(239): region to add: 2700e21ceee9ee6242041ee38fc8cdfa 2023-02-17 02:01:28,603 INFO [Listener at localhost/46551] snapshot.RestoreSnapshotHelper(239): region to add: 6014956a2b3f63abad8cd3b17629b80c 2023-02-17 02:01:28,603 INFO [Listener at localhost/46551] snapshot.RestoreSnapshotHelper(239): region to add: 76fb71705f76672ea40ce0d3b7341303 2023-02-17 02:01:28,603 INFO [Listener at localhost/46551] snapshot.RestoreSnapshotHelper(585): clone region=3e671049091ae20efb4f185e13c8e87d as 3e671049091ae20efb4f185e13c8e87d in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:28,603 INFO [Listener at localhost/46551] snapshot.RestoreSnapshotHelper(585): clone region=5b902d43bfac9401fc39fb36d68d8226 as 5b902d43bfac9401fc39fb36d68d8226 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:28,603 INFO [Listener at localhost/46551] snapshot.RestoreSnapshotHelper(585): clone region=d0c39439e95718da09586626dbdd1981 as d0c39439e95718da09586626dbdd1981 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:28,603 INFO [Listener at localhost/46551] snapshot.RestoreSnapshotHelper(585): clone region=6fd84418026599548312cefaa7aa3bbe as 6fd84418026599548312cefaa7aa3bbe in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:28,603 INFO [Listener at localhost/46551] snapshot.RestoreSnapshotHelper(585): clone region=2320e8050ac479d9cc2f8e39be1d5e17 as 2320e8050ac479d9cc2f8e39be1d5e17 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:28,603 INFO [Listener at localhost/46551] snapshot.RestoreSnapshotHelper(585): clone region=0ac77707fded7da956ea2eaff472f1e5 as 0ac77707fded7da956ea2eaff472f1e5 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:28,603 INFO [Listener at localhost/46551] snapshot.RestoreSnapshotHelper(585): clone region=c087f3b958f194282116d4bdcb846998 as c087f3b958f194282116d4bdcb846998 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:28,603 INFO [Listener at localhost/46551] snapshot.RestoreSnapshotHelper(585): clone region=2700e21ceee9ee6242041ee38fc8cdfa as 2700e21ceee9ee6242041ee38fc8cdfa in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:28,603 INFO [Listener at localhost/46551] snapshot.RestoreSnapshotHelper(585): clone region=6014956a2b3f63abad8cd3b17629b80c as 6014956a2b3f63abad8cd3b17629b80c in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:28,604 INFO [Listener at localhost/46551] snapshot.RestoreSnapshotHelper(585): clone region=76fb71705f76672ea40ce0d3b7341303 as 76fb71705f76672ea40ce0d3b7341303 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 02:01:28,605 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 5b902d43bfac9401fc39fb36d68d8226, NAME => 'testWithMapReduce,zz{,1676599283172.5b902d43bfac9401fc39fb36d68d8226.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36619/user/jenkins/test-data/e42fbbaf-2fbf-3bc7-220c-4ace9dd84d78/testWithMapReduceAndOfflineHBaseMultiRegion/87bdb44d-c6d1-47cd-9aa3-68b079f8a6f6 2023-02-17 02:01:28,605 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 3e671049091ae20efb4f185e13c8e87d, NAME => 'testWithMapReduce,m\xED\xED,1676599283172.3e671049091ae20efb4f185e13c8e87d.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36619/user/jenkins/test-data/e42fbbaf-2fbf-3bc7-220c-4ace9dd84d78/testWithMapReduceAndOfflineHBaseMultiRegion/87bdb44d-c6d1-47cd-9aa3-68b079f8a6f6 2023-02-17 02:01:28,606 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 2320e8050ac479d9cc2f8e39be1d5e17, NAME => 'testWithMapReduce,j\xCA\xCA,1676599283172.2320e8050ac479d9cc2f8e39be1d5e17.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36619/user/jenkins/test-data/e42fbbaf-2fbf-3bc7-220c-4ace9dd84d78/testWithMapReduceAndOfflineHBaseMultiRegion/87bdb44d-c6d1-47cd-9aa3-68b079f8a6f6 2023-02-17 02:01:28,606 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 6fd84418026599548312cefaa7aa3bbe, NAME => 'testWithMapReduce,,1676599283172.6fd84418026599548312cefaa7aa3bbe.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36619/user/jenkins/test-data/e42fbbaf-2fbf-3bc7-220c-4ace9dd84d78/testWithMapReduceAndOfflineHBaseMultiRegion/87bdb44d-c6d1-47cd-9aa3-68b079f8a6f6 2023-02-17 02:01:28,606 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 2700e21ceee9ee6242041ee38fc8cdfa, NAME => 'testWithMapReduce,g\xA7\xA7,1676599283172.2700e21ceee9ee6242041ee38fc8cdfa.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36619/user/jenkins/test-data/e42fbbaf-2fbf-3bc7-220c-4ace9dd84d78/testWithMapReduceAndOfflineHBaseMultiRegion/87bdb44d-c6d1-47cd-9aa3-68b079f8a6f6 2023-02-17 02:01:28,606 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => c087f3b958f194282116d4bdcb846998, NAME => 'testWithMapReduce,wWV,1676599283172.c087f3b958f194282116d4bdcb846998.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36619/user/jenkins/test-data/e42fbbaf-2fbf-3bc7-220c-4ace9dd84d78/testWithMapReduceAndOfflineHBaseMultiRegion/87bdb44d-c6d1-47cd-9aa3-68b079f8a6f6 2023-02-17 02:01:28,607 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 0ac77707fded7da956ea2eaff472f1e5, NAME => 'testWithMapReduce,t43,1676599283172.0ac77707fded7da956ea2eaff472f1e5.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36619/user/jenkins/test-data/e42fbbaf-2fbf-3bc7-220c-4ace9dd84d78/testWithMapReduceAndOfflineHBaseMultiRegion/87bdb44d-c6d1-47cd-9aa3-68b079f8a6f6 2023-02-17 02:01:28,607 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => d0c39439e95718da09586626dbdd1981, NAME => 'testWithMapReduce,d\x84\x84,1676599283172.d0c39439e95718da09586626dbdd1981.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36619/user/jenkins/test-data/e42fbbaf-2fbf-3bc7-220c-4ace9dd84d78/testWithMapReduceAndOfflineHBaseMultiRegion/87bdb44d-c6d1-47cd-9aa3-68b079f8a6f6 2023-02-17 02:01:28,617 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676599283172.3e671049091ae20efb4f185e13c8e87d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:28,617 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 55558ab6d7b54feeaca8cc93d2adb771 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-17 02:01:28,622 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b7d3e51017ce4128be5cd682cec839b2 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-17 02:01:28,626 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676599283172.2320e8050ac479d9cc2f8e39be1d5e17.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:28,626 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d4857bef8d7c415499bb951c3134619d from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-17 02:01:28,626 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676599283172.5b902d43bfac9401fc39fb36d68d8226.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:28,626 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 5b902d43bfac9401fc39fb36d68d8226, disabling compactions & flushes 2023-02-17 02:01:28,627 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676599283172.5b902d43bfac9401fc39fb36d68d8226. 2023-02-17 02:01:28,627 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676599283172.5b902d43bfac9401fc39fb36d68d8226. 2023-02-17 02:01:28,627 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676599283172.5b902d43bfac9401fc39fb36d68d8226. after waiting 0 ms 2023-02-17 02:01:28,627 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676599283172.5b902d43bfac9401fc39fb36d68d8226. 2023-02-17 02:01:28,627 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676599283172.5b902d43bfac9401fc39fb36d68d8226. 2023-02-17 02:01:28,627 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 5b902d43bfac9401fc39fb36d68d8226: 2023-02-17 02:01:28,627 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 3e671049091ae20efb4f185e13c8e87d, disabling compactions & flushes 2023-02-17 02:01:28,627 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 6014956a2b3f63abad8cd3b17629b80c, NAME => 'testWithMapReduce,q\x11\x10,1676599283172.6014956a2b3f63abad8cd3b17629b80c.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36619/user/jenkins/test-data/e42fbbaf-2fbf-3bc7-220c-4ace9dd84d78/testWithMapReduceAndOfflineHBaseMultiRegion/87bdb44d-c6d1-47cd-9aa3-68b079f8a6f6 2023-02-17 02:01:28,627 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676599283172.3e671049091ae20efb4f185e13c8e87d. 2023-02-17 02:01:28,628 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676599283172.3e671049091ae20efb4f185e13c8e87d. 2023-02-17 02:01:28,628 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676599283172.3e671049091ae20efb4f185e13c8e87d. after waiting 0 ms 2023-02-17 02:01:28,628 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676599283172.3e671049091ae20efb4f185e13c8e87d. 2023-02-17 02:01:28,628 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676599283172.3e671049091ae20efb4f185e13c8e87d. 2023-02-17 02:01:28,628 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 3e671049091ae20efb4f185e13c8e87d: 2023-02-17 02:01:28,628 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 76fb71705f76672ea40ce0d3b7341303, NAME => 'testWithMapReduce,aaa,1676599283172.76fb71705f76672ea40ce0d3b7341303.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36619/user/jenkins/test-data/e42fbbaf-2fbf-3bc7-220c-4ace9dd84d78/testWithMapReduceAndOfflineHBaseMultiRegion/87bdb44d-c6d1-47cd-9aa3-68b079f8a6f6 2023-02-17 02:01:28,628 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676599283172.0ac77707fded7da956ea2eaff472f1e5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:28,628 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676599283172.c087f3b958f194282116d4bdcb846998.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:28,629 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink af17d92e6eea4eda9e92df8e203f4b31 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-17 02:01:28,629 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 98ec870aaabb42f9a6a2c32e566935d4 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-17 02:01:28,631 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink fe31e0e76f5d42f0bdc0287b6ead1d1d from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-17 02:01:28,632 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 5a398bfa3b644ddb96cd9a14ab04516a from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-17 02:01:28,633 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 5b08c323ca4d4c02ba7b497e70601e82 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-17 02:01:28,634 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 2320e8050ac479d9cc2f8e39be1d5e17, disabling compactions & flushes 2023-02-17 02:01:28,634 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676599283172.2320e8050ac479d9cc2f8e39be1d5e17. 2023-02-17 02:01:28,634 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676599283172.2320e8050ac479d9cc2f8e39be1d5e17. 2023-02-17 02:01:28,634 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676599283172.2320e8050ac479d9cc2f8e39be1d5e17. after waiting 0 ms 2023-02-17 02:01:28,634 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676599283172.2320e8050ac479d9cc2f8e39be1d5e17. 2023-02-17 02:01:28,634 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 0ac77707fded7da956ea2eaff472f1e5, disabling compactions & flushes 2023-02-17 02:01:28,634 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676599283172.2320e8050ac479d9cc2f8e39be1d5e17. 2023-02-17 02:01:28,635 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676599283172.0ac77707fded7da956ea2eaff472f1e5. 2023-02-17 02:01:28,635 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 2320e8050ac479d9cc2f8e39be1d5e17: 2023-02-17 02:01:28,635 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676599283172.0ac77707fded7da956ea2eaff472f1e5. 2023-02-17 02:01:28,635 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676599283172.0ac77707fded7da956ea2eaff472f1e5. after waiting 0 ms 2023-02-17 02:01:28,635 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676599283172.0ac77707fded7da956ea2eaff472f1e5. 2023-02-17 02:01:28,635 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676599283172.0ac77707fded7da956ea2eaff472f1e5. 2023-02-17 02:01:28,635 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 0ac77707fded7da956ea2eaff472f1e5: 2023-02-17 02:01:28,636 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing c087f3b958f194282116d4bdcb846998, disabling compactions & flushes 2023-02-17 02:01:28,636 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676599283172.c087f3b958f194282116d4bdcb846998. 2023-02-17 02:01:28,636 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676599283172.c087f3b958f194282116d4bdcb846998. 2023-02-17 02:01:28,636 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676599283172.c087f3b958f194282116d4bdcb846998. after waiting 0 ms 2023-02-17 02:01:28,636 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676599283172.c087f3b958f194282116d4bdcb846998. 2023-02-17 02:01:28,636 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676599283172.c087f3b958f194282116d4bdcb846998. 2023-02-17 02:01:28,636 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for c087f3b958f194282116d4bdcb846998: 2023-02-17 02:01:28,638 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676599283172.76fb71705f76672ea40ce0d3b7341303.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:28,638 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink af5e460408ec47dab3b88d86382ee410 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-17 02:01:28,640 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 3d5e3d58e0dd4468ba82bb6148cd9647 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-17 02:01:28,640 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676599283172.6014956a2b3f63abad8cd3b17629b80c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:28,640 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 27f79d882d924577bb88d5435c2114a9 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-17 02:01:28,642 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 76fb71705f76672ea40ce0d3b7341303, disabling compactions & flushes 2023-02-17 02:01:28,642 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676599283172.76fb71705f76672ea40ce0d3b7341303. 2023-02-17 02:01:28,642 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676599283172.76fb71705f76672ea40ce0d3b7341303. 2023-02-17 02:01:28,642 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676599283172.76fb71705f76672ea40ce0d3b7341303. after waiting 0 ms 2023-02-17 02:01:28,642 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676599283172.76fb71705f76672ea40ce0d3b7341303. 2023-02-17 02:01:28,642 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676599283172.76fb71705f76672ea40ce0d3b7341303. 2023-02-17 02:01:28,642 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 76fb71705f76672ea40ce0d3b7341303: 2023-02-17 02:01:28,642 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink ebb80d64719a40e7941f8b9b77e84bae from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-17 02:01:28,645 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 6014956a2b3f63abad8cd3b17629b80c, disabling compactions & flushes 2023-02-17 02:01:28,645 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676599283172.6014956a2b3f63abad8cd3b17629b80c. 2023-02-17 02:01:28,645 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676599283172.6014956a2b3f63abad8cd3b17629b80c. 2023-02-17 02:01:28,645 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676599283172.6014956a2b3f63abad8cd3b17629b80c. after waiting 0 ms 2023-02-17 02:01:28,645 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676599283172.6014956a2b3f63abad8cd3b17629b80c. 2023-02-17 02:01:28,645 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676599283172.6014956a2b3f63abad8cd3b17629b80c. 2023-02-17 02:01:28,645 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 6014956a2b3f63abad8cd3b17629b80c: 2023-02-17 02:01:29,023 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676599283172.2700e21ceee9ee6242041ee38fc8cdfa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:29,023 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676599283172.d0c39439e95718da09586626dbdd1981.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:29,023 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 3e69b14c8e634095b91687c9b144de10 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-17 02:01:29,023 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink cd0fe9cd085147fea9c2ec34a42ecd1b from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-17 02:01:29,024 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676599283172.6fd84418026599548312cefaa7aa3bbe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:29,024 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 6fd84418026599548312cefaa7aa3bbe, disabling compactions & flushes 2023-02-17 02:01:29,024 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676599283172.6fd84418026599548312cefaa7aa3bbe. 2023-02-17 02:01:29,024 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676599283172.6fd84418026599548312cefaa7aa3bbe. 2023-02-17 02:01:29,024 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676599283172.6fd84418026599548312cefaa7aa3bbe. after waiting 0 ms 2023-02-17 02:01:29,024 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676599283172.6fd84418026599548312cefaa7aa3bbe. 2023-02-17 02:01:29,024 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,,1676599283172.6fd84418026599548312cefaa7aa3bbe. 2023-02-17 02:01:29,024 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 6fd84418026599548312cefaa7aa3bbe: 2023-02-17 02:01:29,027 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a4b492ef88ec46e982586e9fe090e72b from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-17 02:01:29,027 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink c20f6d6c1f9941a2a488560223a30b8d from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-17 02:01:29,030 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 2700e21ceee9ee6242041ee38fc8cdfa, disabling compactions & flushes 2023-02-17 02:01:29,030 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676599283172.2700e21ceee9ee6242041ee38fc8cdfa. 2023-02-17 02:01:29,030 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676599283172.2700e21ceee9ee6242041ee38fc8cdfa. 2023-02-17 02:01:29,030 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676599283172.2700e21ceee9ee6242041ee38fc8cdfa. after waiting 0 ms 2023-02-17 02:01:29,030 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing d0c39439e95718da09586626dbdd1981, disabling compactions & flushes 2023-02-17 02:01:29,030 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676599283172.2700e21ceee9ee6242041ee38fc8cdfa. 2023-02-17 02:01:29,030 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676599283172.d0c39439e95718da09586626dbdd1981. 2023-02-17 02:01:29,030 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676599283172.2700e21ceee9ee6242041ee38fc8cdfa. 2023-02-17 02:01:29,030 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676599283172.d0c39439e95718da09586626dbdd1981. 2023-02-17 02:01:29,030 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 2700e21ceee9ee6242041ee38fc8cdfa: 2023-02-17 02:01:29,030 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676599283172.d0c39439e95718da09586626dbdd1981. after waiting 0 ms 2023-02-17 02:01:29,030 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676599283172.d0c39439e95718da09586626dbdd1981. 2023-02-17 02:01:29,030 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676599283172.d0c39439e95718da09586626dbdd1981. 2023-02-17 02:01:29,030 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for d0c39439e95718da09586626dbdd1981: 2023-02-17 02:01:29,030 INFO [Listener at localhost/46551] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1676599284624 type: FLUSH version: 2 ttl: 0 2023-02-17 02:01:29,031 DEBUG [Listener at localhost/46551] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:36619/user/jenkins/test-data/e42fbbaf-2fbf-3bc7-220c-4ace9dd84d78/testWithMapReduceAndOfflineHBaseMultiRegion/87bdb44d-c6d1-47cd-9aa3-68b079f8a6f6 2023-02-17 02:01:29,031 DEBUG [Listener at localhost/46551] util.CommonFSUtils(682): File system contents for path hdfs://localhost:36619/user/jenkins/test-data/e42fbbaf-2fbf-3bc7-220c-4ace9dd84d78/testWithMapReduceAndOfflineHBaseMultiRegion/87bdb44d-c6d1-47cd-9aa3-68b079f8a6f6 2023-02-17 02:01:29,031 DEBUG [Listener at localhost/46551] util.CommonFSUtils(699): |-data/ 2023-02-17 02:01:29,032 DEBUG [Listener at localhost/46551] util.CommonFSUtils(699): |----default/ 2023-02-17 02:01:29,032 DEBUG [Listener at localhost/46551] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-17 02:01:29,033 DEBUG [Listener at localhost/46551] util.CommonFSUtils(699): |----------0ac77707fded7da956ea2eaff472f1e5/ 2023-02-17 02:01:29,034 DEBUG [Listener at localhost/46551] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 02:01:29,034 DEBUG [Listener at localhost/46551] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 02:01:29,034 DEBUG [Listener at localhost/46551] util.CommonFSUtils(702): |----------------testWithMapReduce=0ac77707fded7da956ea2eaff472f1e5-af17d92e6eea4eda9e92df8e203f4b31 2023-02-17 02:01:29,034 DEBUG [Listener at localhost/46551] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 02:01:29,035 DEBUG [Listener at localhost/46551] util.CommonFSUtils(702): |----------------testWithMapReduce=0ac77707fded7da956ea2eaff472f1e5-5a398bfa3b644ddb96cd9a14ab04516a 2023-02-17 02:01:29,035 DEBUG [Listener at localhost/46551] util.CommonFSUtils(699): |----------2320e8050ac479d9cc2f8e39be1d5e17/ 2023-02-17 02:01:29,035 DEBUG [Listener at localhost/46551] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 02:01:29,035 DEBUG [Listener at localhost/46551] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 02:01:29,036 DEBUG [Listener at localhost/46551] util.CommonFSUtils(702): |----------------testWithMapReduce=2320e8050ac479d9cc2f8e39be1d5e17-d4857bef8d7c415499bb951c3134619d 2023-02-17 02:01:29,036 DEBUG [Listener at localhost/46551] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 02:01:29,037 DEBUG [Listener at localhost/46551] util.CommonFSUtils(702): |----------------testWithMapReduce=2320e8050ac479d9cc2f8e39be1d5e17-fe31e0e76f5d42f0bdc0287b6ead1d1d 2023-02-17 02:01:29,037 DEBUG [Listener at localhost/46551] util.CommonFSUtils(699): |----------2700e21ceee9ee6242041ee38fc8cdfa/ 2023-02-17 02:01:29,037 DEBUG [Listener at localhost/46551] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 02:01:29,037 DEBUG [Listener at localhost/46551] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 02:01:29,038 DEBUG [Listener at localhost/46551] util.CommonFSUtils(702): |----------------testWithMapReduce=2700e21ceee9ee6242041ee38fc8cdfa-3e69b14c8e634095b91687c9b144de10 2023-02-17 02:01:29,038 DEBUG [Listener at localhost/46551] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 02:01:29,038 DEBUG [Listener at localhost/46551] util.CommonFSUtils(702): |----------------testWithMapReduce=2700e21ceee9ee6242041ee38fc8cdfa-a4b492ef88ec46e982586e9fe090e72b 2023-02-17 02:01:29,039 DEBUG [Listener at localhost/46551] util.CommonFSUtils(699): |----------3e671049091ae20efb4f185e13c8e87d/ 2023-02-17 02:01:29,039 DEBUG [Listener at localhost/46551] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 02:01:29,039 DEBUG [Listener at localhost/46551] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 02:01:29,040 DEBUG [Listener at localhost/46551] util.CommonFSUtils(702): |----------------testWithMapReduce=3e671049091ae20efb4f185e13c8e87d-55558ab6d7b54feeaca8cc93d2adb771 2023-02-17 02:01:29,040 DEBUG [Listener at localhost/46551] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 02:01:29,040 DEBUG [Listener at localhost/46551] util.CommonFSUtils(702): |----------------testWithMapReduce=3e671049091ae20efb4f185e13c8e87d-b7d3e51017ce4128be5cd682cec839b2 2023-02-17 02:01:29,040 DEBUG [Listener at localhost/46551] util.CommonFSUtils(699): |----------5b902d43bfac9401fc39fb36d68d8226/ 2023-02-17 02:01:29,040 DEBUG [Listener at localhost/46551] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 02:01:29,041 DEBUG [Listener at localhost/46551] util.CommonFSUtils(699): |----------6014956a2b3f63abad8cd3b17629b80c/ 2023-02-17 02:01:29,041 DEBUG [Listener at localhost/46551] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 02:01:29,041 DEBUG [Listener at localhost/46551] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 02:01:29,042 DEBUG [Listener at localhost/46551] util.CommonFSUtils(702): |----------------testWithMapReduce=6014956a2b3f63abad8cd3b17629b80c-27f79d882d924577bb88d5435c2114a9 2023-02-17 02:01:29,042 DEBUG [Listener at localhost/46551] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 02:01:29,043 DEBUG [Listener at localhost/46551] util.CommonFSUtils(702): |----------------testWithMapReduce=6014956a2b3f63abad8cd3b17629b80c-ebb80d64719a40e7941f8b9b77e84bae 2023-02-17 02:01:29,043 DEBUG [Listener at localhost/46551] util.CommonFSUtils(699): |----------6fd84418026599548312cefaa7aa3bbe/ 2023-02-17 02:01:29,043 DEBUG [Listener at localhost/46551] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 02:01:29,043 DEBUG [Listener at localhost/46551] util.CommonFSUtils(699): |----------76fb71705f76672ea40ce0d3b7341303/ 2023-02-17 02:01:29,044 DEBUG [Listener at localhost/46551] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 02:01:29,044 DEBUG [Listener at localhost/46551] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 02:01:29,044 DEBUG [Listener at localhost/46551] util.CommonFSUtils(702): |----------------testWithMapReduce=76fb71705f76672ea40ce0d3b7341303-af5e460408ec47dab3b88d86382ee410 2023-02-17 02:01:29,044 DEBUG [Listener at localhost/46551] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 02:01:29,045 DEBUG [Listener at localhost/46551] util.CommonFSUtils(702): |----------------testWithMapReduce=76fb71705f76672ea40ce0d3b7341303-3d5e3d58e0dd4468ba82bb6148cd9647 2023-02-17 02:01:29,045 DEBUG [Listener at localhost/46551] util.CommonFSUtils(699): |----------c087f3b958f194282116d4bdcb846998/ 2023-02-17 02:01:29,045 DEBUG [Listener at localhost/46551] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 02:01:29,046 DEBUG [Listener at localhost/46551] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 02:01:29,046 DEBUG [Listener at localhost/46551] util.CommonFSUtils(702): |----------------testWithMapReduce=c087f3b958f194282116d4bdcb846998-98ec870aaabb42f9a6a2c32e566935d4 2023-02-17 02:01:29,046 DEBUG [Listener at localhost/46551] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 02:01:29,047 DEBUG [Listener at localhost/46551] util.CommonFSUtils(702): |----------------testWithMapReduce=c087f3b958f194282116d4bdcb846998-5b08c323ca4d4c02ba7b497e70601e82 2023-02-17 02:01:29,047 DEBUG [Listener at localhost/46551] util.CommonFSUtils(699): |----------d0c39439e95718da09586626dbdd1981/ 2023-02-17 02:01:29,048 DEBUG [Listener at localhost/46551] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 02:01:29,048 DEBUG [Listener at localhost/46551] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 02:01:29,048 DEBUG [Listener at localhost/46551] util.CommonFSUtils(702): |----------------testWithMapReduce=d0c39439e95718da09586626dbdd1981-cd0fe9cd085147fea9c2ec34a42ecd1b 2023-02-17 02:01:29,048 DEBUG [Listener at localhost/46551] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 02:01:29,049 DEBUG [Listener at localhost/46551] util.CommonFSUtils(702): |----------------testWithMapReduce=d0c39439e95718da09586626dbdd1981-c20f6d6c1f9941a2a488560223a30b8d 2023-02-17 02:01:29,049 DEBUG [Listener at localhost/46551] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-17 02:01:29,050 DEBUG [Listener at localhost/46551] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-17 02:01:29,050 DEBUG [Listener at localhost/46551] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-17 02:01:29,050 DEBUG [Listener at localhost/46551] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-17 02:01:29,179 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-17 02:01:29,971 DEBUG [Listener at localhost/46551] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1b0266e-bab7-2139-00bf-960e9cca3a54/hadoop-7556921282245056839.jar 2023-02-17 02:01:29,972 DEBUG [Listener at localhost/46551] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-17 02:01:29,972 DEBUG [Listener at localhost/46551] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-17 02:01:30,054 DEBUG [Listener at localhost/46551] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1b0266e-bab7-2139-00bf-960e9cca3a54/hadoop-2435700825215685576.jar 2023-02-17 02:01:30,055 DEBUG [Listener at localhost/46551] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-17 02:01:30,055 DEBUG [Listener at localhost/46551] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-17 02:01:30,056 DEBUG [Listener at localhost/46551] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-17 02:01:30,056 DEBUG [Listener at localhost/46551] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-17 02:01:30,057 DEBUG [Listener at localhost/46551] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-17 02:01:30,057 DEBUG [Listener at localhost/46551] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-17 02:01:30,058 DEBUG [Listener at localhost/46551] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-17 02:01:30,058 DEBUG [Listener at localhost/46551] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-17 02:01:30,059 DEBUG [Listener at localhost/46551] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-17 02:01:30,060 DEBUG [Listener at localhost/46551] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-17 02:01:30,060 DEBUG [Listener at localhost/46551] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-17 02:01:30,061 DEBUG [Listener at localhost/46551] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-17 02:01:30,061 DEBUG [Listener at localhost/46551] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-17 02:01:30,062 DEBUG [Listener at localhost/46551] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-17 02:01:30,062 DEBUG [Listener at localhost/46551] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-17 02:01:30,063 DEBUG [Listener at localhost/46551] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-17 02:01:30,064 DEBUG [Listener at localhost/46551] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-17 02:01:30,065 DEBUG [Listener at localhost/46551] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-17 02:01:30,065 DEBUG [Listener at localhost/46551] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-17 02:01:30,066 DEBUG [Listener at localhost/46551] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-17 02:01:30,067 DEBUG [Listener at localhost/46551] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-17 02:01:30,143 DEBUG [Listener at localhost/46551] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1b0266e-bab7-2139-00bf-960e9cca3a54/hadoop-4560276493198995373.jar 2023-02-17 02:01:30,143 DEBUG [Listener at localhost/46551] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-17 02:01:30,154 WARN [Listener at localhost/46551] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-17 02:01:30,161 WARN [Listener at localhost/46551] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-02-17 02:01:30,169 INFO [Listener at localhost/46551] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-17 02:01:30,299 WARN [Listener at localhost/46551] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1b0266e-bab7-2139-00bf-960e9cca3a54/mapreduce.cluster.local.dir/1676599290258/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-17 02:01:30,299 WARN [Listener at localhost/46551] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1b0266e-bab7-2139-00bf-960e9cca3a54/mapreduce.cluster.local.dir/1676599290258/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-17 02:01:30,342 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676599283172.2320e8050ac479d9cc2f8e39be1d5e17.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:30,342 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 02:01:30,344 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 02:01:30,349 INFO [StoreOpener-2320e8050ac479d9cc2f8e39be1d5e17-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2320e8050ac479d9cc2f8e39be1d5e17 2023-02-17 02:01:30,350 DEBUG [StoreOpener-2320e8050ac479d9cc2f8e39be1d5e17-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36619/user/jenkins/test-data/e42fbbaf-2fbf-3bc7-220c-4ace9dd84d78/testWithMapReduceAndOfflineHBaseMultiRegion/87bdb44d-c6d1-47cd-9aa3-68b079f8a6f6/data/default/testWithMapReduce/2320e8050ac479d9cc2f8e39be1d5e17/f1 2023-02-17 02:01:30,351 INFO [StoreOpener-2320e8050ac479d9cc2f8e39be1d5e17-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2320e8050ac479d9cc2f8e39be1d5e17 columnFamilyName f1 2023-02-17 02:01:30,363 DEBUG [StoreOpener-2320e8050ac479d9cc2f8e39be1d5e17-1] regionserver.HStore(539): loaded hdfs://localhost:36619/user/jenkins/test-data/e42fbbaf-2fbf-3bc7-220c-4ace9dd84d78/testWithMapReduceAndOfflineHBaseMultiRegion/87bdb44d-c6d1-47cd-9aa3-68b079f8a6f6/data/default/testWithMapReduce/2320e8050ac479d9cc2f8e39be1d5e17/f1/testWithMapReduce=2320e8050ac479d9cc2f8e39be1d5e17-d4857bef8d7c415499bb951c3134619d 2023-02-17 02:01:30,363 INFO [StoreOpener-2320e8050ac479d9cc2f8e39be1d5e17-1] regionserver.HStore(310): Store=2320e8050ac479d9cc2f8e39be1d5e17/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:30,363 INFO [StoreOpener-2320e8050ac479d9cc2f8e39be1d5e17-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2320e8050ac479d9cc2f8e39be1d5e17 2023-02-17 02:01:30,364 DEBUG [StoreOpener-2320e8050ac479d9cc2f8e39be1d5e17-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36619/user/jenkins/test-data/e42fbbaf-2fbf-3bc7-220c-4ace9dd84d78/testWithMapReduceAndOfflineHBaseMultiRegion/87bdb44d-c6d1-47cd-9aa3-68b079f8a6f6/data/default/testWithMapReduce/2320e8050ac479d9cc2f8e39be1d5e17/f2 2023-02-17 02:01:30,365 INFO [StoreOpener-2320e8050ac479d9cc2f8e39be1d5e17-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2320e8050ac479d9cc2f8e39be1d5e17 columnFamilyName f2 2023-02-17 02:01:30,370 DEBUG [StoreOpener-2320e8050ac479d9cc2f8e39be1d5e17-1] regionserver.HStore(539): loaded hdfs://localhost:36619/user/jenkins/test-data/e42fbbaf-2fbf-3bc7-220c-4ace9dd84d78/testWithMapReduceAndOfflineHBaseMultiRegion/87bdb44d-c6d1-47cd-9aa3-68b079f8a6f6/data/default/testWithMapReduce/2320e8050ac479d9cc2f8e39be1d5e17/f2/testWithMapReduce=2320e8050ac479d9cc2f8e39be1d5e17-fe31e0e76f5d42f0bdc0287b6ead1d1d 2023-02-17 02:01:30,371 INFO [StoreOpener-2320e8050ac479d9cc2f8e39be1d5e17-1] regionserver.HStore(310): Store=2320e8050ac479d9cc2f8e39be1d5e17/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:30,371 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 02:01:30,371 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 2320e8050ac479d9cc2f8e39be1d5e17; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72381133, jitterRate=0.07856293022632599}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 02:01:30,371 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 2320e8050ac479d9cc2f8e39be1d5e17: 2023-02-17 02:01:30,412 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 2320e8050ac479d9cc2f8e39be1d5e17, disabling compactions & flushes 2023-02-17 02:01:30,412 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676599283172.2320e8050ac479d9cc2f8e39be1d5e17. 2023-02-17 02:01:30,412 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676599283172.2320e8050ac479d9cc2f8e39be1d5e17. 2023-02-17 02:01:30,412 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676599283172.2320e8050ac479d9cc2f8e39be1d5e17. after waiting 0 ms 2023-02-17 02:01:30,412 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676599283172.2320e8050ac479d9cc2f8e39be1d5e17. 2023-02-17 02:01:30,423 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676599283172.2320e8050ac479d9cc2f8e39be1d5e17. 2023-02-17 02:01:30,423 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 2320e8050ac479d9cc2f8e39be1d5e17: 2023-02-17 02:01:30,430 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676599283172.3e671049091ae20efb4f185e13c8e87d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:30,430 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 02:01:30,434 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 02:01:30,437 INFO [StoreOpener-3e671049091ae20efb4f185e13c8e87d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3e671049091ae20efb4f185e13c8e87d 2023-02-17 02:01:30,438 DEBUG [StoreOpener-3e671049091ae20efb4f185e13c8e87d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36619/user/jenkins/test-data/e42fbbaf-2fbf-3bc7-220c-4ace9dd84d78/testWithMapReduceAndOfflineHBaseMultiRegion/87bdb44d-c6d1-47cd-9aa3-68b079f8a6f6/data/default/testWithMapReduce/3e671049091ae20efb4f185e13c8e87d/f1 2023-02-17 02:01:30,439 INFO [StoreOpener-3e671049091ae20efb4f185e13c8e87d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3e671049091ae20efb4f185e13c8e87d columnFamilyName f1 2023-02-17 02:01:30,459 DEBUG [StoreOpener-3e671049091ae20efb4f185e13c8e87d-1] regionserver.HStore(539): loaded hdfs://localhost:36619/user/jenkins/test-data/e42fbbaf-2fbf-3bc7-220c-4ace9dd84d78/testWithMapReduceAndOfflineHBaseMultiRegion/87bdb44d-c6d1-47cd-9aa3-68b079f8a6f6/data/default/testWithMapReduce/3e671049091ae20efb4f185e13c8e87d/f1/testWithMapReduce=3e671049091ae20efb4f185e13c8e87d-55558ab6d7b54feeaca8cc93d2adb771 2023-02-17 02:01:30,459 INFO [StoreOpener-3e671049091ae20efb4f185e13c8e87d-1] regionserver.HStore(310): Store=3e671049091ae20efb4f185e13c8e87d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:30,459 INFO [StoreOpener-3e671049091ae20efb4f185e13c8e87d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3e671049091ae20efb4f185e13c8e87d 2023-02-17 02:01:30,461 DEBUG [StoreOpener-3e671049091ae20efb4f185e13c8e87d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36619/user/jenkins/test-data/e42fbbaf-2fbf-3bc7-220c-4ace9dd84d78/testWithMapReduceAndOfflineHBaseMultiRegion/87bdb44d-c6d1-47cd-9aa3-68b079f8a6f6/data/default/testWithMapReduce/3e671049091ae20efb4f185e13c8e87d/f2 2023-02-17 02:01:30,461 INFO [StoreOpener-3e671049091ae20efb4f185e13c8e87d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3e671049091ae20efb4f185e13c8e87d columnFamilyName f2 2023-02-17 02:01:30,468 DEBUG [StoreOpener-3e671049091ae20efb4f185e13c8e87d-1] regionserver.HStore(539): loaded hdfs://localhost:36619/user/jenkins/test-data/e42fbbaf-2fbf-3bc7-220c-4ace9dd84d78/testWithMapReduceAndOfflineHBaseMultiRegion/87bdb44d-c6d1-47cd-9aa3-68b079f8a6f6/data/default/testWithMapReduce/3e671049091ae20efb4f185e13c8e87d/f2/testWithMapReduce=3e671049091ae20efb4f185e13c8e87d-b7d3e51017ce4128be5cd682cec839b2 2023-02-17 02:01:30,468 INFO [StoreOpener-3e671049091ae20efb4f185e13c8e87d-1] regionserver.HStore(310): Store=3e671049091ae20efb4f185e13c8e87d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:30,468 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 02:01:30,469 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 3e671049091ae20efb4f185e13c8e87d; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73825703, jitterRate=0.1000887006521225}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 02:01:30,469 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 3e671049091ae20efb4f185e13c8e87d: 2023-02-17 02:01:30,506 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 3e671049091ae20efb4f185e13c8e87d, disabling compactions & flushes 2023-02-17 02:01:30,506 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676599283172.3e671049091ae20efb4f185e13c8e87d. 2023-02-17 02:01:30,506 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676599283172.3e671049091ae20efb4f185e13c8e87d. 2023-02-17 02:01:30,506 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676599283172.3e671049091ae20efb4f185e13c8e87d. after waiting 0 ms 2023-02-17 02:01:30,506 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676599283172.3e671049091ae20efb4f185e13c8e87d. 2023-02-17 02:01:30,507 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676599283172.3e671049091ae20efb4f185e13c8e87d. 2023-02-17 02:01:30,507 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 3e671049091ae20efb4f185e13c8e87d: 2023-02-17 02:01:30,511 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676599283172.0ac77707fded7da956ea2eaff472f1e5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:30,511 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 02:01:30,514 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 02:01:30,516 INFO [StoreOpener-0ac77707fded7da956ea2eaff472f1e5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0ac77707fded7da956ea2eaff472f1e5 2023-02-17 02:01:30,517 DEBUG [StoreOpener-0ac77707fded7da956ea2eaff472f1e5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36619/user/jenkins/test-data/e42fbbaf-2fbf-3bc7-220c-4ace9dd84d78/testWithMapReduceAndOfflineHBaseMultiRegion/87bdb44d-c6d1-47cd-9aa3-68b079f8a6f6/data/default/testWithMapReduce/0ac77707fded7da956ea2eaff472f1e5/f1 2023-02-17 02:01:30,518 INFO [StoreOpener-0ac77707fded7da956ea2eaff472f1e5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0ac77707fded7da956ea2eaff472f1e5 columnFamilyName f1 2023-02-17 02:01:30,528 DEBUG [StoreOpener-0ac77707fded7da956ea2eaff472f1e5-1] regionserver.HStore(539): loaded hdfs://localhost:36619/user/jenkins/test-data/e42fbbaf-2fbf-3bc7-220c-4ace9dd84d78/testWithMapReduceAndOfflineHBaseMultiRegion/87bdb44d-c6d1-47cd-9aa3-68b079f8a6f6/data/default/testWithMapReduce/0ac77707fded7da956ea2eaff472f1e5/f1/testWithMapReduce=0ac77707fded7da956ea2eaff472f1e5-af17d92e6eea4eda9e92df8e203f4b31 2023-02-17 02:01:30,528 INFO [StoreOpener-0ac77707fded7da956ea2eaff472f1e5-1] regionserver.HStore(310): Store=0ac77707fded7da956ea2eaff472f1e5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:30,528 INFO [StoreOpener-0ac77707fded7da956ea2eaff472f1e5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0ac77707fded7da956ea2eaff472f1e5 2023-02-17 02:01:30,529 DEBUG [StoreOpener-0ac77707fded7da956ea2eaff472f1e5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36619/user/jenkins/test-data/e42fbbaf-2fbf-3bc7-220c-4ace9dd84d78/testWithMapReduceAndOfflineHBaseMultiRegion/87bdb44d-c6d1-47cd-9aa3-68b079f8a6f6/data/default/testWithMapReduce/0ac77707fded7da956ea2eaff472f1e5/f2 2023-02-17 02:01:30,530 INFO [StoreOpener-0ac77707fded7da956ea2eaff472f1e5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0ac77707fded7da956ea2eaff472f1e5 columnFamilyName f2 2023-02-17 02:01:30,535 DEBUG [StoreOpener-0ac77707fded7da956ea2eaff472f1e5-1] regionserver.HStore(539): loaded hdfs://localhost:36619/user/jenkins/test-data/e42fbbaf-2fbf-3bc7-220c-4ace9dd84d78/testWithMapReduceAndOfflineHBaseMultiRegion/87bdb44d-c6d1-47cd-9aa3-68b079f8a6f6/data/default/testWithMapReduce/0ac77707fded7da956ea2eaff472f1e5/f2/testWithMapReduce=0ac77707fded7da956ea2eaff472f1e5-5a398bfa3b644ddb96cd9a14ab04516a 2023-02-17 02:01:30,536 INFO [StoreOpener-0ac77707fded7da956ea2eaff472f1e5-1] regionserver.HStore(310): Store=0ac77707fded7da956ea2eaff472f1e5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:30,536 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 02:01:30,536 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 0ac77707fded7da956ea2eaff472f1e5; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72558292, jitterRate=0.08120280504226685}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 02:01:30,536 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 0ac77707fded7da956ea2eaff472f1e5: 2023-02-17 02:01:30,579 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 0ac77707fded7da956ea2eaff472f1e5, disabling compactions & flushes 2023-02-17 02:01:30,579 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676599283172.0ac77707fded7da956ea2eaff472f1e5. 2023-02-17 02:01:30,579 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676599283172.0ac77707fded7da956ea2eaff472f1e5. 2023-02-17 02:01:30,579 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676599283172.0ac77707fded7da956ea2eaff472f1e5. after waiting 0 ms 2023-02-17 02:01:30,579 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676599283172.0ac77707fded7da956ea2eaff472f1e5. 2023-02-17 02:01:30,581 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676599283172.0ac77707fded7da956ea2eaff472f1e5. 2023-02-17 02:01:30,581 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 0ac77707fded7da956ea2eaff472f1e5: 2023-02-17 02:01:30,586 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676599283172.6014956a2b3f63abad8cd3b17629b80c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:30,586 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 02:01:30,587 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 02:01:30,589 INFO [StoreOpener-6014956a2b3f63abad8cd3b17629b80c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 6014956a2b3f63abad8cd3b17629b80c 2023-02-17 02:01:30,590 DEBUG [StoreOpener-6014956a2b3f63abad8cd3b17629b80c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36619/user/jenkins/test-data/e42fbbaf-2fbf-3bc7-220c-4ace9dd84d78/testWithMapReduceAndOfflineHBaseMultiRegion/87bdb44d-c6d1-47cd-9aa3-68b079f8a6f6/data/default/testWithMapReduce/6014956a2b3f63abad8cd3b17629b80c/f1 2023-02-17 02:01:30,590 INFO [StoreOpener-6014956a2b3f63abad8cd3b17629b80c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6014956a2b3f63abad8cd3b17629b80c columnFamilyName f1 2023-02-17 02:01:30,600 DEBUG [StoreOpener-6014956a2b3f63abad8cd3b17629b80c-1] regionserver.HStore(539): loaded hdfs://localhost:36619/user/jenkins/test-data/e42fbbaf-2fbf-3bc7-220c-4ace9dd84d78/testWithMapReduceAndOfflineHBaseMultiRegion/87bdb44d-c6d1-47cd-9aa3-68b079f8a6f6/data/default/testWithMapReduce/6014956a2b3f63abad8cd3b17629b80c/f1/testWithMapReduce=6014956a2b3f63abad8cd3b17629b80c-27f79d882d924577bb88d5435c2114a9 2023-02-17 02:01:30,600 INFO [StoreOpener-6014956a2b3f63abad8cd3b17629b80c-1] regionserver.HStore(310): Store=6014956a2b3f63abad8cd3b17629b80c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:30,600 INFO [StoreOpener-6014956a2b3f63abad8cd3b17629b80c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 6014956a2b3f63abad8cd3b17629b80c 2023-02-17 02:01:30,601 DEBUG [StoreOpener-6014956a2b3f63abad8cd3b17629b80c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36619/user/jenkins/test-data/e42fbbaf-2fbf-3bc7-220c-4ace9dd84d78/testWithMapReduceAndOfflineHBaseMultiRegion/87bdb44d-c6d1-47cd-9aa3-68b079f8a6f6/data/default/testWithMapReduce/6014956a2b3f63abad8cd3b17629b80c/f2 2023-02-17 02:01:30,602 INFO [StoreOpener-6014956a2b3f63abad8cd3b17629b80c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6014956a2b3f63abad8cd3b17629b80c columnFamilyName f2 2023-02-17 02:01:30,609 DEBUG [StoreOpener-6014956a2b3f63abad8cd3b17629b80c-1] regionserver.HStore(539): loaded hdfs://localhost:36619/user/jenkins/test-data/e42fbbaf-2fbf-3bc7-220c-4ace9dd84d78/testWithMapReduceAndOfflineHBaseMultiRegion/87bdb44d-c6d1-47cd-9aa3-68b079f8a6f6/data/default/testWithMapReduce/6014956a2b3f63abad8cd3b17629b80c/f2/testWithMapReduce=6014956a2b3f63abad8cd3b17629b80c-ebb80d64719a40e7941f8b9b77e84bae 2023-02-17 02:01:30,610 INFO [StoreOpener-6014956a2b3f63abad8cd3b17629b80c-1] regionserver.HStore(310): Store=6014956a2b3f63abad8cd3b17629b80c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:30,610 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 02:01:30,610 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 6014956a2b3f63abad8cd3b17629b80c; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71544482, jitterRate=0.06609585881233215}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 02:01:30,610 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 6014956a2b3f63abad8cd3b17629b80c: 2023-02-17 02:01:30,640 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 6014956a2b3f63abad8cd3b17629b80c, disabling compactions & flushes 2023-02-17 02:01:30,640 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676599283172.6014956a2b3f63abad8cd3b17629b80c. 2023-02-17 02:01:30,641 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676599283172.6014956a2b3f63abad8cd3b17629b80c. 2023-02-17 02:01:30,641 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676599283172.6014956a2b3f63abad8cd3b17629b80c. after waiting 0 ms 2023-02-17 02:01:30,641 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676599283172.6014956a2b3f63abad8cd3b17629b80c. 2023-02-17 02:01:30,642 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676599283172.6014956a2b3f63abad8cd3b17629b80c. 2023-02-17 02:01:30,642 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 6014956a2b3f63abad8cd3b17629b80c: 2023-02-17 02:01:30,646 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676599283172.2700e21ceee9ee6242041ee38fc8cdfa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:30,646 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 02:01:30,648 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 02:01:30,650 INFO [StoreOpener-2700e21ceee9ee6242041ee38fc8cdfa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2700e21ceee9ee6242041ee38fc8cdfa 2023-02-17 02:01:30,651 DEBUG [StoreOpener-2700e21ceee9ee6242041ee38fc8cdfa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36619/user/jenkins/test-data/e42fbbaf-2fbf-3bc7-220c-4ace9dd84d78/testWithMapReduceAndOfflineHBaseMultiRegion/87bdb44d-c6d1-47cd-9aa3-68b079f8a6f6/data/default/testWithMapReduce/2700e21ceee9ee6242041ee38fc8cdfa/f1 2023-02-17 02:01:30,652 INFO [StoreOpener-2700e21ceee9ee6242041ee38fc8cdfa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2700e21ceee9ee6242041ee38fc8cdfa columnFamilyName f1 2023-02-17 02:01:30,657 DEBUG [StoreOpener-2700e21ceee9ee6242041ee38fc8cdfa-1] regionserver.HStore(539): loaded hdfs://localhost:36619/user/jenkins/test-data/e42fbbaf-2fbf-3bc7-220c-4ace9dd84d78/testWithMapReduceAndOfflineHBaseMultiRegion/87bdb44d-c6d1-47cd-9aa3-68b079f8a6f6/data/default/testWithMapReduce/2700e21ceee9ee6242041ee38fc8cdfa/f1/testWithMapReduce=2700e21ceee9ee6242041ee38fc8cdfa-3e69b14c8e634095b91687c9b144de10 2023-02-17 02:01:30,658 INFO [StoreOpener-2700e21ceee9ee6242041ee38fc8cdfa-1] regionserver.HStore(310): Store=2700e21ceee9ee6242041ee38fc8cdfa/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:30,658 INFO [StoreOpener-2700e21ceee9ee6242041ee38fc8cdfa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2700e21ceee9ee6242041ee38fc8cdfa 2023-02-17 02:01:30,659 DEBUG [StoreOpener-2700e21ceee9ee6242041ee38fc8cdfa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36619/user/jenkins/test-data/e42fbbaf-2fbf-3bc7-220c-4ace9dd84d78/testWithMapReduceAndOfflineHBaseMultiRegion/87bdb44d-c6d1-47cd-9aa3-68b079f8a6f6/data/default/testWithMapReduce/2700e21ceee9ee6242041ee38fc8cdfa/f2 2023-02-17 02:01:30,660 INFO [StoreOpener-2700e21ceee9ee6242041ee38fc8cdfa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2700e21ceee9ee6242041ee38fc8cdfa columnFamilyName f2 2023-02-17 02:01:30,665 DEBUG [StoreOpener-2700e21ceee9ee6242041ee38fc8cdfa-1] regionserver.HStore(539): loaded hdfs://localhost:36619/user/jenkins/test-data/e42fbbaf-2fbf-3bc7-220c-4ace9dd84d78/testWithMapReduceAndOfflineHBaseMultiRegion/87bdb44d-c6d1-47cd-9aa3-68b079f8a6f6/data/default/testWithMapReduce/2700e21ceee9ee6242041ee38fc8cdfa/f2/testWithMapReduce=2700e21ceee9ee6242041ee38fc8cdfa-a4b492ef88ec46e982586e9fe090e72b 2023-02-17 02:01:30,665 INFO [StoreOpener-2700e21ceee9ee6242041ee38fc8cdfa-1] regionserver.HStore(310): Store=2700e21ceee9ee6242041ee38fc8cdfa/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:30,665 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 02:01:30,665 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 2700e21ceee9ee6242041ee38fc8cdfa; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74311615, jitterRate=0.1073293536901474}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 02:01:30,665 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 2700e21ceee9ee6242041ee38fc8cdfa: 2023-02-17 02:01:30,696 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 2700e21ceee9ee6242041ee38fc8cdfa, disabling compactions & flushes 2023-02-17 02:01:30,696 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676599283172.2700e21ceee9ee6242041ee38fc8cdfa. 2023-02-17 02:01:30,696 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676599283172.2700e21ceee9ee6242041ee38fc8cdfa. 2023-02-17 02:01:30,696 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676599283172.2700e21ceee9ee6242041ee38fc8cdfa. after waiting 0 ms 2023-02-17 02:01:30,696 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676599283172.2700e21ceee9ee6242041ee38fc8cdfa. 2023-02-17 02:01:30,698 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676599283172.2700e21ceee9ee6242041ee38fc8cdfa. 2023-02-17 02:01:30,698 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 2700e21ceee9ee6242041ee38fc8cdfa: 2023-02-17 02:01:30,701 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676599283172.5b902d43bfac9401fc39fb36d68d8226.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:30,701 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 02:01:30,704 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 02:01:30,706 INFO [StoreOpener-5b902d43bfac9401fc39fb36d68d8226-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5b902d43bfac9401fc39fb36d68d8226 2023-02-17 02:01:30,707 DEBUG [StoreOpener-5b902d43bfac9401fc39fb36d68d8226-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36619/user/jenkins/test-data/e42fbbaf-2fbf-3bc7-220c-4ace9dd84d78/testWithMapReduceAndOfflineHBaseMultiRegion/87bdb44d-c6d1-47cd-9aa3-68b079f8a6f6/data/default/testWithMapReduce/5b902d43bfac9401fc39fb36d68d8226/f1 2023-02-17 02:01:30,708 INFO [StoreOpener-5b902d43bfac9401fc39fb36d68d8226-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5b902d43bfac9401fc39fb36d68d8226 columnFamilyName f1 2023-02-17 02:01:30,709 INFO [StoreOpener-5b902d43bfac9401fc39fb36d68d8226-1] regionserver.HStore(310): Store=5b902d43bfac9401fc39fb36d68d8226/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:30,709 INFO [StoreOpener-5b902d43bfac9401fc39fb36d68d8226-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5b902d43bfac9401fc39fb36d68d8226 2023-02-17 02:01:30,711 DEBUG [StoreOpener-5b902d43bfac9401fc39fb36d68d8226-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36619/user/jenkins/test-data/e42fbbaf-2fbf-3bc7-220c-4ace9dd84d78/testWithMapReduceAndOfflineHBaseMultiRegion/87bdb44d-c6d1-47cd-9aa3-68b079f8a6f6/data/default/testWithMapReduce/5b902d43bfac9401fc39fb36d68d8226/f2 2023-02-17 02:01:30,711 INFO [StoreOpener-5b902d43bfac9401fc39fb36d68d8226-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5b902d43bfac9401fc39fb36d68d8226 columnFamilyName f2 2023-02-17 02:01:30,712 INFO [StoreOpener-5b902d43bfac9401fc39fb36d68d8226-1] regionserver.HStore(310): Store=5b902d43bfac9401fc39fb36d68d8226/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:30,712 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 02:01:30,712 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 5b902d43bfac9401fc39fb36d68d8226; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69015444, jitterRate=0.028410255908966064}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 02:01:30,712 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 5b902d43bfac9401fc39fb36d68d8226: 2023-02-17 02:01:30,731 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 5b902d43bfac9401fc39fb36d68d8226, disabling compactions & flushes 2023-02-17 02:01:30,731 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676599283172.5b902d43bfac9401fc39fb36d68d8226. 2023-02-17 02:01:30,731 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676599283172.5b902d43bfac9401fc39fb36d68d8226. 2023-02-17 02:01:30,731 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676599283172.5b902d43bfac9401fc39fb36d68d8226. after waiting 0 ms 2023-02-17 02:01:30,731 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676599283172.5b902d43bfac9401fc39fb36d68d8226. 2023-02-17 02:01:30,731 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676599283172.5b902d43bfac9401fc39fb36d68d8226. 2023-02-17 02:01:30,731 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 5b902d43bfac9401fc39fb36d68d8226: 2023-02-17 02:01:30,735 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676599283172.d0c39439e95718da09586626dbdd1981.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:30,735 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 02:01:30,736 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 02:01:30,738 INFO [StoreOpener-d0c39439e95718da09586626dbdd1981-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d0c39439e95718da09586626dbdd1981 2023-02-17 02:01:30,739 DEBUG [StoreOpener-d0c39439e95718da09586626dbdd1981-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36619/user/jenkins/test-data/e42fbbaf-2fbf-3bc7-220c-4ace9dd84d78/testWithMapReduceAndOfflineHBaseMultiRegion/87bdb44d-c6d1-47cd-9aa3-68b079f8a6f6/data/default/testWithMapReduce/d0c39439e95718da09586626dbdd1981/f1 2023-02-17 02:01:30,739 INFO [StoreOpener-d0c39439e95718da09586626dbdd1981-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d0c39439e95718da09586626dbdd1981 columnFamilyName f1 2023-02-17 02:01:30,744 DEBUG [StoreOpener-d0c39439e95718da09586626dbdd1981-1] regionserver.HStore(539): loaded hdfs://localhost:36619/user/jenkins/test-data/e42fbbaf-2fbf-3bc7-220c-4ace9dd84d78/testWithMapReduceAndOfflineHBaseMultiRegion/87bdb44d-c6d1-47cd-9aa3-68b079f8a6f6/data/default/testWithMapReduce/d0c39439e95718da09586626dbdd1981/f1/testWithMapReduce=d0c39439e95718da09586626dbdd1981-cd0fe9cd085147fea9c2ec34a42ecd1b 2023-02-17 02:01:30,744 INFO [StoreOpener-d0c39439e95718da09586626dbdd1981-1] regionserver.HStore(310): Store=d0c39439e95718da09586626dbdd1981/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:30,745 INFO [StoreOpener-d0c39439e95718da09586626dbdd1981-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d0c39439e95718da09586626dbdd1981 2023-02-17 02:01:30,746 DEBUG [StoreOpener-d0c39439e95718da09586626dbdd1981-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36619/user/jenkins/test-data/e42fbbaf-2fbf-3bc7-220c-4ace9dd84d78/testWithMapReduceAndOfflineHBaseMultiRegion/87bdb44d-c6d1-47cd-9aa3-68b079f8a6f6/data/default/testWithMapReduce/d0c39439e95718da09586626dbdd1981/f2 2023-02-17 02:01:30,746 INFO [StoreOpener-d0c39439e95718da09586626dbdd1981-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d0c39439e95718da09586626dbdd1981 columnFamilyName f2 2023-02-17 02:01:30,751 DEBUG [StoreOpener-d0c39439e95718da09586626dbdd1981-1] regionserver.HStore(539): loaded hdfs://localhost:36619/user/jenkins/test-data/e42fbbaf-2fbf-3bc7-220c-4ace9dd84d78/testWithMapReduceAndOfflineHBaseMultiRegion/87bdb44d-c6d1-47cd-9aa3-68b079f8a6f6/data/default/testWithMapReduce/d0c39439e95718da09586626dbdd1981/f2/testWithMapReduce=d0c39439e95718da09586626dbdd1981-c20f6d6c1f9941a2a488560223a30b8d 2023-02-17 02:01:30,751 INFO [StoreOpener-d0c39439e95718da09586626dbdd1981-1] regionserver.HStore(310): Store=d0c39439e95718da09586626dbdd1981/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:30,751 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 02:01:30,752 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened d0c39439e95718da09586626dbdd1981; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68447506, jitterRate=0.019947320222854614}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 02:01:30,752 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for d0c39439e95718da09586626dbdd1981: 2023-02-17 02:01:30,791 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing d0c39439e95718da09586626dbdd1981, disabling compactions & flushes 2023-02-17 02:01:30,791 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676599283172.d0c39439e95718da09586626dbdd1981. 2023-02-17 02:01:30,791 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676599283172.d0c39439e95718da09586626dbdd1981. 2023-02-17 02:01:30,791 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676599283172.d0c39439e95718da09586626dbdd1981. after waiting 0 ms 2023-02-17 02:01:30,791 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676599283172.d0c39439e95718da09586626dbdd1981. 2023-02-17 02:01:30,798 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676599283172.d0c39439e95718da09586626dbdd1981. 2023-02-17 02:01:30,798 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for d0c39439e95718da09586626dbdd1981: 2023-02-17 02:01:30,802 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676599283172.76fb71705f76672ea40ce0d3b7341303.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:30,802 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 02:01:30,805 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 02:01:30,813 INFO [StoreOpener-76fb71705f76672ea40ce0d3b7341303-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 76fb71705f76672ea40ce0d3b7341303 2023-02-17 02:01:30,814 DEBUG [StoreOpener-76fb71705f76672ea40ce0d3b7341303-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36619/user/jenkins/test-data/e42fbbaf-2fbf-3bc7-220c-4ace9dd84d78/testWithMapReduceAndOfflineHBaseMultiRegion/87bdb44d-c6d1-47cd-9aa3-68b079f8a6f6/data/default/testWithMapReduce/76fb71705f76672ea40ce0d3b7341303/f1 2023-02-17 02:01:30,814 INFO [StoreOpener-76fb71705f76672ea40ce0d3b7341303-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 76fb71705f76672ea40ce0d3b7341303 columnFamilyName f1 2023-02-17 02:01:30,820 DEBUG [StoreOpener-76fb71705f76672ea40ce0d3b7341303-1] regionserver.HStore(539): loaded hdfs://localhost:36619/user/jenkins/test-data/e42fbbaf-2fbf-3bc7-220c-4ace9dd84d78/testWithMapReduceAndOfflineHBaseMultiRegion/87bdb44d-c6d1-47cd-9aa3-68b079f8a6f6/data/default/testWithMapReduce/76fb71705f76672ea40ce0d3b7341303/f1/testWithMapReduce=76fb71705f76672ea40ce0d3b7341303-af5e460408ec47dab3b88d86382ee410 2023-02-17 02:01:30,820 INFO [StoreOpener-76fb71705f76672ea40ce0d3b7341303-1] regionserver.HStore(310): Store=76fb71705f76672ea40ce0d3b7341303/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:30,820 INFO [StoreOpener-76fb71705f76672ea40ce0d3b7341303-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 76fb71705f76672ea40ce0d3b7341303 2023-02-17 02:01:30,821 DEBUG [StoreOpener-76fb71705f76672ea40ce0d3b7341303-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36619/user/jenkins/test-data/e42fbbaf-2fbf-3bc7-220c-4ace9dd84d78/testWithMapReduceAndOfflineHBaseMultiRegion/87bdb44d-c6d1-47cd-9aa3-68b079f8a6f6/data/default/testWithMapReduce/76fb71705f76672ea40ce0d3b7341303/f2 2023-02-17 02:01:30,822 INFO [StoreOpener-76fb71705f76672ea40ce0d3b7341303-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 76fb71705f76672ea40ce0d3b7341303 columnFamilyName f2 2023-02-17 02:01:30,827 DEBUG [StoreOpener-76fb71705f76672ea40ce0d3b7341303-1] regionserver.HStore(539): loaded hdfs://localhost:36619/user/jenkins/test-data/e42fbbaf-2fbf-3bc7-220c-4ace9dd84d78/testWithMapReduceAndOfflineHBaseMultiRegion/87bdb44d-c6d1-47cd-9aa3-68b079f8a6f6/data/default/testWithMapReduce/76fb71705f76672ea40ce0d3b7341303/f2/testWithMapReduce=76fb71705f76672ea40ce0d3b7341303-3d5e3d58e0dd4468ba82bb6148cd9647 2023-02-17 02:01:30,827 INFO [StoreOpener-76fb71705f76672ea40ce0d3b7341303-1] regionserver.HStore(310): Store=76fb71705f76672ea40ce0d3b7341303/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:30,827 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 02:01:30,827 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 76fb71705f76672ea40ce0d3b7341303; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66355181, jitterRate=-0.011230751872062683}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 02:01:30,827 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 76fb71705f76672ea40ce0d3b7341303: 2023-02-17 02:01:30,860 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 76fb71705f76672ea40ce0d3b7341303, disabling compactions & flushes 2023-02-17 02:01:30,860 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676599283172.76fb71705f76672ea40ce0d3b7341303. 2023-02-17 02:01:30,860 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676599283172.76fb71705f76672ea40ce0d3b7341303. 2023-02-17 02:01:30,860 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676599283172.76fb71705f76672ea40ce0d3b7341303. after waiting 0 ms 2023-02-17 02:01:30,860 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676599283172.76fb71705f76672ea40ce0d3b7341303. 2023-02-17 02:01:30,861 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676599283172.76fb71705f76672ea40ce0d3b7341303. 2023-02-17 02:01:30,861 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 76fb71705f76672ea40ce0d3b7341303: 2023-02-17 02:01:30,864 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676599283172.c087f3b958f194282116d4bdcb846998.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:30,865 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 02:01:30,866 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 02:01:30,868 INFO [StoreOpener-c087f3b958f194282116d4bdcb846998-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c087f3b958f194282116d4bdcb846998 2023-02-17 02:01:30,868 DEBUG [StoreOpener-c087f3b958f194282116d4bdcb846998-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36619/user/jenkins/test-data/e42fbbaf-2fbf-3bc7-220c-4ace9dd84d78/testWithMapReduceAndOfflineHBaseMultiRegion/87bdb44d-c6d1-47cd-9aa3-68b079f8a6f6/data/default/testWithMapReduce/c087f3b958f194282116d4bdcb846998/f1 2023-02-17 02:01:30,869 INFO [StoreOpener-c087f3b958f194282116d4bdcb846998-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c087f3b958f194282116d4bdcb846998 columnFamilyName f1 2023-02-17 02:01:30,874 DEBUG [StoreOpener-c087f3b958f194282116d4bdcb846998-1] regionserver.HStore(539): loaded hdfs://localhost:36619/user/jenkins/test-data/e42fbbaf-2fbf-3bc7-220c-4ace9dd84d78/testWithMapReduceAndOfflineHBaseMultiRegion/87bdb44d-c6d1-47cd-9aa3-68b079f8a6f6/data/default/testWithMapReduce/c087f3b958f194282116d4bdcb846998/f1/testWithMapReduce=c087f3b958f194282116d4bdcb846998-98ec870aaabb42f9a6a2c32e566935d4 2023-02-17 02:01:30,874 INFO [StoreOpener-c087f3b958f194282116d4bdcb846998-1] regionserver.HStore(310): Store=c087f3b958f194282116d4bdcb846998/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:30,874 INFO [StoreOpener-c087f3b958f194282116d4bdcb846998-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c087f3b958f194282116d4bdcb846998 2023-02-17 02:01:30,875 DEBUG [StoreOpener-c087f3b958f194282116d4bdcb846998-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36619/user/jenkins/test-data/e42fbbaf-2fbf-3bc7-220c-4ace9dd84d78/testWithMapReduceAndOfflineHBaseMultiRegion/87bdb44d-c6d1-47cd-9aa3-68b079f8a6f6/data/default/testWithMapReduce/c087f3b958f194282116d4bdcb846998/f2 2023-02-17 02:01:30,876 INFO [StoreOpener-c087f3b958f194282116d4bdcb846998-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c087f3b958f194282116d4bdcb846998 columnFamilyName f2 2023-02-17 02:01:30,880 DEBUG [StoreOpener-c087f3b958f194282116d4bdcb846998-1] regionserver.HStore(539): loaded hdfs://localhost:36619/user/jenkins/test-data/e42fbbaf-2fbf-3bc7-220c-4ace9dd84d78/testWithMapReduceAndOfflineHBaseMultiRegion/87bdb44d-c6d1-47cd-9aa3-68b079f8a6f6/data/default/testWithMapReduce/c087f3b958f194282116d4bdcb846998/f2/testWithMapReduce=c087f3b958f194282116d4bdcb846998-5b08c323ca4d4c02ba7b497e70601e82 2023-02-17 02:01:30,880 INFO [StoreOpener-c087f3b958f194282116d4bdcb846998-1] regionserver.HStore(310): Store=c087f3b958f194282116d4bdcb846998/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:30,881 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 02:01:30,881 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened c087f3b958f194282116d4bdcb846998; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75295862, jitterRate=0.12199577689170837}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 02:01:30,881 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for c087f3b958f194282116d4bdcb846998: 2023-02-17 02:01:30,911 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing c087f3b958f194282116d4bdcb846998, disabling compactions & flushes 2023-02-17 02:01:30,911 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676599283172.c087f3b958f194282116d4bdcb846998. 2023-02-17 02:01:30,911 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676599283172.c087f3b958f194282116d4bdcb846998. 2023-02-17 02:01:30,911 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676599283172.c087f3b958f194282116d4bdcb846998. after waiting 0 ms 2023-02-17 02:01:30,911 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676599283172.c087f3b958f194282116d4bdcb846998. 2023-02-17 02:01:30,912 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676599283172.c087f3b958f194282116d4bdcb846998. 2023-02-17 02:01:30,912 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for c087f3b958f194282116d4bdcb846998: 2023-02-17 02:01:30,915 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676599283172.6fd84418026599548312cefaa7aa3bbe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:30,915 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 02:01:30,916 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 02:01:30,918 INFO [StoreOpener-6fd84418026599548312cefaa7aa3bbe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 6fd84418026599548312cefaa7aa3bbe 2023-02-17 02:01:30,920 DEBUG [StoreOpener-6fd84418026599548312cefaa7aa3bbe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36619/user/jenkins/test-data/e42fbbaf-2fbf-3bc7-220c-4ace9dd84d78/testWithMapReduceAndOfflineHBaseMultiRegion/87bdb44d-c6d1-47cd-9aa3-68b079f8a6f6/data/default/testWithMapReduce/6fd84418026599548312cefaa7aa3bbe/f1 2023-02-17 02:01:30,920 INFO [StoreOpener-6fd84418026599548312cefaa7aa3bbe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6fd84418026599548312cefaa7aa3bbe columnFamilyName f1 2023-02-17 02:01:30,921 INFO [StoreOpener-6fd84418026599548312cefaa7aa3bbe-1] regionserver.HStore(310): Store=6fd84418026599548312cefaa7aa3bbe/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:30,921 INFO [StoreOpener-6fd84418026599548312cefaa7aa3bbe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 6fd84418026599548312cefaa7aa3bbe 2023-02-17 02:01:30,922 DEBUG [StoreOpener-6fd84418026599548312cefaa7aa3bbe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36619/user/jenkins/test-data/e42fbbaf-2fbf-3bc7-220c-4ace9dd84d78/testWithMapReduceAndOfflineHBaseMultiRegion/87bdb44d-c6d1-47cd-9aa3-68b079f8a6f6/data/default/testWithMapReduce/6fd84418026599548312cefaa7aa3bbe/f2 2023-02-17 02:01:30,922 INFO [StoreOpener-6fd84418026599548312cefaa7aa3bbe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6fd84418026599548312cefaa7aa3bbe columnFamilyName f2 2023-02-17 02:01:30,923 INFO [StoreOpener-6fd84418026599548312cefaa7aa3bbe-1] regionserver.HStore(310): Store=6fd84418026599548312cefaa7aa3bbe/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:30,923 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 02:01:30,924 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 6fd84418026599548312cefaa7aa3bbe; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65062812, jitterRate=-0.030488550662994385}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 02:01:30,924 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 6fd84418026599548312cefaa7aa3bbe: 2023-02-17 02:01:30,941 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 6fd84418026599548312cefaa7aa3bbe, disabling compactions & flushes 2023-02-17 02:01:30,941 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676599283172.6fd84418026599548312cefaa7aa3bbe. 2023-02-17 02:01:30,941 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676599283172.6fd84418026599548312cefaa7aa3bbe. 2023-02-17 02:01:30,941 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676599283172.6fd84418026599548312cefaa7aa3bbe. after waiting 0 ms 2023-02-17 02:01:30,941 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676599283172.6fd84418026599548312cefaa7aa3bbe. 2023-02-17 02:01:30,941 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676599283172.6fd84418026599548312cefaa7aa3bbe. 2023-02-17 02:01:30,941 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 6fd84418026599548312cefaa7aa3bbe: 2023-02-17 02:01:31,342 INFO [Listener at localhost/46551] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-17 02:01:31,343 WARN [Listener at localhost/46551] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-17 02:01:31,349 INFO [Listener at localhost/46551] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-17 02:01:31,452 WARN [BP-424417974-172.31.14.131-1676599280878 heartbeating to localhost/127.0.0.1:36619] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-17 02:01:31,452 WARN [BP-424417974-172.31.14.131-1676599280878 heartbeating to localhost/127.0.0.1:36619] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-424417974-172.31.14.131-1676599280878 (Datanode Uuid 8ca3a3e5-11a6-4775-8d0f-a9cce0b3d215) service to localhost/127.0.0.1:36619 2023-02-17 02:01:31,453 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1b0266e-bab7-2139-00bf-960e9cca3a54/cluster_644caca6-26f9-eef7-aee2-cdd95793493a/dfs/data/data3/current/BP-424417974-172.31.14.131-1676599280878] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 02:01:31,453 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1b0266e-bab7-2139-00bf-960e9cca3a54/cluster_644caca6-26f9-eef7-aee2-cdd95793493a/dfs/data/data4/current/BP-424417974-172.31.14.131-1676599280878] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 02:01:31,454 WARN [Listener at localhost/46551] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-17 02:01:31,457 INFO [Listener at localhost/46551] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-17 02:01:31,561 WARN [BP-424417974-172.31.14.131-1676599280878 heartbeating to localhost/127.0.0.1:36619] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-17 02:01:31,561 WARN [BP-424417974-172.31.14.131-1676599280878 heartbeating to localhost/127.0.0.1:36619] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-424417974-172.31.14.131-1676599280878 (Datanode Uuid 9f9a53ee-72ab-4bb9-9992-b3102189cfaa) service to localhost/127.0.0.1:36619 2023-02-17 02:01:31,562 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1b0266e-bab7-2139-00bf-960e9cca3a54/cluster_644caca6-26f9-eef7-aee2-cdd95793493a/dfs/data/data1/current/BP-424417974-172.31.14.131-1676599280878] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 02:01:31,563 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1b0266e-bab7-2139-00bf-960e9cca3a54/cluster_644caca6-26f9-eef7-aee2-cdd95793493a/dfs/data/data2/current/BP-424417974-172.31.14.131-1676599280878] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 02:01:31,574 INFO [Listener at localhost/46551] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-17 02:01:31,693 INFO [Listener at localhost/46551] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-17 02:01:31,738 INFO [Listener at localhost/46551] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-17 02:01:31,752 INFO [Listener at localhost/46551] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=155 (was 103) Potentially hanging thread: RS-EventLoopGroup-8-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1508527786) connection to localhost/127.0.0.1:36619 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-9-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/46551 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1508527786) connection to localhost/127.0.0.1:36619 from jenkins.hfs.2 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-7-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-3-worker-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: (jenkins-hbase4.apache.org,36043,1676599281810)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1508527786) connection to localhost/127.0.0.1:36619 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins.hfs.3@localhost:36619 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.2@localhost:36619 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:36619 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'DataNode' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: IPC Client (1508527786) connection to localhost/127.0.0.1:36619 from jenkins.hfs.3 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-3-worker-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: RS-EventLoopGroup-6-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=538 (was 551), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=347 (was 318) - SystemLoadAverage LEAK? -, ProcessCount=170 (was 170), AvailableMemoryMB=7717 (was 8240) 2023-02-17 02:01:31,762 INFO [Listener at localhost/46551] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=155, OpenFileDescriptor=538, MaxFileDescriptor=60000, SystemLoadAverage=347, ProcessCount=170, AvailableMemoryMB=7717 2023-02-17 02:01:31,774 INFO [Listener at localhost/46551] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1b0266e-bab7-2139-00bf-960e9cca3a54/hadoop.log.dir so I do NOT create it in target/test-data/b95c4b67-2ebf-d7a6-fc30-de669ab715d0 2023-02-17 02:01:31,774 WARN [Listener at localhost/46551] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1b0266e-bab7-2139-00bf-960e9cca3a54/hadoop.log.dir Erasing configuration value by system value. 2023-02-17 02:01:31,774 INFO [Listener at localhost/46551] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1b0266e-bab7-2139-00bf-960e9cca3a54/hadoop.tmp.dir so I do NOT create it in target/test-data/b95c4b67-2ebf-d7a6-fc30-de669ab715d0 2023-02-17 02:01:31,774 WARN [Listener at localhost/46551] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1b0266e-bab7-2139-00bf-960e9cca3a54/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-17 02:01:31,774 DEBUG [Listener at localhost/46551] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b95c4b67-2ebf-d7a6-fc30-de669ab715d0 2023-02-17 02:01:31,775 INFO [Listener at localhost/46551] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-17 02:01:31,775 INFO [Listener at localhost/46551] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b95c4b67-2ebf-d7a6-fc30-de669ab715d0/cluster_606d4d2a-7354-0975-eec9-6025b3f65465, deleteOnExit=true 2023-02-17 02:01:31,775 INFO [Listener at localhost/46551] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-17 02:01:31,775 INFO [Listener at localhost/46551] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b95c4b67-2ebf-d7a6-fc30-de669ab715d0/test.cache.data in system properties and HBase conf 2023-02-17 02:01:31,775 INFO [Listener at localhost/46551] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b95c4b67-2ebf-d7a6-fc30-de669ab715d0/hadoop.tmp.dir in system properties and HBase conf 2023-02-17 02:01:31,775 INFO [Listener at localhost/46551] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b95c4b67-2ebf-d7a6-fc30-de669ab715d0/hadoop.log.dir in system properties and HBase conf 2023-02-17 02:01:31,775 INFO [Listener at localhost/46551] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b95c4b67-2ebf-d7a6-fc30-de669ab715d0/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-17 02:01:31,775 INFO [Listener at localhost/46551] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b95c4b67-2ebf-d7a6-fc30-de669ab715d0/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-17 02:01:31,775 INFO [Listener at localhost/46551] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-17 02:01:31,775 DEBUG [Listener at localhost/46551] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-17 02:01:31,776 INFO [Listener at localhost/46551] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b95c4b67-2ebf-d7a6-fc30-de669ab715d0/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-17 02:01:31,776 INFO [Listener at localhost/46551] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b95c4b67-2ebf-d7a6-fc30-de669ab715d0/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-17 02:01:31,776 INFO [Listener at localhost/46551] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b95c4b67-2ebf-d7a6-fc30-de669ab715d0/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-17 02:01:31,776 INFO [Listener at localhost/46551] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b95c4b67-2ebf-d7a6-fc30-de669ab715d0/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-17 02:01:31,776 INFO [Listener at localhost/46551] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b95c4b67-2ebf-d7a6-fc30-de669ab715d0/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-17 02:01:31,776 INFO [Listener at localhost/46551] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b95c4b67-2ebf-d7a6-fc30-de669ab715d0/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-17 02:01:31,776 INFO [Listener at localhost/46551] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b95c4b67-2ebf-d7a6-fc30-de669ab715d0/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-17 02:01:31,776 INFO [Listener at localhost/46551] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b95c4b67-2ebf-d7a6-fc30-de669ab715d0/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-17 02:01:31,777 INFO [Listener at localhost/46551] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b95c4b67-2ebf-d7a6-fc30-de669ab715d0/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-17 02:01:31,777 INFO [Listener at localhost/46551] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b95c4b67-2ebf-d7a6-fc30-de669ab715d0/nfs.dump.dir in system properties and HBase conf 2023-02-17 02:01:31,777 INFO [Listener at localhost/46551] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b95c4b67-2ebf-d7a6-fc30-de669ab715d0/java.io.tmpdir in system properties and HBase conf 2023-02-17 02:01:31,777 INFO [Listener at localhost/46551] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b95c4b67-2ebf-d7a6-fc30-de669ab715d0/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-17 02:01:31,777 INFO [Listener at localhost/46551] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b95c4b67-2ebf-d7a6-fc30-de669ab715d0/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-17 02:01:31,777 INFO [Listener at localhost/46551] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b95c4b67-2ebf-d7a6-fc30-de669ab715d0/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-17 02:01:31,782 WARN [Listener at localhost/46551] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-17 02:01:31,782 WARN [Listener at localhost/46551] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-17 02:01:31,847 WARN [Listener at localhost/46551] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-17 02:01:31,850 INFO [Listener at localhost/46551] log.Slf4jLog(67): jetty-6.1.26 2023-02-17 02:01:31,859 INFO [Listener at localhost/46551] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b95c4b67-2ebf-d7a6-fc30-de669ab715d0/java.io.tmpdir/Jetty_localhost_43139_hdfs____ql3qci/webapp 2023-02-17 02:01:31,967 INFO [Listener at localhost/46551] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43139 2023-02-17 02:01:31,972 WARN [Listener at localhost/46551] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-17 02:01:31,972 WARN [Listener at localhost/46551] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-17 02:01:32,016 WARN [Listener at localhost/35647] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-17 02:01:32,029 WARN [Listener at localhost/35647] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-17 02:01:32,031 WARN [Listener at localhost/35647] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-17 02:01:32,032 INFO [Listener at localhost/35647] log.Slf4jLog(67): jetty-6.1.26 2023-02-17 02:01:32,038 INFO [Listener at localhost/35647] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b95c4b67-2ebf-d7a6-fc30-de669ab715d0/java.io.tmpdir/Jetty_localhost_35819_datanode____oxp1gl/webapp 2023-02-17 02:01:32,147 INFO [Listener at localhost/35647] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35819 2023-02-17 02:01:32,157 WARN [Listener at localhost/42217] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-17 02:01:32,191 WARN [Listener at localhost/42217] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-17 02:01:32,193 WARN [Listener at localhost/42217] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-17 02:01:32,194 INFO [Listener at localhost/42217] log.Slf4jLog(67): jetty-6.1.26 2023-02-17 02:01:32,199 INFO [Listener at localhost/42217] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b95c4b67-2ebf-d7a6-fc30-de669ab715d0/java.io.tmpdir/Jetty_localhost_41097_datanode____.xhkwko/webapp 2023-02-17 02:01:32,262 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4537ff8c76b19b28: Processing first storage report for DS-b70bec12-8bc9-4d4e-9889-ece1bdab4259 from datanode d876c189-dc76-45ff-8b95-2cd79b854c37 2023-02-17 02:01:32,262 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4537ff8c76b19b28: from storage DS-b70bec12-8bc9-4d4e-9889-ece1bdab4259 node DatanodeRegistration(127.0.0.1:45147, datanodeUuid=d876c189-dc76-45ff-8b95-2cd79b854c37, infoPort=35595, infoSecurePort=0, ipcPort=42217, storageInfo=lv=-57;cid=testClusterID;nsid=720402040;c=1676599291806), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-17 02:01:32,262 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4537ff8c76b19b28: Processing first storage report for DS-c1df8ef6-ee42-487a-9f41-e6d4d5f7dd73 from datanode d876c189-dc76-45ff-8b95-2cd79b854c37 2023-02-17 02:01:32,262 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4537ff8c76b19b28: from storage DS-c1df8ef6-ee42-487a-9f41-e6d4d5f7dd73 node DatanodeRegistration(127.0.0.1:45147, datanodeUuid=d876c189-dc76-45ff-8b95-2cd79b854c37, infoPort=35595, infoSecurePort=0, ipcPort=42217, storageInfo=lv=-57;cid=testClusterID;nsid=720402040;c=1676599291806), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-17 02:01:32,296 INFO [Listener at localhost/42217] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41097 2023-02-17 02:01:32,306 WARN [Listener at localhost/38639] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-17 02:01:32,425 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x15ef644bd720ea93: Processing first storage report for DS-ea23432d-b5bd-4d05-aeb4-e92dce23b4b1 from datanode b4ac1ed5-68e3-49f9-ac06-b2b2856f020b 2023-02-17 02:01:32,425 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x15ef644bd720ea93: from storage DS-ea23432d-b5bd-4d05-aeb4-e92dce23b4b1 node DatanodeRegistration(127.0.0.1:46463, datanodeUuid=b4ac1ed5-68e3-49f9-ac06-b2b2856f020b, infoPort=39199, infoSecurePort=0, ipcPort=38639, storageInfo=lv=-57;cid=testClusterID;nsid=720402040;c=1676599291806), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-17 02:01:32,425 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x15ef644bd720ea93: Processing first storage report for DS-7a59b2fa-fd77-4179-846a-ba92feb65863 from datanode b4ac1ed5-68e3-49f9-ac06-b2b2856f020b 2023-02-17 02:01:32,425 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x15ef644bd720ea93: from storage DS-7a59b2fa-fd77-4179-846a-ba92feb65863 node DatanodeRegistration(127.0.0.1:46463, datanodeUuid=b4ac1ed5-68e3-49f9-ac06-b2b2856f020b, infoPort=39199, infoSecurePort=0, ipcPort=38639, storageInfo=lv=-57;cid=testClusterID;nsid=720402040;c=1676599291806), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-17 02:01:32,525 DEBUG [Listener at localhost/38639] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b95c4b67-2ebf-d7a6-fc30-de669ab715d0 2023-02-17 02:01:32,527 INFO [Listener at localhost/38639] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b95c4b67-2ebf-d7a6-fc30-de669ab715d0/cluster_606d4d2a-7354-0975-eec9-6025b3f65465/zookeeper_0, clientPort=55691, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b95c4b67-2ebf-d7a6-fc30-de669ab715d0/cluster_606d4d2a-7354-0975-eec9-6025b3f65465/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b95c4b67-2ebf-d7a6-fc30-de669ab715d0/cluster_606d4d2a-7354-0975-eec9-6025b3f65465/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-17 02:01:32,528 INFO [Listener at localhost/38639] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=55691 2023-02-17 02:01:32,528 INFO [Listener at localhost/38639] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 02:01:32,529 INFO [Listener at localhost/38639] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 02:01:32,540 INFO [Listener at localhost/38639] util.FSUtils(479): Created version file at hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b with version=8 2023-02-17 02:01:32,541 INFO [Listener at localhost/38639] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 02:01:32,541 INFO [Listener at localhost/38639] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 02:01:32,542 INFO [Listener at localhost/38639] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:35647/user/jenkins/test-data/94cc82d3-b594-2e37-50e7-49756463a5b9/hbase-staging 2023-02-17 02:01:32,544 INFO [Listener at localhost/38639] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-17 02:01:32,544 INFO [Listener at localhost/38639] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 02:01:32,544 INFO [Listener at localhost/38639] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-17 02:01:32,544 INFO [Listener at localhost/38639] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-17 02:01:32,545 INFO [Listener at localhost/38639] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 02:01:32,545 INFO [Listener at localhost/38639] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-17 02:01:32,545 INFO [Listener at localhost/38639] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-17 02:01:32,546 INFO [Listener at localhost/38639] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41793 2023-02-17 02:01:32,547 INFO [Listener at localhost/38639] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 02:01:32,547 INFO [Listener at localhost/38639] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 02:01:32,548 INFO [Listener at localhost/38639] zookeeper.RecoverableZooKeeper(93): Process identifier=master:41793 connecting to ZooKeeper ensemble=127.0.0.1:55691 2023-02-17 02:01:32,558 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): master:417930x0, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-17 02:01:32,559 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:41793-0x1006002dc330000 connected 2023-02-17 02:01:32,573 DEBUG [Listener at localhost/38639] zookeeper.ZKUtil(164): master:41793-0x1006002dc330000, quorum=127.0.0.1:55691, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 02:01:32,574 DEBUG [Listener at localhost/38639] zookeeper.ZKUtil(164): master:41793-0x1006002dc330000, quorum=127.0.0.1:55691, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 02:01:32,574 DEBUG [Listener at localhost/38639] zookeeper.ZKUtil(164): master:41793-0x1006002dc330000, quorum=127.0.0.1:55691, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-17 02:01:32,575 DEBUG [Listener at localhost/38639] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41793 2023-02-17 02:01:32,575 DEBUG [Listener at localhost/38639] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41793 2023-02-17 02:01:32,575 DEBUG [Listener at localhost/38639] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41793 2023-02-17 02:01:32,575 DEBUG [Listener at localhost/38639] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41793 2023-02-17 02:01:32,576 DEBUG [Listener at localhost/38639] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41793 2023-02-17 02:01:32,576 INFO [Listener at localhost/38639] master.HMaster(444): hbase.rootdir=hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b, hbase.cluster.distributed=false 2023-02-17 02:01:32,588 INFO [Listener at localhost/38639] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-17 02:01:32,589 INFO [Listener at localhost/38639] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 02:01:32,589 INFO [Listener at localhost/38639] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-17 02:01:32,589 INFO [Listener at localhost/38639] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-17 02:01:32,589 INFO [Listener at localhost/38639] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 02:01:32,589 INFO [Listener at localhost/38639] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-17 02:01:32,589 INFO [Listener at localhost/38639] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-17 02:01:32,590 INFO [Listener at localhost/38639] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41441 2023-02-17 02:01:32,591 INFO [Listener at localhost/38639] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-17 02:01:32,592 DEBUG [Listener at localhost/38639] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 02:01:32,592 INFO [Listener at localhost/38639] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 02:01:32,593 INFO [Listener at localhost/38639] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 02:01:32,594 INFO [Listener at localhost/38639] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41441 connecting to ZooKeeper ensemble=127.0.0.1:55691 2023-02-17 02:01:32,597 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): regionserver:414410x0, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-17 02:01:32,598 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:41441-0x1006002dc330001 connected 2023-02-17 02:01:32,599 DEBUG [Listener at localhost/38639] zookeeper.ZKUtil(164): regionserver:41441-0x1006002dc330001, quorum=127.0.0.1:55691, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 02:01:32,599 DEBUG [Listener at localhost/38639] zookeeper.ZKUtil(164): regionserver:41441-0x1006002dc330001, quorum=127.0.0.1:55691, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 02:01:32,600 DEBUG [Listener at localhost/38639] zookeeper.ZKUtil(164): regionserver:41441-0x1006002dc330001, quorum=127.0.0.1:55691, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-17 02:01:32,603 DEBUG [Listener at localhost/38639] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41441 2023-02-17 02:01:32,603 DEBUG [Listener at localhost/38639] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41441 2023-02-17 02:01:32,603 DEBUG [Listener at localhost/38639] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41441 2023-02-17 02:01:32,604 DEBUG [Listener at localhost/38639] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41441 2023-02-17 02:01:32,604 DEBUG [Listener at localhost/38639] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41441 2023-02-17 02:01:32,615 INFO [Listener at localhost/38639] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-17 02:01:32,615 INFO [Listener at localhost/38639] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 02:01:32,616 INFO [Listener at localhost/38639] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-17 02:01:32,616 INFO [Listener at localhost/38639] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-17 02:01:32,616 INFO [Listener at localhost/38639] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 02:01:32,616 INFO [Listener at localhost/38639] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-17 02:01:32,616 INFO [Listener at localhost/38639] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-17 02:01:32,617 INFO [Listener at localhost/38639] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45887 2023-02-17 02:01:32,618 INFO [Listener at localhost/38639] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-17 02:01:32,620 DEBUG [Listener at localhost/38639] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 02:01:32,620 INFO [Listener at localhost/38639] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 02:01:32,621 INFO [Listener at localhost/38639] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 02:01:32,622 INFO [Listener at localhost/38639] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45887 connecting to ZooKeeper ensemble=127.0.0.1:55691 2023-02-17 02:01:32,625 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): regionserver:458870x0, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-17 02:01:32,627 DEBUG [Listener at localhost/38639] zookeeper.ZKUtil(164): regionserver:458870x0, quorum=127.0.0.1:55691, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 02:01:32,627 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:45887-0x1006002dc330002 connected 2023-02-17 02:01:32,627 DEBUG [Listener at localhost/38639] zookeeper.ZKUtil(164): regionserver:45887-0x1006002dc330002, quorum=127.0.0.1:55691, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 02:01:32,628 DEBUG [Listener at localhost/38639] zookeeper.ZKUtil(164): regionserver:45887-0x1006002dc330002, quorum=127.0.0.1:55691, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-17 02:01:32,630 DEBUG [Listener at localhost/38639] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45887 2023-02-17 02:01:32,630 DEBUG [Listener at localhost/38639] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45887 2023-02-17 02:01:32,630 DEBUG [Listener at localhost/38639] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45887 2023-02-17 02:01:32,632 DEBUG [Listener at localhost/38639] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45887 2023-02-17 02:01:32,632 DEBUG [Listener at localhost/38639] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45887 2023-02-17 02:01:32,633 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,41793,1676599292544 2023-02-17 02:01:32,634 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006002dc330000, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-17 02:01:32,635 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41793-0x1006002dc330000, quorum=127.0.0.1:55691, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,41793,1676599292544 2023-02-17 02:01:32,636 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006002dc330000, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-17 02:01:32,636 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): regionserver:45887-0x1006002dc330002, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-17 02:01:32,636 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006002dc330000, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 02:01:32,636 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): regionserver:41441-0x1006002dc330001, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-17 02:01:32,637 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41793-0x1006002dc330000, quorum=127.0.0.1:55691, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-17 02:01:32,639 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,41793,1676599292544 from backup master directory 2023-02-17 02:01:32,639 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:41793-0x1006002dc330000, quorum=127.0.0.1:55691, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-17 02:01:32,641 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006002dc330000, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,41793,1676599292544 2023-02-17 02:01:32,641 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006002dc330000, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-17 02:01:32,641 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-17 02:01:32,641 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,41793,1676599292544 2023-02-17 02:01:32,652 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/hbase.id with ID: fb3dce66-2f5c-4e3c-9fd4-e0ae444feb06 2023-02-17 02:01:32,662 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 02:01:32,670 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006002dc330000, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 02:01:32,679 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x78842134 to 127.0.0.1:55691 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 02:01:32,686 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6e8c13ed, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 02:01:32,687 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-17 02:01:32,687 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-17 02:01:32,687 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 02:01:32,688 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/MasterData/data/master/store-tmp 2023-02-17 02:01:32,695 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:32,695 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-17 02:01:32,695 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 02:01:32,695 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 02:01:32,695 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-17 02:01:32,695 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 02:01:32,695 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 02:01:32,695 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-17 02:01:32,696 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/MasterData/WALs/jenkins-hbase4.apache.org,41793,1676599292544 2023-02-17 02:01:32,698 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41793%2C1676599292544, suffix=, logDir=hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/MasterData/WALs/jenkins-hbase4.apache.org,41793,1676599292544, archiveDir=hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/MasterData/oldWALs, maxLogs=10 2023-02-17 02:01:32,717 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46463,DS-ea23432d-b5bd-4d05-aeb4-e92dce23b4b1,DISK] 2023-02-17 02:01:32,717 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45147,DS-b70bec12-8bc9-4d4e-9889-ece1bdab4259,DISK] 2023-02-17 02:01:32,720 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/MasterData/WALs/jenkins-hbase4.apache.org,41793,1676599292544/jenkins-hbase4.apache.org%2C41793%2C1676599292544.1676599292698 2023-02-17 02:01:32,720 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46463,DS-ea23432d-b5bd-4d05-aeb4-e92dce23b4b1,DISK], DatanodeInfoWithStorage[127.0.0.1:45147,DS-b70bec12-8bc9-4d4e-9889-ece1bdab4259,DISK]] 2023-02-17 02:01:32,720 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-17 02:01:32,720 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:32,720 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-17 02:01:32,720 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-17 02:01:32,721 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-17 02:01:32,723 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-17 02:01:32,723 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-17 02:01:32,723 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:32,724 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-17 02:01:32,724 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-17 02:01:32,726 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-17 02:01:32,728 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 02:01:32,728 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59423760, jitterRate=-0.1145169734954834}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-17 02:01:32,728 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-17 02:01:32,728 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-17 02:01:32,730 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-17 02:01:32,730 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-17 02:01:32,730 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-17 02:01:32,730 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-17 02:01:32,730 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-17 02:01:32,730 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-17 02:01:32,731 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-17 02:01:32,732 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-17 02:01:32,742 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-17 02:01:32,742 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-17 02:01:32,742 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41793-0x1006002dc330000, quorum=127.0.0.1:55691, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-17 02:01:32,743 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-17 02:01:32,743 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41793-0x1006002dc330000, quorum=127.0.0.1:55691, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-17 02:01:32,745 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006002dc330000, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 02:01:32,745 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41793-0x1006002dc330000, quorum=127.0.0.1:55691, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-17 02:01:32,745 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41793-0x1006002dc330000, quorum=127.0.0.1:55691, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-17 02:01:32,746 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41793-0x1006002dc330000, quorum=127.0.0.1:55691, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-17 02:01:32,748 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006002dc330000, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-17 02:01:32,748 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): regionserver:41441-0x1006002dc330001, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-17 02:01:32,748 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): regionserver:45887-0x1006002dc330002, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-17 02:01:32,748 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006002dc330000, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 02:01:32,750 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,41793,1676599292544, sessionid=0x1006002dc330000, setting cluster-up flag (Was=false) 2023-02-17 02:01:32,753 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006002dc330000, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 02:01:32,758 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-17 02:01:32,758 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,41793,1676599292544 2023-02-17 02:01:32,761 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006002dc330000, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 02:01:32,766 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-17 02:01:32,766 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,41793,1676599292544 2023-02-17 02:01:32,767 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/.hbase-snapshot/.tmp 2023-02-17 02:01:32,769 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-17 02:01:32,769 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-17 02:01:32,769 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-17 02:01:32,769 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-17 02:01:32,769 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-17 02:01:32,769 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-17 02:01:32,769 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:32,769 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-17 02:01:32,769 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:32,770 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676599322770 2023-02-17 02:01:32,771 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-17 02:01:32,771 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-17 02:01:32,771 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-17 02:01:32,771 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-17 02:01:32,771 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-17 02:01:32,771 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-17 02:01:32,771 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:32,772 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-17 02:01:32,772 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-17 02:01:32,772 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-17 02:01:32,772 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-17 02:01:32,772 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-17 02:01:32,772 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-17 02:01:32,773 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-17 02:01:32,773 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676599292773,5,FailOnTimeoutGroup] 2023-02-17 02:01:32,773 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676599292773,5,FailOnTimeoutGroup] 2023-02-17 02:01:32,773 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:32,773 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-17 02:01:32,773 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:32,773 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:32,773 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-17 02:01:32,787 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-17 02:01:32,788 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-17 02:01:32,788 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b 2023-02-17 02:01:32,794 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:32,795 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-17 02:01:32,796 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/data/hbase/meta/1588230740/info 2023-02-17 02:01:32,797 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-17 02:01:32,797 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:32,797 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-17 02:01:32,798 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/data/hbase/meta/1588230740/rep_barrier 2023-02-17 02:01:32,798 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-17 02:01:32,799 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:32,799 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-17 02:01:32,800 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/data/hbase/meta/1588230740/table 2023-02-17 02:01:32,800 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-17 02:01:32,800 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:32,801 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/data/hbase/meta/1588230740 2023-02-17 02:01:32,801 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/data/hbase/meta/1588230740 2023-02-17 02:01:32,803 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-17 02:01:32,804 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-17 02:01:32,805 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 02:01:32,806 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66419900, jitterRate=-0.010266363620758057}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-17 02:01:32,806 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-17 02:01:32,806 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-17 02:01:32,806 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-17 02:01:32,806 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-17 02:01:32,806 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-17 02:01:32,806 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-17 02:01:32,807 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-17 02:01:32,807 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-17 02:01:32,808 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-17 02:01:32,808 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-17 02:01:32,808 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-17 02:01:32,810 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-17 02:01:32,811 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-17 02:01:32,834 INFO [RS:0;jenkins-hbase4:41441] regionserver.HRegionServer(952): ClusterId : fb3dce66-2f5c-4e3c-9fd4-e0ae444feb06 2023-02-17 02:01:32,834 DEBUG [RS:0;jenkins-hbase4:41441] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-17 02:01:32,834 INFO [RS:1;jenkins-hbase4:45887] regionserver.HRegionServer(952): ClusterId : fb3dce66-2f5c-4e3c-9fd4-e0ae444feb06 2023-02-17 02:01:32,834 DEBUG [RS:1;jenkins-hbase4:45887] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-17 02:01:32,838 DEBUG [RS:0;jenkins-hbase4:41441] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-17 02:01:32,838 DEBUG [RS:0;jenkins-hbase4:41441] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-17 02:01:32,838 DEBUG [RS:1;jenkins-hbase4:45887] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-17 02:01:32,838 DEBUG [RS:1;jenkins-hbase4:45887] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-17 02:01:32,840 DEBUG [RS:0;jenkins-hbase4:41441] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-17 02:01:32,841 DEBUG [RS:1;jenkins-hbase4:45887] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-17 02:01:32,841 DEBUG [RS:0;jenkins-hbase4:41441] zookeeper.ReadOnlyZKClient(139): Connect 0x521ae249 to 127.0.0.1:55691 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 02:01:32,842 DEBUG [RS:1;jenkins-hbase4:45887] zookeeper.ReadOnlyZKClient(139): Connect 0x32d56191 to 127.0.0.1:55691 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 02:01:32,851 DEBUG [RS:0;jenkins-hbase4:41441] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5cdd167a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 02:01:32,851 DEBUG [RS:0;jenkins-hbase4:41441] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@58e28939, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-17 02:01:32,860 DEBUG [RS:1;jenkins-hbase4:45887] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3c1299bb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 02:01:32,860 DEBUG [RS:1;jenkins-hbase4:45887] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@382d0ae1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-17 02:01:32,861 DEBUG [RS:0;jenkins-hbase4:41441] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:41441 2023-02-17 02:01:32,861 INFO [RS:0;jenkins-hbase4:41441] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-17 02:01:32,861 INFO [RS:0;jenkins-hbase4:41441] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-17 02:01:32,861 DEBUG [RS:0;jenkins-hbase4:41441] regionserver.HRegionServer(1023): About to register with Master. 2023-02-17 02:01:32,861 INFO [RS:0;jenkins-hbase4:41441] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,41793,1676599292544 with isa=jenkins-hbase4.apache.org/172.31.14.131:41441, startcode=1676599292588 2023-02-17 02:01:32,862 DEBUG [RS:0;jenkins-hbase4:41441] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-17 02:01:32,866 INFO [RS-EventLoopGroup-9-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43525, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.4 (auth:SIMPLE), service=RegionServerStatusService 2023-02-17 02:01:32,868 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,41441,1676599292588 2023-02-17 02:01:32,869 DEBUG [RS:0;jenkins-hbase4:41441] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b 2023-02-17 02:01:32,869 DEBUG [RS:0;jenkins-hbase4:41441] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:35647 2023-02-17 02:01:32,869 DEBUG [RS:0;jenkins-hbase4:41441] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-17 02:01:32,871 DEBUG [RS:1;jenkins-hbase4:45887] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:45887 2023-02-17 02:01:32,871 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006002dc330000, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 02:01:32,871 INFO [RS:1;jenkins-hbase4:45887] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-17 02:01:32,871 INFO [RS:1;jenkins-hbase4:45887] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-17 02:01:32,871 DEBUG [RS:1;jenkins-hbase4:45887] regionserver.HRegionServer(1023): About to register with Master. 2023-02-17 02:01:32,871 DEBUG [RS:0;jenkins-hbase4:41441] zookeeper.ZKUtil(162): regionserver:41441-0x1006002dc330001, quorum=127.0.0.1:55691, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41441,1676599292588 2023-02-17 02:01:32,871 WARN [RS:0;jenkins-hbase4:41441] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-17 02:01:32,871 INFO [RS:0;jenkins-hbase4:41441] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 02:01:32,872 DEBUG [RS:0;jenkins-hbase4:41441] regionserver.HRegionServer(1947): logDir=hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/WALs/jenkins-hbase4.apache.org,41441,1676599292588 2023-02-17 02:01:32,872 INFO [RS:1;jenkins-hbase4:45887] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,41793,1676599292544 with isa=jenkins-hbase4.apache.org/172.31.14.131:45887, startcode=1676599292615 2023-02-17 02:01:32,872 DEBUG [RS:1;jenkins-hbase4:45887] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-17 02:01:32,872 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,41441,1676599292588] 2023-02-17 02:01:32,876 INFO [RS-EventLoopGroup-9-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35295, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.5 (auth:SIMPLE), service=RegionServerStatusService 2023-02-17 02:01:32,877 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,45887,1676599292615 2023-02-17 02:01:32,877 DEBUG [RS:1;jenkins-hbase4:45887] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b 2023-02-17 02:01:32,877 DEBUG [RS:1;jenkins-hbase4:45887] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:35647 2023-02-17 02:01:32,877 DEBUG [RS:1;jenkins-hbase4:45887] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-17 02:01:32,882 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006002dc330000, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 02:01:32,883 DEBUG [RS:1;jenkins-hbase4:45887] zookeeper.ZKUtil(162): regionserver:45887-0x1006002dc330002, quorum=127.0.0.1:55691, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45887,1676599292615 2023-02-17 02:01:32,883 WARN [RS:1;jenkins-hbase4:45887] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-17 02:01:32,883 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,45887,1676599292615] 2023-02-17 02:01:32,883 INFO [RS:1;jenkins-hbase4:45887] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 02:01:32,883 DEBUG [RS:1;jenkins-hbase4:45887] regionserver.HRegionServer(1947): logDir=hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/WALs/jenkins-hbase4.apache.org,45887,1676599292615 2023-02-17 02:01:32,883 DEBUG [RS:0;jenkins-hbase4:41441] zookeeper.ZKUtil(162): regionserver:41441-0x1006002dc330001, quorum=127.0.0.1:55691, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41441,1676599292588 2023-02-17 02:01:32,884 DEBUG [RS:0;jenkins-hbase4:41441] zookeeper.ZKUtil(162): regionserver:41441-0x1006002dc330001, quorum=127.0.0.1:55691, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45887,1676599292615 2023-02-17 02:01:32,886 DEBUG [RS:0;jenkins-hbase4:41441] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-17 02:01:32,886 INFO [RS:0;jenkins-hbase4:41441] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-17 02:01:32,888 INFO [RS:0;jenkins-hbase4:41441] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-17 02:01:32,890 DEBUG [RS:1;jenkins-hbase4:45887] zookeeper.ZKUtil(162): regionserver:45887-0x1006002dc330002, quorum=127.0.0.1:55691, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41441,1676599292588 2023-02-17 02:01:32,891 INFO [RS:0;jenkins-hbase4:41441] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-17 02:01:32,891 INFO [RS:0;jenkins-hbase4:41441] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:32,891 DEBUG [RS:1;jenkins-hbase4:45887] zookeeper.ZKUtil(162): regionserver:45887-0x1006002dc330002, quorum=127.0.0.1:55691, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45887,1676599292615 2023-02-17 02:01:32,892 INFO [RS:0;jenkins-hbase4:41441] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-17 02:01:32,893 DEBUG [RS:1;jenkins-hbase4:45887] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-17 02:01:32,893 INFO [RS:1;jenkins-hbase4:45887] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-17 02:01:32,893 INFO [RS:0;jenkins-hbase4:41441] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:32,894 DEBUG [RS:0;jenkins-hbase4:41441] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:32,894 DEBUG [RS:0;jenkins-hbase4:41441] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:32,894 DEBUG [RS:0;jenkins-hbase4:41441] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:32,894 DEBUG [RS:0;jenkins-hbase4:41441] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:32,894 DEBUG [RS:0;jenkins-hbase4:41441] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:32,894 DEBUG [RS:0;jenkins-hbase4:41441] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-17 02:01:32,894 DEBUG [RS:0;jenkins-hbase4:41441] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:32,894 DEBUG [RS:0;jenkins-hbase4:41441] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:32,894 DEBUG [RS:0;jenkins-hbase4:41441] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:32,894 DEBUG [RS:0;jenkins-hbase4:41441] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:32,900 INFO [RS:0;jenkins-hbase4:41441] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:32,900 INFO [RS:0;jenkins-hbase4:41441] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:32,900 INFO [RS:0;jenkins-hbase4:41441] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:32,901 INFO [RS:1;jenkins-hbase4:45887] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-17 02:01:32,908 INFO [RS:1;jenkins-hbase4:45887] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-17 02:01:32,908 INFO [RS:1;jenkins-hbase4:45887] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:32,909 INFO [RS:1;jenkins-hbase4:45887] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-17 02:01:32,911 INFO [RS:1;jenkins-hbase4:45887] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:32,911 DEBUG [RS:1;jenkins-hbase4:45887] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:32,912 DEBUG [RS:1;jenkins-hbase4:45887] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:32,912 DEBUG [RS:1;jenkins-hbase4:45887] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:32,912 DEBUG [RS:1;jenkins-hbase4:45887] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:32,912 DEBUG [RS:1;jenkins-hbase4:45887] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:32,912 DEBUG [RS:1;jenkins-hbase4:45887] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-17 02:01:32,912 DEBUG [RS:1;jenkins-hbase4:45887] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:32,912 DEBUG [RS:1;jenkins-hbase4:45887] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:32,912 DEBUG [RS:1;jenkins-hbase4:45887] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:32,912 DEBUG [RS:1;jenkins-hbase4:45887] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:32,917 INFO [RS:0;jenkins-hbase4:41441] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-17 02:01:32,917 INFO [RS:0;jenkins-hbase4:41441] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41441,1676599292588-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:32,918 INFO [RS:1;jenkins-hbase4:45887] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:32,918 INFO [RS:1;jenkins-hbase4:45887] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:32,918 INFO [RS:1;jenkins-hbase4:45887] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:32,934 INFO [RS:1;jenkins-hbase4:45887] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-17 02:01:32,935 INFO [RS:1;jenkins-hbase4:45887] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45887,1676599292615-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:32,936 INFO [RS:0;jenkins-hbase4:41441] regionserver.Replication(203): jenkins-hbase4.apache.org,41441,1676599292588 started 2023-02-17 02:01:32,936 INFO [RS:0;jenkins-hbase4:41441] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,41441,1676599292588, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:41441, sessionid=0x1006002dc330001 2023-02-17 02:01:32,936 DEBUG [RS:0;jenkins-hbase4:41441] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-17 02:01:32,936 DEBUG [RS:0;jenkins-hbase4:41441] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,41441,1676599292588 2023-02-17 02:01:32,936 DEBUG [RS:0;jenkins-hbase4:41441] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41441,1676599292588' 2023-02-17 02:01:32,936 DEBUG [RS:0;jenkins-hbase4:41441] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 02:01:32,936 DEBUG [RS:0;jenkins-hbase4:41441] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 02:01:32,937 DEBUG [RS:0;jenkins-hbase4:41441] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-17 02:01:32,937 DEBUG [RS:0;jenkins-hbase4:41441] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-17 02:01:32,937 DEBUG [RS:0;jenkins-hbase4:41441] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,41441,1676599292588 2023-02-17 02:01:32,937 DEBUG [RS:0;jenkins-hbase4:41441] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41441,1676599292588' 2023-02-17 02:01:32,937 DEBUG [RS:0;jenkins-hbase4:41441] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 02:01:32,937 DEBUG [RS:0;jenkins-hbase4:41441] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 02:01:32,938 DEBUG [RS:0;jenkins-hbase4:41441] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-17 02:01:32,938 INFO [RS:0;jenkins-hbase4:41441] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-17 02:01:32,938 INFO [RS:0;jenkins-hbase4:41441] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-17 02:01:32,947 INFO [RS:1;jenkins-hbase4:45887] regionserver.Replication(203): jenkins-hbase4.apache.org,45887,1676599292615 started 2023-02-17 02:01:32,947 INFO [RS:1;jenkins-hbase4:45887] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,45887,1676599292615, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:45887, sessionid=0x1006002dc330002 2023-02-17 02:01:32,947 DEBUG [RS:1;jenkins-hbase4:45887] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-17 02:01:32,947 DEBUG [RS:1;jenkins-hbase4:45887] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,45887,1676599292615 2023-02-17 02:01:32,947 DEBUG [RS:1;jenkins-hbase4:45887] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45887,1676599292615' 2023-02-17 02:01:32,947 DEBUG [RS:1;jenkins-hbase4:45887] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 02:01:32,948 DEBUG [RS:1;jenkins-hbase4:45887] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 02:01:32,948 DEBUG [RS:1;jenkins-hbase4:45887] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-17 02:01:32,948 DEBUG [RS:1;jenkins-hbase4:45887] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-17 02:01:32,948 DEBUG [RS:1;jenkins-hbase4:45887] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,45887,1676599292615 2023-02-17 02:01:32,948 DEBUG [RS:1;jenkins-hbase4:45887] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45887,1676599292615' 2023-02-17 02:01:32,948 DEBUG [RS:1;jenkins-hbase4:45887] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 02:01:32,948 DEBUG [RS:1;jenkins-hbase4:45887] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 02:01:32,949 DEBUG [RS:1;jenkins-hbase4:45887] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-17 02:01:32,949 INFO [RS:1;jenkins-hbase4:45887] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-17 02:01:32,949 INFO [RS:1;jenkins-hbase4:45887] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-17 02:01:32,961 DEBUG [jenkins-hbase4:41793] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-17 02:01:32,962 DEBUG [jenkins-hbase4:41793] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-17 02:01:32,963 DEBUG [jenkins-hbase4:41793] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-17 02:01:32,963 DEBUG [jenkins-hbase4:41793] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-17 02:01:32,963 DEBUG [jenkins-hbase4:41793] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-17 02:01:32,964 INFO [PEWorker-2] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,45887,1676599292615, state=OPENING 2023-02-17 02:01:32,966 DEBUG [PEWorker-2] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-17 02:01:32,967 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006002dc330000, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 02:01:32,968 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-17 02:01:32,968 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,45887,1676599292615}] 2023-02-17 02:01:33,122 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,45887,1676599292615 2023-02-17 02:01:33,123 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-17 02:01:33,124 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57566, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-17 02:01:33,132 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-17 02:01:33,132 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 02:01:33,133 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45887%2C1676599292615.meta, suffix=.meta, logDir=hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/WALs/jenkins-hbase4.apache.org,45887,1676599292615, archiveDir=hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/oldWALs, maxLogs=32 2023-02-17 02:01:33,150 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46463,DS-ea23432d-b5bd-4d05-aeb4-e92dce23b4b1,DISK] 2023-02-17 02:01:33,150 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45147,DS-b70bec12-8bc9-4d4e-9889-ece1bdab4259,DISK] 2023-02-17 02:01:33,152 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/WALs/jenkins-hbase4.apache.org,45887,1676599292615/jenkins-hbase4.apache.org%2C45887%2C1676599292615.meta.1676599293134.meta 2023-02-17 02:01:33,152 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46463,DS-ea23432d-b5bd-4d05-aeb4-e92dce23b4b1,DISK], DatanodeInfoWithStorage[127.0.0.1:45147,DS-b70bec12-8bc9-4d4e-9889-ece1bdab4259,DISK]] 2023-02-17 02:01:33,152 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-17 02:01:33,152 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-17 02:01:33,152 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-17 02:01:33,152 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-17 02:01:33,152 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-17 02:01:33,152 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:33,152 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-17 02:01:33,153 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-17 02:01:33,154 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-17 02:01:33,155 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/data/hbase/meta/1588230740/info 2023-02-17 02:01:33,155 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/data/hbase/meta/1588230740/info 2023-02-17 02:01:33,155 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-17 02:01:33,155 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:33,156 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-17 02:01:33,156 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/data/hbase/meta/1588230740/rep_barrier 2023-02-17 02:01:33,156 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/data/hbase/meta/1588230740/rep_barrier 2023-02-17 02:01:33,157 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-17 02:01:33,157 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:33,157 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-17 02:01:33,158 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/data/hbase/meta/1588230740/table 2023-02-17 02:01:33,158 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/data/hbase/meta/1588230740/table 2023-02-17 02:01:33,158 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-17 02:01:33,159 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:33,160 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/data/hbase/meta/1588230740 2023-02-17 02:01:33,161 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/data/hbase/meta/1588230740 2023-02-17 02:01:33,163 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-17 02:01:33,164 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-17 02:01:33,165 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65587762, jitterRate=-0.022666186094284058}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-17 02:01:33,165 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-17 02:01:33,166 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676599293122 2023-02-17 02:01:33,170 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-17 02:01:33,170 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-17 02:01:33,170 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,45887,1676599292615, state=OPEN 2023-02-17 02:01:33,173 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006002dc330000, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-17 02:01:33,173 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-17 02:01:33,174 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-17 02:01:33,174 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,45887,1676599292615 in 206 msec 2023-02-17 02:01:33,176 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-17 02:01:33,176 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 366 msec 2023-02-17 02:01:33,177 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 408 msec 2023-02-17 02:01:33,178 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676599293177, completionTime=-1 2023-02-17 02:01:33,178 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-17 02:01:33,178 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-17 02:01:33,182 DEBUG [hconnection-0x12c41a91-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 02:01:33,183 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57574, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 02:01:33,184 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-17 02:01:33,184 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676599353184 2023-02-17 02:01:33,184 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676599413184 2023-02-17 02:01:33,184 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 6 msec 2023-02-17 02:01:33,191 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41793,1676599292544-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:33,191 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41793,1676599292544-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:33,191 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41793,1676599292544-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:33,191 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:41793, period=300000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:33,191 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:33,192 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-17 02:01:33,192 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-17 02:01:33,193 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-17 02:01:33,193 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-17 02:01:33,194 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-17 02:01:33,194 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-17 02:01:33,196 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/.tmp/data/hbase/namespace/17cca714e8ffe02e2c2e71e0cb0506f8 2023-02-17 02:01:33,196 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/.tmp/data/hbase/namespace/17cca714e8ffe02e2c2e71e0cb0506f8 empty. 2023-02-17 02:01:33,197 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/.tmp/data/hbase/namespace/17cca714e8ffe02e2c2e71e0cb0506f8 2023-02-17 02:01:33,197 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-17 02:01:33,205 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-17 02:01:33,207 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 17cca714e8ffe02e2c2e71e0cb0506f8, NAME => 'hbase:namespace,,1676599293192.17cca714e8ffe02e2c2e71e0cb0506f8.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/.tmp 2023-02-17 02:01:33,214 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676599293192.17cca714e8ffe02e2c2e71e0cb0506f8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:33,214 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 17cca714e8ffe02e2c2e71e0cb0506f8, disabling compactions & flushes 2023-02-17 02:01:33,214 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676599293192.17cca714e8ffe02e2c2e71e0cb0506f8. 2023-02-17 02:01:33,214 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676599293192.17cca714e8ffe02e2c2e71e0cb0506f8. 2023-02-17 02:01:33,214 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676599293192.17cca714e8ffe02e2c2e71e0cb0506f8. after waiting 0 ms 2023-02-17 02:01:33,214 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676599293192.17cca714e8ffe02e2c2e71e0cb0506f8. 2023-02-17 02:01:33,214 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676599293192.17cca714e8ffe02e2c2e71e0cb0506f8. 2023-02-17 02:01:33,214 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 17cca714e8ffe02e2c2e71e0cb0506f8: 2023-02-17 02:01:33,216 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-17 02:01:33,217 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676599293192.17cca714e8ffe02e2c2e71e0cb0506f8.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676599293217"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676599293217"}]},"ts":"1676599293217"} 2023-02-17 02:01:33,219 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-17 02:01:33,220 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-17 02:01:33,220 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676599293220"}]},"ts":"1676599293220"} 2023-02-17 02:01:33,222 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-17 02:01:33,226 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-17 02:01:33,227 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-17 02:01:33,227 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-17 02:01:33,227 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-17 02:01:33,227 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=17cca714e8ffe02e2c2e71e0cb0506f8, ASSIGN}] 2023-02-17 02:01:33,230 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=17cca714e8ffe02e2c2e71e0cb0506f8, ASSIGN 2023-02-17 02:01:33,230 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=17cca714e8ffe02e2c2e71e0cb0506f8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45887,1676599292615; forceNewPlan=false, retain=false 2023-02-17 02:01:33,381 INFO [jenkins-hbase4:41793] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-17 02:01:33,382 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=17cca714e8ffe02e2c2e71e0cb0506f8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45887,1676599292615 2023-02-17 02:01:33,382 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676599293192.17cca714e8ffe02e2c2e71e0cb0506f8.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676599293382"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676599293382"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676599293382"}]},"ts":"1676599293382"} 2023-02-17 02:01:33,384 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 17cca714e8ffe02e2c2e71e0cb0506f8, server=jenkins-hbase4.apache.org,45887,1676599292615}] 2023-02-17 02:01:33,541 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676599293192.17cca714e8ffe02e2c2e71e0cb0506f8. 2023-02-17 02:01:33,543 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45887%2C1676599292615, suffix=, logDir=hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/WALs/jenkins-hbase4.apache.org,45887,1676599292615, archiveDir=hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/oldWALs, maxLogs=32 2023-02-17 02:01:33,563 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46463,DS-ea23432d-b5bd-4d05-aeb4-e92dce23b4b1,DISK] 2023-02-17 02:01:33,565 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45147,DS-b70bec12-8bc9-4d4e-9889-ece1bdab4259,DISK] 2023-02-17 02:01:33,569 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/WALs/jenkins-hbase4.apache.org,45887,1676599292615/jenkins-hbase4.apache.org%2C45887%2C1676599292615.1676599293544 2023-02-17 02:01:33,574 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46463,DS-ea23432d-b5bd-4d05-aeb4-e92dce23b4b1,DISK], DatanodeInfoWithStorage[127.0.0.1:45147,DS-b70bec12-8bc9-4d4e-9889-ece1bdab4259,DISK]] 2023-02-17 02:01:33,574 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 17cca714e8ffe02e2c2e71e0cb0506f8, NAME => 'hbase:namespace,,1676599293192.17cca714e8ffe02e2c2e71e0cb0506f8.', STARTKEY => '', ENDKEY => ''} 2023-02-17 02:01:33,574 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 17cca714e8ffe02e2c2e71e0cb0506f8 2023-02-17 02:01:33,574 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676599293192.17cca714e8ffe02e2c2e71e0cb0506f8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:33,574 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 17cca714e8ffe02e2c2e71e0cb0506f8 2023-02-17 02:01:33,574 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 17cca714e8ffe02e2c2e71e0cb0506f8 2023-02-17 02:01:33,576 INFO [StoreOpener-17cca714e8ffe02e2c2e71e0cb0506f8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 17cca714e8ffe02e2c2e71e0cb0506f8 2023-02-17 02:01:33,577 DEBUG [StoreOpener-17cca714e8ffe02e2c2e71e0cb0506f8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/data/hbase/namespace/17cca714e8ffe02e2c2e71e0cb0506f8/info 2023-02-17 02:01:33,577 DEBUG [StoreOpener-17cca714e8ffe02e2c2e71e0cb0506f8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/data/hbase/namespace/17cca714e8ffe02e2c2e71e0cb0506f8/info 2023-02-17 02:01:33,578 INFO [StoreOpener-17cca714e8ffe02e2c2e71e0cb0506f8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 17cca714e8ffe02e2c2e71e0cb0506f8 columnFamilyName info 2023-02-17 02:01:33,578 INFO [StoreOpener-17cca714e8ffe02e2c2e71e0cb0506f8-1] regionserver.HStore(310): Store=17cca714e8ffe02e2c2e71e0cb0506f8/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:33,579 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/data/hbase/namespace/17cca714e8ffe02e2c2e71e0cb0506f8 2023-02-17 02:01:33,580 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/data/hbase/namespace/17cca714e8ffe02e2c2e71e0cb0506f8 2023-02-17 02:01:33,585 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 17cca714e8ffe02e2c2e71e0cb0506f8 2023-02-17 02:01:33,587 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/data/hbase/namespace/17cca714e8ffe02e2c2e71e0cb0506f8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 02:01:33,587 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 17cca714e8ffe02e2c2e71e0cb0506f8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71299400, jitterRate=0.06244385242462158}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-17 02:01:33,587 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 17cca714e8ffe02e2c2e71e0cb0506f8: 2023-02-17 02:01:33,588 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676599293192.17cca714e8ffe02e2c2e71e0cb0506f8., pid=6, masterSystemTime=1676599293537 2023-02-17 02:01:33,590 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676599293192.17cca714e8ffe02e2c2e71e0cb0506f8. 2023-02-17 02:01:33,591 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676599293192.17cca714e8ffe02e2c2e71e0cb0506f8. 2023-02-17 02:01:33,591 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=17cca714e8ffe02e2c2e71e0cb0506f8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45887,1676599292615 2023-02-17 02:01:33,591 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676599293192.17cca714e8ffe02e2c2e71e0cb0506f8.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676599293591"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676599293591"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676599293591"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676599293591"}]},"ts":"1676599293591"} 2023-02-17 02:01:33,594 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-17 02:01:33,594 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 17cca714e8ffe02e2c2e71e0cb0506f8, server=jenkins-hbase4.apache.org,45887,1676599292615 in 208 msec 2023-02-17 02:01:33,596 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-17 02:01:33,596 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=17cca714e8ffe02e2c2e71e0cb0506f8, ASSIGN in 367 msec 2023-02-17 02:01:33,596 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-17 02:01:33,596 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676599293596"}]},"ts":"1676599293596"} 2023-02-17 02:01:33,598 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-17 02:01:33,600 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-17 02:01:33,601 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 408 msec 2023-02-17 02:01:33,694 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41793-0x1006002dc330000, quorum=127.0.0.1:55691, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-17 02:01:33,695 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006002dc330000, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-17 02:01:33,695 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006002dc330000, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 02:01:33,700 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-17 02:01:33,709 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006002dc330000, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-17 02:01:33,712 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 12 msec 2023-02-17 02:01:33,721 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-17 02:01:33,728 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006002dc330000, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-17 02:01:33,731 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 9 msec 2023-02-17 02:01:33,737 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006002dc330000, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-17 02:01:33,739 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006002dc330000, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-17 02:01:33,739 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.098sec 2023-02-17 02:01:33,739 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-17 02:01:33,739 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-17 02:01:33,739 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-17 02:01:33,739 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41793,1676599292544-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-17 02:01:33,739 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41793,1676599292544-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-17 02:01:33,741 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-17 02:01:33,834 DEBUG [Listener at localhost/38639] zookeeper.ReadOnlyZKClient(139): Connect 0x37c7b0a0 to 127.0.0.1:55691 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 02:01:33,841 DEBUG [Listener at localhost/38639] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1b222c9d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 02:01:33,842 DEBUG [hconnection-0x36812912-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 02:01:33,844 INFO [RS-EventLoopGroup-11-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52606, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 02:01:33,845 INFO [Listener at localhost/38639] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,41793,1676599292544 2023-02-17 02:01:33,846 DEBUG [Listener at localhost/38639] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-17 02:01:33,848 DEBUG [Listener at localhost/38639] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-17 02:01:33,849 INFO [RS-EventLoopGroup-9-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58526, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-17 02:01:33,850 INFO [Listener at localhost/38639] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-17 02:01:33,850 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testInitTableSnapshotMapperJobConfig 2023-02-17 02:01:33,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-17 02:01:33,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 97 connection: 172.31.14.131:58526 deadline: 1676599353850, exception=org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig 2023-02-17 02:01:33,851 INFO [Listener at localhost/38639] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testInitTableSnapshotMapperJobConfig' 2023-02-17 02:01:33,853 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-17 02:01:33,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-17 02:01:33,856 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_PRE_OPERATION 2023-02-17 02:01:33,856 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testInitTableSnapshotMapperJobConfig" procId is: 10 2023-02-17 02:01:33,857 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-17 02:01:33,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 02:01:33,859 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/.tmp/data/default/testInitTableSnapshotMapperJobConfig/b090cc996c90343b893637dd38d6e671 2023-02-17 02:01:33,859 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/.tmp/data/default/testInitTableSnapshotMapperJobConfig/b090cc996c90343b893637dd38d6e671 empty. 2023-02-17 02:01:33,859 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/.tmp/data/default/testInitTableSnapshotMapperJobConfig/b090cc996c90343b893637dd38d6e671 2023-02-17 02:01:33,860 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-17 02:01:33,868 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/.tmp/data/default/testInitTableSnapshotMapperJobConfig/.tabledesc/.tableinfo.0000000001 2023-02-17 02:01:33,869 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(7671): creating {ENCODED => b090cc996c90343b893637dd38d6e671, NAME => 'testInitTableSnapshotMapperJobConfig,,1676599293853.b090cc996c90343b893637dd38d6e671.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/.tmp 2023-02-17 02:01:33,875 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676599293853.b090cc996c90343b893637dd38d6e671.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:33,875 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1603): Closing b090cc996c90343b893637dd38d6e671, disabling compactions & flushes 2023-02-17 02:01:33,875 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676599293853.b090cc996c90343b893637dd38d6e671. 2023-02-17 02:01:33,875 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676599293853.b090cc996c90343b893637dd38d6e671. 2023-02-17 02:01:33,875 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676599293853.b090cc996c90343b893637dd38d6e671. after waiting 0 ms 2023-02-17 02:01:33,875 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676599293853.b090cc996c90343b893637dd38d6e671. 2023-02-17 02:01:33,876 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676599293853.b090cc996c90343b893637dd38d6e671. 2023-02-17 02:01:33,876 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1557): Region close journal for b090cc996c90343b893637dd38d6e671: 2023-02-17 02:01:33,877 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ADD_TO_META 2023-02-17 02:01:33,878 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1676599293853.b090cc996c90343b893637dd38d6e671.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676599293878"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676599293878"}]},"ts":"1676599293878"} 2023-02-17 02:01:33,880 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-17 02:01:33,880 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-17 02:01:33,881 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676599293880"}]},"ts":"1676599293880"} 2023-02-17 02:01:33,882 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLING in hbase:meta 2023-02-17 02:01:33,885 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-17 02:01:33,886 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-17 02:01:33,886 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-17 02:01:33,886 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-17 02:01:33,886 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=b090cc996c90343b893637dd38d6e671, ASSIGN}] 2023-02-17 02:01:33,888 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=b090cc996c90343b893637dd38d6e671, ASSIGN 2023-02-17 02:01:33,888 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=b090cc996c90343b893637dd38d6e671, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41441,1676599292588; forceNewPlan=false, retain=false 2023-02-17 02:01:33,940 INFO [RS:0;jenkins-hbase4:41441] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41441%2C1676599292588, suffix=, logDir=hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/WALs/jenkins-hbase4.apache.org,41441,1676599292588, archiveDir=hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/oldWALs, maxLogs=32 2023-02-17 02:01:33,955 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45147,DS-b70bec12-8bc9-4d4e-9889-ece1bdab4259,DISK] 2023-02-17 02:01:33,955 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46463,DS-ea23432d-b5bd-4d05-aeb4-e92dce23b4b1,DISK] 2023-02-17 02:01:33,957 INFO [RS:0;jenkins-hbase4:41441] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/WALs/jenkins-hbase4.apache.org,41441,1676599292588/jenkins-hbase4.apache.org%2C41441%2C1676599292588.1676599293940 2023-02-17 02:01:33,957 DEBUG [RS:0;jenkins-hbase4:41441] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45147,DS-b70bec12-8bc9-4d4e-9889-ece1bdab4259,DISK], DatanodeInfoWithStorage[127.0.0.1:46463,DS-ea23432d-b5bd-4d05-aeb4-e92dce23b4b1,DISK]] 2023-02-17 02:01:33,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 02:01:34,039 INFO [jenkins-hbase4:41793] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-17 02:01:34,040 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=b090cc996c90343b893637dd38d6e671, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41441,1676599292588 2023-02-17 02:01:34,040 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1676599293853.b090cc996c90343b893637dd38d6e671.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676599294040"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676599294040"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676599294040"}]},"ts":"1676599294040"} 2023-02-17 02:01:34,042 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure b090cc996c90343b893637dd38d6e671, server=jenkins-hbase4.apache.org,41441,1676599292588}] 2023-02-17 02:01:34,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 02:01:34,195 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,41441,1676599292588 2023-02-17 02:01:34,195 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-17 02:01:34,197 INFO [RS-EventLoopGroup-10-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33492, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-17 02:01:34,201 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testInitTableSnapshotMapperJobConfig,,1676599293853.b090cc996c90343b893637dd38d6e671. 2023-02-17 02:01:34,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => b090cc996c90343b893637dd38d6e671, NAME => 'testInitTableSnapshotMapperJobConfig,,1676599293853.b090cc996c90343b893637dd38d6e671.', STARTKEY => '', ENDKEY => ''} 2023-02-17 02:01:34,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testInitTableSnapshotMapperJobConfig b090cc996c90343b893637dd38d6e671 2023-02-17 02:01:34,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676599293853.b090cc996c90343b893637dd38d6e671.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:34,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for b090cc996c90343b893637dd38d6e671 2023-02-17 02:01:34,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for b090cc996c90343b893637dd38d6e671 2023-02-17 02:01:34,202 INFO [StoreOpener-b090cc996c90343b893637dd38d6e671-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b090cc996c90343b893637dd38d6e671 2023-02-17 02:01:34,204 DEBUG [StoreOpener-b090cc996c90343b893637dd38d6e671-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/data/default/testInitTableSnapshotMapperJobConfig/b090cc996c90343b893637dd38d6e671/f1 2023-02-17 02:01:34,204 DEBUG [StoreOpener-b090cc996c90343b893637dd38d6e671-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/data/default/testInitTableSnapshotMapperJobConfig/b090cc996c90343b893637dd38d6e671/f1 2023-02-17 02:01:34,204 INFO [StoreOpener-b090cc996c90343b893637dd38d6e671-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b090cc996c90343b893637dd38d6e671 columnFamilyName f1 2023-02-17 02:01:34,204 INFO [StoreOpener-b090cc996c90343b893637dd38d6e671-1] regionserver.HStore(310): Store=b090cc996c90343b893637dd38d6e671/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:34,205 INFO [StoreOpener-b090cc996c90343b893637dd38d6e671-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b090cc996c90343b893637dd38d6e671 2023-02-17 02:01:34,206 DEBUG [StoreOpener-b090cc996c90343b893637dd38d6e671-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/data/default/testInitTableSnapshotMapperJobConfig/b090cc996c90343b893637dd38d6e671/f2 2023-02-17 02:01:34,206 DEBUG [StoreOpener-b090cc996c90343b893637dd38d6e671-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/data/default/testInitTableSnapshotMapperJobConfig/b090cc996c90343b893637dd38d6e671/f2 2023-02-17 02:01:34,206 INFO [StoreOpener-b090cc996c90343b893637dd38d6e671-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b090cc996c90343b893637dd38d6e671 columnFamilyName f2 2023-02-17 02:01:34,206 INFO [StoreOpener-b090cc996c90343b893637dd38d6e671-1] regionserver.HStore(310): Store=b090cc996c90343b893637dd38d6e671/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:34,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/data/default/testInitTableSnapshotMapperJobConfig/b090cc996c90343b893637dd38d6e671 2023-02-17 02:01:34,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/data/default/testInitTableSnapshotMapperJobConfig/b090cc996c90343b893637dd38d6e671 2023-02-17 02:01:34,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testInitTableSnapshotMapperJobConfig descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 02:01:34,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for b090cc996c90343b893637dd38d6e671 2023-02-17 02:01:34,212 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/data/default/testInitTableSnapshotMapperJobConfig/b090cc996c90343b893637dd38d6e671/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 02:01:34,212 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened b090cc996c90343b893637dd38d6e671; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66380060, jitterRate=-0.010860025882720947}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 02:01:34,212 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for b090cc996c90343b893637dd38d6e671: 2023-02-17 02:01:34,213 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testInitTableSnapshotMapperJobConfig,,1676599293853.b090cc996c90343b893637dd38d6e671., pid=12, masterSystemTime=1676599294195 2023-02-17 02:01:34,217 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=b090cc996c90343b893637dd38d6e671, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41441,1676599292588 2023-02-17 02:01:34,217 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testInitTableSnapshotMapperJobConfig,,1676599293853.b090cc996c90343b893637dd38d6e671.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676599294217"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676599294217"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676599294217"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676599294217"}]},"ts":"1676599294217"} 2023-02-17 02:01:34,218 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testInitTableSnapshotMapperJobConfig,,1676599293853.b090cc996c90343b893637dd38d6e671. 2023-02-17 02:01:34,218 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testInitTableSnapshotMapperJobConfig,,1676599293853.b090cc996c90343b893637dd38d6e671. 2023-02-17 02:01:34,221 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-17 02:01:34,221 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure b090cc996c90343b893637dd38d6e671, server=jenkins-hbase4.apache.org,41441,1676599292588 in 178 msec 2023-02-17 02:01:34,222 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-17 02:01:34,222 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=b090cc996c90343b893637dd38d6e671, ASSIGN in 335 msec 2023-02-17 02:01:34,223 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-17 02:01:34,223 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676599294223"}]},"ts":"1676599294223"} 2023-02-17 02:01:34,224 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLED in hbase:meta 2023-02-17 02:01:34,226 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_POST_OPERATION 2023-02-17 02:01:34,228 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig in 374 msec 2023-02-17 02:01:34,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 02:01:34,462 INFO [Listener at localhost/38639] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 10 completed 2023-02-17 02:01:34,462 DEBUG [Listener at localhost/38639] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testInitTableSnapshotMapperJobConfig get assigned. Timeout = 60000ms 2023-02-17 02:01:34,463 INFO [Listener at localhost/38639] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-17 02:01:34,465 INFO [Listener at localhost/38639] hbase.HBaseTestingUtility(3484): All regions for table testInitTableSnapshotMapperJobConfig assigned to meta. Checking AM states. 2023-02-17 02:01:34,465 INFO [Listener at localhost/38639] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-17 02:01:34,465 INFO [Listener at localhost/38639] hbase.HBaseTestingUtility(3504): All regions for table testInitTableSnapshotMapperJobConfig assigned. 2023-02-17 02:01:34,465 INFO [Listener at localhost/38639] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-17 02:01:34,486 DEBUG [hconnection-0x36812912-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 02:01:34,508 INFO [RS-EventLoopGroup-10-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33498, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 02:01:34,516 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41441] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testInitTableSnapshotMapperJobConfig,,1676599293853.b090cc996c90343b893637dd38d6e671. 2023-02-17 02:01:34,627 INFO [Listener at localhost/38639] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-17 02:01:34,627 INFO [Listener at localhost/38639] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-17 02:01:34,628 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-17 02:01:34,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676599294628 (current time:1676599294628). 2023-02-17 02:01:34,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-17 02:01:34,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] zookeeper.ReadOnlyZKClient(139): Connect 0x2ec5a6da to 127.0.0.1:55691 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 02:01:34,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6242a369, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 02:01:34,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 02:01:34,636 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52614, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 02:01:34,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2ec5a6da to 127.0.0.1:55691 2023-02-17 02:01:34,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 02:01:34,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-17 02:01:34,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-17 02:01:34,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-17 02:01:34,641 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-17 02:01:34,641 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE; timeout=600000, timestamp=1676599894641 2023-02-17 02:01:34,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-17 02:01:34,641 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig 2023-02-17 02:01:34,642 DEBUG [Listener at localhost/38639] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-17 02:01:34,642 DEBUG [Listener at localhost/38639] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-17 02:01:34,643 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-17 02:01:34,643 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-17 02:01:34,644 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE in 4 msec 2023-02-17 02:01:34,645 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-17 02:01:34,645 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED; timeout=600000, timestamp=1676599894645 2023-02-17 02:01:34,660 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-17 02:01:34,661 INFO [(jenkins-hbase4.apache.org,41793,1676599292544)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-17 02:01:34,661 DEBUG [(jenkins-hbase4.apache.org,41793,1676599292544)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-17 02:01:34,662 DEBUG [(jenkins-hbase4.apache.org,41793,1676599292544)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-17 02:01:34,662 DEBUG [(jenkins-hbase4.apache.org,41793,1676599292544)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-17 02:01:34,662 DEBUG [(jenkins-hbase4.apache.org,41793,1676599292544)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41793-0x1006002dc330000, quorum=127.0.0.1:55691, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-17 02:01:34,662 DEBUG [(jenkins-hbase4.apache.org,41793,1676599292544)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-17 02:01:34,664 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): regionserver:41441-0x1006002dc330001, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 02:01:34,664 DEBUG [(jenkins-hbase4.apache.org,41793,1676599292544)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,41441,1676599292588 2023-02-17 02:01:34,664 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): regionserver:45887-0x1006002dc330002, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 02:01:34,664 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 02:01:34,664 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 02:01:34,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 02:01:34,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 02:01:34,664 DEBUG [(jenkins-hbase4.apache.org,41793,1676599292544)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41793-0x1006002dc330000, quorum=127.0.0.1:55691, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,41441,1676599292588 2023-02-17 02:01:34,664 DEBUG [(jenkins-hbase4.apache.org,41793,1676599292544)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-17 02:01:34,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-17 02:01:34,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-17 02:01:34,665 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45887-0x1006002dc330002, quorum=127.0.0.1:55691, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-17 02:01:34,665 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41441-0x1006002dc330001, quorum=127.0.0.1:55691, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-17 02:01:34,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-17 02:01:34,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-17 02:01:34,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-17 02:01:34,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-17 02:01:34,665 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-17 02:01:34,665 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-17 02:01:34,665 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-17 02:01:34,665 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-17 02:01:34,665 DEBUG [member: 'jenkins-hbase4.apache.org,41441,1676599292588' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-17 02:01:34,666 DEBUG [member: 'jenkins-hbase4.apache.org,41441,1676599292588' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-17 02:01:34,666 DEBUG [member: 'jenkins-hbase4.apache.org,45887,1676599292615' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-17 02:01:34,666 DEBUG [member: 'jenkins-hbase4.apache.org,45887,1676599292615' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-17 02:01:34,666 DEBUG [member: 'jenkins-hbase4.apache.org,41441,1676599292588' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-17 02:01:34,666 DEBUG [member: 'jenkins-hbase4.apache.org,41441,1676599292588' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-17 02:01:34,667 DEBUG [member: 'jenkins-hbase4.apache.org,45887,1676599292615' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-17 02:01:34,667 DEBUG [member: 'jenkins-hbase4.apache.org,45887,1676599292615' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-17 02:01:34,667 DEBUG [member: 'jenkins-hbase4.apache.org,45887,1676599292615' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45887,1676599292615' joining acquired barrier for procedure (foo) in zk 2023-02-17 02:01:34,667 DEBUG [member: 'jenkins-hbase4.apache.org,41441,1676599292588' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41441,1676599292588' joining acquired barrier for procedure (foo) in zk 2023-02-17 02:01:34,668 DEBUG [member: 'jenkins-hbase4.apache.org,45887,1676599292615' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-17 02:01:34,668 DEBUG [member: 'jenkins-hbase4.apache.org,41441,1676599292588' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-17 02:01:34,669 DEBUG [member: 'jenkins-hbase4.apache.org,45887,1676599292615' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45887-0x1006002dc330002, quorum=127.0.0.1:55691, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-17 02:01:34,669 DEBUG [member: 'jenkins-hbase4.apache.org,45887,1676599292615' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 02:01:34,669 DEBUG [member: 'jenkins-hbase4.apache.org,41441,1676599292588' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41441-0x1006002dc330001, quorum=127.0.0.1:55691, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-17 02:01:34,669 DEBUG [member: 'jenkins-hbase4.apache.org,41441,1676599292588' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 02:01:34,672 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006002dc330000, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,41441,1676599292588 2023-02-17 02:01:34,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,41441,1676599292588 2023-02-17 02:01:34,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 02:01:34,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-17 02:01:34,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 02:01:34,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 02:01:34,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-17 02:01:34,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41441,1676599292588 2023-02-17 02:01:34,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45887,1676599292615 2023-02-17 02:01:34,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 02:01:34,674 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41441,1676599292588' joining acquired barrier for procedure 'foo' on coordinator 2023-02-17 02:01:34,674 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@828dcc5[Count = 0] remaining members to acquire global barrier 2023-02-17 02:01:34,674 DEBUG [(jenkins-hbase4.apache.org,41793,1676599292544)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-17 02:01:34,674 DEBUG [(jenkins-hbase4.apache.org,41793,1676599292544)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-17 02:01:34,677 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): regionserver:45887-0x1006002dc330002, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-17 02:01:34,677 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): regionserver:41441-0x1006002dc330001, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-17 02:01:34,677 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-17 02:01:34,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-17 02:01:34,677 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-17 02:01:34,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-17 02:01:34,677 DEBUG [member: 'jenkins-hbase4.apache.org,41441,1676599292588' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-17 02:01:34,677 DEBUG [(jenkins-hbase4.apache.org,41793,1676599292544)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41793-0x1006002dc330000, quorum=127.0.0.1:55691, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,41441,1676599292588 2023-02-17 02:01:34,677 DEBUG [(jenkins-hbase4.apache.org,41793,1676599292544)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-17 02:01:34,677 DEBUG [member: 'jenkins-hbase4.apache.org,45887,1676599292615' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-17 02:01:34,677 DEBUG [member: 'jenkins-hbase4.apache.org,45887,1676599292615' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-17 02:01:34,677 DEBUG [member: 'jenkins-hbase4.apache.org,45887,1676599292615' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,45887,1676599292615' in zk 2023-02-17 02:01:34,679 DEBUG [member: 'jenkins-hbase4.apache.org,45887,1676599292615' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-17 02:01:34,680 DEBUG [member: 'jenkins-hbase4.apache.org,45887,1676599292615' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 02:01:34,680 DEBUG [member: 'jenkins-hbase4.apache.org,45887,1676599292615' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-17 02:01:34,680 DEBUG [member: 'jenkins-hbase4.apache.org,41441,1676599292588' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-17 02:01:34,680 DEBUG [member: 'jenkins-hbase4.apache.org,41441,1676599292588' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-17 02:01:34,680 DEBUG [rs(jenkins-hbase4.apache.org,41441,1676599292588)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testInitTableSnapshotMapperJobConfig,,1676599293853.b090cc996c90343b893637dd38d6e671. 2023-02-17 02:01:34,680 DEBUG [rs(jenkins-hbase4.apache.org,41441,1676599292588)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1676599293853.b090cc996c90343b893637dd38d6e671. started... 2023-02-17 02:01:34,684 INFO [rs(jenkins-hbase4.apache.org,41441,1676599292588)-snapshot-pool-0] regionserver.HRegion(2744): Flushing b090cc996c90343b893637dd38d6e671 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-17 02:01:34,712 INFO [rs(jenkins-hbase4.apache.org,41441,1676599292588)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/data/default/testInitTableSnapshotMapperJobConfig/b090cc996c90343b893637dd38d6e671/.tmp/f1/bf581aab790346268f33238f44b08698 2023-02-17 02:01:34,738 INFO [rs(jenkins-hbase4.apache.org,41441,1676599292588)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/data/default/testInitTableSnapshotMapperJobConfig/b090cc996c90343b893637dd38d6e671/.tmp/f2/cb6c3b3f4c0342889a98e44cff2cc32b 2023-02-17 02:01:34,743 DEBUG [Listener at localhost/38639] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-17 02:01:34,744 DEBUG [rs(jenkins-hbase4.apache.org,41441,1676599292588)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/data/default/testInitTableSnapshotMapperJobConfig/b090cc996c90343b893637dd38d6e671/.tmp/f1/bf581aab790346268f33238f44b08698 as hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/data/default/testInitTableSnapshotMapperJobConfig/b090cc996c90343b893637dd38d6e671/f1/bf581aab790346268f33238f44b08698 2023-02-17 02:01:34,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-17 02:01:34,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' is still in progress! 2023-02-17 02:01:34,745 DEBUG [Listener at localhost/38639] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-17 02:01:34,749 INFO [rs(jenkins-hbase4.apache.org,41441,1676599292588)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/data/default/testInitTableSnapshotMapperJobConfig/b090cc996c90343b893637dd38d6e671/f1/bf581aab790346268f33238f44b08698, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-17 02:01:34,750 DEBUG [rs(jenkins-hbase4.apache.org,41441,1676599292588)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/data/default/testInitTableSnapshotMapperJobConfig/b090cc996c90343b893637dd38d6e671/.tmp/f2/cb6c3b3f4c0342889a98e44cff2cc32b as hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/data/default/testInitTableSnapshotMapperJobConfig/b090cc996c90343b893637dd38d6e671/f2/cb6c3b3f4c0342889a98e44cff2cc32b 2023-02-17 02:01:34,755 INFO [rs(jenkins-hbase4.apache.org,41441,1676599292588)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/data/default/testInitTableSnapshotMapperJobConfig/b090cc996c90343b893637dd38d6e671/f2/cb6c3b3f4c0342889a98e44cff2cc32b, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-17 02:01:34,756 INFO [rs(jenkins-hbase4.apache.org,41441,1676599292588)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for b090cc996c90343b893637dd38d6e671 in 73ms, sequenceid=5, compaction requested=false 2023-02-17 02:01:34,756 DEBUG [rs(jenkins-hbase4.apache.org,41441,1676599292588)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testInitTableSnapshotMapperJobConfig' 2023-02-17 02:01:34,756 DEBUG [rs(jenkins-hbase4.apache.org,41441,1676599292588)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for b090cc996c90343b893637dd38d6e671: 2023-02-17 02:01:34,756 DEBUG [rs(jenkins-hbase4.apache.org,41441,1676599292588)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testInitTableSnapshotMapperJobConfig,,1676599293853.b090cc996c90343b893637dd38d6e671.' region-info for snapshot=foo 2023-02-17 02:01:34,756 DEBUG [rs(jenkins-hbase4.apache.org,41441,1676599292588)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 02:01:34,756 DEBUG [rs(jenkins-hbase4.apache.org,41441,1676599292588)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/data/default/testInitTableSnapshotMapperJobConfig/b090cc996c90343b893637dd38d6e671/f1/bf581aab790346268f33238f44b08698] hfiles 2023-02-17 02:01:34,756 DEBUG [rs(jenkins-hbase4.apache.org,41441,1676599292588)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/data/default/testInitTableSnapshotMapperJobConfig/b090cc996c90343b893637dd38d6e671/f1/bf581aab790346268f33238f44b08698 for snapshot=foo 2023-02-17 02:01:34,756 DEBUG [rs(jenkins-hbase4.apache.org,41441,1676599292588)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/data/default/testInitTableSnapshotMapperJobConfig/b090cc996c90343b893637dd38d6e671/f2/cb6c3b3f4c0342889a98e44cff2cc32b] hfiles 2023-02-17 02:01:34,756 DEBUG [rs(jenkins-hbase4.apache.org,41441,1676599292588)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/data/default/testInitTableSnapshotMapperJobConfig/b090cc996c90343b893637dd38d6e671/f2/cb6c3b3f4c0342889a98e44cff2cc32b for snapshot=foo 2023-02-17 02:01:34,764 DEBUG [rs(jenkins-hbase4.apache.org,41441,1676599292588)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1676599293853.b090cc996c90343b893637dd38d6e671. completed. 2023-02-17 02:01:34,764 DEBUG [rs(jenkins-hbase4.apache.org,41441,1676599292588)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testInitTableSnapshotMapperJobConfig,,1676599293853.b090cc996c90343b893637dd38d6e671. 2023-02-17 02:01:34,764 DEBUG [member: 'jenkins-hbase4.apache.org,41441,1676599292588' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-17 02:01:34,764 DEBUG [member: 'jenkins-hbase4.apache.org,41441,1676599292588' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-17 02:01:34,764 DEBUG [member: 'jenkins-hbase4.apache.org,41441,1676599292588' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41441,1676599292588 2023-02-17 02:01:34,764 DEBUG [member: 'jenkins-hbase4.apache.org,41441,1676599292588' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-17 02:01:34,764 DEBUG [member: 'jenkins-hbase4.apache.org,41441,1676599292588' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,41441,1676599292588' in zk 2023-02-17 02:01:34,766 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006002dc330000, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,41441,1676599292588 2023-02-17 02:01:34,766 DEBUG [member: 'jenkins-hbase4.apache.org,41441,1676599292588' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-17 02:01:34,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,41441,1676599292588 2023-02-17 02:01:34,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 02:01:34,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-17 02:01:34,766 DEBUG [member: 'jenkins-hbase4.apache.org,41441,1676599292588' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 02:01:34,766 DEBUG [member: 'jenkins-hbase4.apache.org,41441,1676599292588' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-17 02:01:34,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 02:01:34,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 02:01:34,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-17 02:01:34,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41441,1676599292588 2023-02-17 02:01:34,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45887,1676599292615 2023-02-17 02:01:34,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 02:01:34,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-17 02:01:34,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41441,1676599292588 2023-02-17 02:01:34,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45887,1676599292615 2023-02-17 02:01:34,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase4.apache.org,41441,1676599292588': 2023-02-17 02:01:34,770 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41441,1676599292588' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-17 02:01:34,770 INFO [(jenkins-hbase4.apache.org,41793,1676599292544)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-17 02:01:34,770 DEBUG [(jenkins-hbase4.apache.org,41793,1676599292544)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-17 02:01:34,770 DEBUG [(jenkins-hbase4.apache.org,41793,1676599292544)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-17 02:01:34,770 DEBUG [(jenkins-hbase4.apache.org,41793,1676599292544)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-17 02:01:34,770 INFO [(jenkins-hbase4.apache.org,41793,1676599292544)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-17 02:01:34,771 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): regionserver:41441-0x1006002dc330001, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-17 02:01:34,771 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): regionserver:45887-0x1006002dc330002, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-17 02:01:34,771 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006002dc330000, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-17 02:01:34,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-17 02:01:34,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-17 02:01:34,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 02:01:34,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-17 02:01:34,771 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): regionserver:45887-0x1006002dc330002, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 02:01:34,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-17 02:01:34,771 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): regionserver:41441-0x1006002dc330001, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 02:01:34,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-17 02:01:34,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-17 02:01:34,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 02:01:34,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 02:01:34,772 DEBUG [(jenkins-hbase4.apache.org,41793,1676599292544)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41793-0x1006002dc330000, quorum=127.0.0.1:55691, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,41441,1676599292588 2023-02-17 02:01:34,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 02:01:34,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 02:01:34,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-17 02:01:34,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 02:01:34,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-17 02:01:34,774 DEBUG [(jenkins-hbase4.apache.org,41793,1676599292544)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41793-0x1006002dc330000, quorum=127.0.0.1:55691, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,45887,1676599292615 2023-02-17 02:01:34,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-17 02:01:34,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 02:01:34,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-17 02:01:34,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41441,1676599292588 2023-02-17 02:01:34,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45887,1676599292615 2023-02-17 02:01:34,776 DEBUG [(jenkins-hbase4.apache.org,41793,1676599292544)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41793-0x1006002dc330000, quorum=127.0.0.1:55691, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,41441,1676599292588 2023-02-17 02:01:34,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 02:01:34,776 DEBUG [(jenkins-hbase4.apache.org,41793,1676599292544)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41793-0x1006002dc330000, quorum=127.0.0.1:55691, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,45887,1676599292615 2023-02-17 02:01:34,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-17 02:01:34,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41441,1676599292588 2023-02-17 02:01:34,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45887,1676599292615 2023-02-17 02:01:34,784 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006002dc330000, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,45887,1676599292615 2023-02-17 02:01:34,784 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): regionserver:41441-0x1006002dc330001, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 02:01:34,784 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): regionserver:45887-0x1006002dc330002, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 02:01:34,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 02:01:34,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 02:01:34,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 02:01:34,784 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006002dc330000, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-17 02:01:34,785 DEBUG [(jenkins-hbase4.apache.org,41793,1676599292544)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 02:01:34,784 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): regionserver:45887-0x1006002dc330002, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 02:01:34,784 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): regionserver:41441-0x1006002dc330001, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 02:01:34,785 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006002dc330000, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,41441,1676599292588 2023-02-17 02:01:34,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 02:01:34,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 02:01:34,785 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-17 02:01:34,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 02:01:34,786 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-17 02:01:34,786 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006002dc330000, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-17 02:01:34,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 02:01:34,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 02:01:34,786 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006002dc330000, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,45887,1676599292615 2023-02-17 02:01:34,787 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006002dc330000, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-17 02:01:34,787 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006002dc330000, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,41441,1676599292588 2023-02-17 02:01:34,787 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006002dc330000, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-17 02:01:34,787 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006002dc330000, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-17 02:01:34,787 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/.hbase-snapshot/.tmp/foo 2023-02-17 02:01:34,804 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/.hbase-snapshot/.tmp/foo to hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/.hbase-snapshot/foo 2023-02-17 02:01:34,818 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testInitTableSnapshotMapperJobConfig completed 2023-02-17 02:01:34,818 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/.hbase-snapshot/.tmp/foo 2023-02-17 02:01:34,819 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/.hbase-snapshot/.tmp/foo 2023-02-17 02:01:34,819 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig at 1676599294642Consolidate snapshot: foo at 1676599294786 (+144 ms)Loading Region manifests for foo at 1676599294786Writing data manifest for foo at 1676599294790 (+4 ms)Verifying snapshot: foo at 1676599294797 (+7 ms)Snapshot foo of table testInitTableSnapshotMapperJobConfig completed at 1676599294818 (+21 ms) 2023-02-17 02:01:34,820 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-17 02:01:34,821 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED in 178 msec 2023-02-17 02:01:34,945 DEBUG [Listener at localhost/38639] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-17 02:01:34,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-17 02:01:34,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-17 02:01:34,948 INFO [Listener at localhost/38639] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-17 02:01:34,956 INFO [Listener at localhost/38639] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-17 02:01:34,970 INFO [Listener at localhost/38639] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-17 02:01:35,011 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41441] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testInitTableSnapshotMapperJobConfig,,1676599293853.b090cc996c90343b893637dd38d6e671. 2023-02-17 02:01:35,104 INFO [Listener at localhost/38639] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-17 02:01:35,110 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-17 02:01:35,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] procedure.ProcedureCoordinator(165): Submitting procedure testInitTableSnapshotMapperJobConfig 2023-02-17 02:01:35,112 INFO [(jenkins-hbase4.apache.org,41793,1676599292544)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testInitTableSnapshotMapperJobConfig' 2023-02-17 02:01:35,112 DEBUG [(jenkins-hbase4.apache.org,41793,1676599292544)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-17 02:01:35,113 DEBUG [(jenkins-hbase4.apache.org,41793,1676599292544)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' 2023-02-17 02:01:35,113 DEBUG [(jenkins-hbase4.apache.org,41793,1676599292544)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testInitTableSnapshotMapperJobConfig', kicking off acquire phase on members. 2023-02-17 02:01:35,114 DEBUG [(jenkins-hbase4.apache.org,41793,1676599292544)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41793-0x1006002dc330000, quorum=127.0.0.1:55691, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-17 02:01:35,114 DEBUG [(jenkins-hbase4.apache.org,41793,1676599292544)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-17 02:01:35,115 DEBUG [(jenkins-hbase4.apache.org,41793,1676599292544)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,41441,1676599292588 2023-02-17 02:01:35,115 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): regionserver:41441-0x1006002dc330001, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 02:01:35,115 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): regionserver:45887-0x1006002dc330002, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 02:01:35,115 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 02:01:35,115 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 02:01:35,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 02:01:35,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 02:01:35,115 DEBUG [(jenkins-hbase4.apache.org,41793,1676599292544)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41793-0x1006002dc330000, quorum=127.0.0.1:55691, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,41441,1676599292588 2023-02-17 02:01:35,115 DEBUG [(jenkins-hbase4.apache.org,41793,1676599292544)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-17 02:01:35,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-17 02:01:35,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-17 02:01:35,116 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41441-0x1006002dc330001, quorum=127.0.0.1:55691, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-17 02:01:35,116 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45887-0x1006002dc330002, quorum=127.0.0.1:55691, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-17 02:01:35,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-17 02:01:35,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-17 02:01:35,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-17 02:01:35,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-17 02:01:35,116 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-17 02:01:35,116 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-17 02:01:35,117 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-17 02:01:35,117 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-17 02:01:35,117 DEBUG [member: 'jenkins-hbase4.apache.org,41441,1676599292588' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-17 02:01:35,117 DEBUG [member: 'jenkins-hbase4.apache.org,41441,1676599292588' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-17 02:01:35,118 DEBUG [member: 'jenkins-hbase4.apache.org,41441,1676599292588' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-17 02:01:35,118 DEBUG [member: 'jenkins-hbase4.apache.org,45887,1676599292615' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-17 02:01:35,118 DEBUG [member: 'jenkins-hbase4.apache.org,45887,1676599292615' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-17 02:01:35,118 DEBUG [member: 'jenkins-hbase4.apache.org,41441,1676599292588' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-17 02:01:35,118 DEBUG [member: 'jenkins-hbase4.apache.org,41441,1676599292588' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-17 02:01:35,119 DEBUG [member: 'jenkins-hbase4.apache.org,45887,1676599292615' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-17 02:01:35,119 DEBUG [member: 'jenkins-hbase4.apache.org,45887,1676599292615' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-17 02:01:35,118 DEBUG [rs(jenkins-hbase4.apache.org,41441,1676599292588)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testInitTableSnapshotMapperJobConfig,,1676599293853.b090cc996c90343b893637dd38d6e671. 2023-02-17 02:01:35,119 DEBUG [member: 'jenkins-hbase4.apache.org,45887,1676599292615' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45887,1676599292615' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-17 02:01:35,119 DEBUG [rs(jenkins-hbase4.apache.org,41441,1676599292588)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testInitTableSnapshotMapperJobConfig,,1676599293853.b090cc996c90343b893637dd38d6e671. started... 2023-02-17 02:01:35,119 INFO [rs(jenkins-hbase4.apache.org,41441,1676599292588)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing b090cc996c90343b893637dd38d6e671 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-17 02:01:35,121 DEBUG [member: 'jenkins-hbase4.apache.org,45887,1676599292615' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-17 02:01:35,122 DEBUG [member: 'jenkins-hbase4.apache.org,45887,1676599292615' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45887-0x1006002dc330002, quorum=127.0.0.1:55691, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-17 02:01:35,122 DEBUG [member: 'jenkins-hbase4.apache.org,45887,1676599292615' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 02:01:35,135 INFO [rs(jenkins-hbase4.apache.org,41441,1676599292588)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/data/default/testInitTableSnapshotMapperJobConfig/b090cc996c90343b893637dd38d6e671/.tmp/f1/a448526e44284d1bb5fa886fcd8eab6f 2023-02-17 02:01:35,156 INFO [rs(jenkins-hbase4.apache.org,41441,1676599292588)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/data/default/testInitTableSnapshotMapperJobConfig/b090cc996c90343b893637dd38d6e671/.tmp/f2/87b158e60a5d4ff19e11cad77a1dfb9a 2023-02-17 02:01:35,162 DEBUG [rs(jenkins-hbase4.apache.org,41441,1676599292588)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/data/default/testInitTableSnapshotMapperJobConfig/b090cc996c90343b893637dd38d6e671/.tmp/f1/a448526e44284d1bb5fa886fcd8eab6f as hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/data/default/testInitTableSnapshotMapperJobConfig/b090cc996c90343b893637dd38d6e671/f1/a448526e44284d1bb5fa886fcd8eab6f 2023-02-17 02:01:35,167 INFO [rs(jenkins-hbase4.apache.org,41441,1676599292588)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/data/default/testInitTableSnapshotMapperJobConfig/b090cc996c90343b893637dd38d6e671/f1/a448526e44284d1bb5fa886fcd8eab6f, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-17 02:01:35,168 DEBUG [rs(jenkins-hbase4.apache.org,41441,1676599292588)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/data/default/testInitTableSnapshotMapperJobConfig/b090cc996c90343b893637dd38d6e671/.tmp/f2/87b158e60a5d4ff19e11cad77a1dfb9a as hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/data/default/testInitTableSnapshotMapperJobConfig/b090cc996c90343b893637dd38d6e671/f2/87b158e60a5d4ff19e11cad77a1dfb9a 2023-02-17 02:01:35,172 INFO [rs(jenkins-hbase4.apache.org,41441,1676599292588)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/data/default/testInitTableSnapshotMapperJobConfig/b090cc996c90343b893637dd38d6e671/f2/87b158e60a5d4ff19e11cad77a1dfb9a, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-17 02:01:35,172 INFO [rs(jenkins-hbase4.apache.org,41441,1676599292588)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for b090cc996c90343b893637dd38d6e671 in 53ms, sequenceid=9, compaction requested=false 2023-02-17 02:01:35,173 DEBUG [rs(jenkins-hbase4.apache.org,41441,1676599292588)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for b090cc996c90343b893637dd38d6e671: 2023-02-17 02:01:35,173 DEBUG [rs(jenkins-hbase4.apache.org,41441,1676599292588)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testInitTableSnapshotMapperJobConfig,,1676599293853.b090cc996c90343b893637dd38d6e671. 2023-02-17 02:01:35,173 DEBUG [member: 'jenkins-hbase4.apache.org,41441,1676599292588' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-17 02:01:35,173 DEBUG [member: 'jenkins-hbase4.apache.org,41441,1676599292588' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-17 02:01:35,174 DEBUG [member: 'jenkins-hbase4.apache.org,41441,1676599292588' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41441,1676599292588 2023-02-17 02:01:35,174 DEBUG [member: 'jenkins-hbase4.apache.org,41441,1676599292588' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-17 02:01:35,174 DEBUG [member: 'jenkins-hbase4.apache.org,41441,1676599292588' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41441,1676599292588' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-17 02:01:35,175 DEBUG [member: 'jenkins-hbase4.apache.org,41441,1676599292588' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-17 02:01:35,175 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006002dc330000, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,41441,1676599292588 2023-02-17 02:01:35,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,41441,1676599292588 2023-02-17 02:01:35,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 02:01:35,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-17 02:01:35,175 DEBUG [member: 'jenkins-hbase4.apache.org,41441,1676599292588' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41441-0x1006002dc330001, quorum=127.0.0.1:55691, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-17 02:01:35,176 DEBUG [member: 'jenkins-hbase4.apache.org,41441,1676599292588' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 02:01:35,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 02:01:35,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 02:01:35,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-17 02:01:35,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41441,1676599292588 2023-02-17 02:01:35,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45887,1676599292615 2023-02-17 02:01:35,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 02:01:35,177 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41441,1676599292588' joining acquired barrier for procedure 'testInitTableSnapshotMapperJobConfig' on coordinator 2023-02-17 02:01:35,177 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@c174918[Count = 0] remaining members to acquire global barrier 2023-02-17 02:01:35,177 DEBUG [(jenkins-hbase4.apache.org,41793,1676599292544)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'in-barrier' execution. 2023-02-17 02:01:35,177 DEBUG [(jenkins-hbase4.apache.org,41793,1676599292544)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-17 02:01:35,179 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): regionserver:41441-0x1006002dc330001, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-17 02:01:35,179 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): regionserver:45887-0x1006002dc330002, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-17 02:01:35,179 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-17 02:01:35,179 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-17 02:01:35,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-17 02:01:35,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-17 02:01:35,179 DEBUG [member: 'jenkins-hbase4.apache.org,41441,1676599292588' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-17 02:01:35,179 DEBUG [(jenkins-hbase4.apache.org,41793,1676599292544)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41793-0x1006002dc330000, quorum=127.0.0.1:55691, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,41441,1676599292588 2023-02-17 02:01:35,179 DEBUG [(jenkins-hbase4.apache.org,41793,1676599292544)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-17 02:01:35,179 DEBUG [member: 'jenkins-hbase4.apache.org,41441,1676599292588' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-17 02:01:35,179 DEBUG [member: 'jenkins-hbase4.apache.org,45887,1676599292615' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-17 02:01:35,179 DEBUG [member: 'jenkins-hbase4.apache.org,45887,1676599292615' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-17 02:01:35,179 DEBUG [member: 'jenkins-hbase4.apache.org,41441,1676599292588' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase4.apache.org,41441,1676599292588' in zk 2023-02-17 02:01:35,179 DEBUG [member: 'jenkins-hbase4.apache.org,45887,1676599292615' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase4.apache.org,45887,1676599292615' in zk 2023-02-17 02:01:35,181 DEBUG [member: 'jenkins-hbase4.apache.org,41441,1676599292588' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-17 02:01:35,181 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006002dc330000, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,41441,1676599292588 2023-02-17 02:01:35,181 DEBUG [member: 'jenkins-hbase4.apache.org,41441,1676599292588' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 02:01:35,181 DEBUG [member: 'jenkins-hbase4.apache.org,41441,1676599292588' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-17 02:01:35,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,41441,1676599292588 2023-02-17 02:01:35,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 02:01:35,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-17 02:01:35,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 02:01:35,183 DEBUG [member: 'jenkins-hbase4.apache.org,45887,1676599292615' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-17 02:01:35,183 DEBUG [member: 'jenkins-hbase4.apache.org,45887,1676599292615' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 02:01:35,183 DEBUG [member: 'jenkins-hbase4.apache.org,45887,1676599292615' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-17 02:01:35,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 02:01:35,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-17 02:01:35,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41441,1676599292588 2023-02-17 02:01:35,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45887,1676599292615 2023-02-17 02:01:35,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 02:01:35,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-17 02:01:35,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41441,1676599292588 2023-02-17 02:01:35,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45887,1676599292615 2023-02-17 02:01:35,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testInitTableSnapshotMapperJobConfig' member 'jenkins-hbase4.apache.org,41441,1676599292588': 2023-02-17 02:01:35,186 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41441,1676599292588' released barrier for procedure'testInitTableSnapshotMapperJobConfig', counting down latch. Waiting for 0 more 2023-02-17 02:01:35,186 INFO [(jenkins-hbase4.apache.org,41793,1676599292544)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testInitTableSnapshotMapperJobConfig' execution completed 2023-02-17 02:01:35,186 DEBUG [(jenkins-hbase4.apache.org,41793,1676599292544)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-17 02:01:35,186 DEBUG [(jenkins-hbase4.apache.org,41793,1676599292544)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-17 02:01:35,186 DEBUG [(jenkins-hbase4.apache.org,41793,1676599292544)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testInitTableSnapshotMapperJobConfig 2023-02-17 02:01:35,186 INFO [(jenkins-hbase4.apache.org,41793,1676599292544)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testInitTableSnapshotMapperJobConfigincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-17 02:01:35,188 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006002dc330000, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-17 02:01:35,188 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): regionserver:41441-0x1006002dc330001, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-17 02:01:35,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-17 02:01:35,188 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): regionserver:41441-0x1006002dc330001, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 02:01:35,188 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-17 02:01:35,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 02:01:35,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-17 02:01:35,188 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): regionserver:45887-0x1006002dc330002, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-17 02:01:35,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-17 02:01:35,188 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-17 02:01:35,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-17 02:01:35,188 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): regionserver:45887-0x1006002dc330002, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 02:01:35,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 02:01:35,189 DEBUG [(jenkins-hbase4.apache.org,41793,1676599292544)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41793-0x1006002dc330000, quorum=127.0.0.1:55691, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,41441,1676599292588 2023-02-17 02:01:35,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 02:01:35,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 02:01:35,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 02:01:35,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 02:01:35,189 DEBUG [(jenkins-hbase4.apache.org,41793,1676599292544)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41793-0x1006002dc330000, quorum=127.0.0.1:55691, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,45887,1676599292615 2023-02-17 02:01:35,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-17 02:01:35,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-17 02:01:35,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-17 02:01:35,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 02:01:35,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-17 02:01:35,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41441,1676599292588 2023-02-17 02:01:35,190 DEBUG [(jenkins-hbase4.apache.org,41793,1676599292544)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41793-0x1006002dc330000, quorum=127.0.0.1:55691, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,41441,1676599292588 2023-02-17 02:01:35,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45887,1676599292615 2023-02-17 02:01:35,191 DEBUG [(jenkins-hbase4.apache.org,41793,1676599292544)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41793-0x1006002dc330000, quorum=127.0.0.1:55691, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,45887,1676599292615 2023-02-17 02:01:35,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 02:01:35,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-17 02:01:35,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41441,1676599292588 2023-02-17 02:01:35,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45887,1676599292615 2023-02-17 02:01:35,193 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): regionserver:45887-0x1006002dc330002, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 02:01:35,193 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006002dc330000, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,45887,1676599292615 2023-02-17 02:01:35,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 02:01:35,193 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006002dc330000, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-17 02:01:35,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 02:01:35,193 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006002dc330000, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,41441,1676599292588 2023-02-17 02:01:35,193 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): regionserver:45887-0x1006002dc330002, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 02:01:35,193 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): regionserver:41441-0x1006002dc330001, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 02:01:35,194 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testInitTableSnapshotMapperJobConfig' 2023-02-17 02:01:35,194 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-17 02:01:35,194 DEBUG [(jenkins-hbase4.apache.org,41793,1676599292544)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 02:01:35,194 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 02:01:35,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 02:01:35,194 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006002dc330000, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-17 02:01:35,194 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 02:01:35,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 02:01:35,194 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): regionserver:41441-0x1006002dc330001, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 02:01:35,195 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006002dc330000, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,45887,1676599292615 2023-02-17 02:01:35,195 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006002dc330000, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-17 02:01:35,195 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006002dc330000, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,41441,1676599292588 2023-02-17 02:01:35,195 DEBUG [Listener at localhost/38639] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testInitTableSnapshotMapperJobConfig'' to complete. (max 20000 ms per retry) 2023-02-17 02:01:35,195 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006002dc330000, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-17 02:01:35,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 02:01:35,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 02:01:35,195 DEBUG [Listener at localhost/38639] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-17 02:01:35,195 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006002dc330000, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-17 02:01:35,296 DEBUG [Listener at localhost/38639] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-17 02:01:35,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-17 02:01:35,302 INFO [Listener at localhost/38639] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1676599294628 type: FLUSH version: 2 ttl: 0 2023-02-17 02:01:35,302 DEBUG [Listener at localhost/38639] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:35647/user/jenkins/test-data/94cc82d3-b594-2e37-50e7-49756463a5b9/foo/49e9dffd-c03d-452b-bb55-a99f4221d198/data/default/testInitTableSnapshotMapperJobConfig 2023-02-17 02:01:35,302 INFO [Listener at localhost/38639] snapshot.RestoreSnapshotHelper(239): region to add: b090cc996c90343b893637dd38d6e671 2023-02-17 02:01:35,302 INFO [Listener at localhost/38639] snapshot.RestoreSnapshotHelper(585): clone region=b090cc996c90343b893637dd38d6e671 as b090cc996c90343b893637dd38d6e671 in snapshot foo 2023-02-17 02:01:35,303 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => b090cc996c90343b893637dd38d6e671, NAME => 'testInitTableSnapshotMapperJobConfig,,1676599293853.b090cc996c90343b893637dd38d6e671.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35647/user/jenkins/test-data/94cc82d3-b594-2e37-50e7-49756463a5b9/foo/49e9dffd-c03d-452b-bb55-a99f4221d198 2023-02-17 02:01:35,309 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676599293853.b090cc996c90343b893637dd38d6e671.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:35,310 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink bf581aab790346268f33238f44b08698 from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-17 02:01:35,312 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink cb6c3b3f4c0342889a98e44cff2cc32b from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-17 02:01:35,313 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing b090cc996c90343b893637dd38d6e671, disabling compactions & flushes 2023-02-17 02:01:35,314 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676599293853.b090cc996c90343b893637dd38d6e671. 2023-02-17 02:01:35,314 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676599293853.b090cc996c90343b893637dd38d6e671. 2023-02-17 02:01:35,314 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676599293853.b090cc996c90343b893637dd38d6e671. after waiting 0 ms 2023-02-17 02:01:35,314 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676599293853.b090cc996c90343b893637dd38d6e671. 2023-02-17 02:01:35,314 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676599293853.b090cc996c90343b893637dd38d6e671. 2023-02-17 02:01:35,314 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for b090cc996c90343b893637dd38d6e671: 2023-02-17 02:01:35,314 INFO [Listener at localhost/38639] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1676599294628 type: FLUSH version: 2 ttl: 0 2023-02-17 02:01:35,314 DEBUG [Listener at localhost/38639] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:35647/user/jenkins/test-data/94cc82d3-b594-2e37-50e7-49756463a5b9/foo/49e9dffd-c03d-452b-bb55-a99f4221d198 2023-02-17 02:01:35,314 DEBUG [Listener at localhost/38639] util.CommonFSUtils(682): File system contents for path hdfs://localhost:35647/user/jenkins/test-data/94cc82d3-b594-2e37-50e7-49756463a5b9/foo/49e9dffd-c03d-452b-bb55-a99f4221d198 2023-02-17 02:01:35,315 DEBUG [Listener at localhost/38639] util.CommonFSUtils(699): |-data/ 2023-02-17 02:01:35,315 DEBUG [Listener at localhost/38639] util.CommonFSUtils(699): |----default/ 2023-02-17 02:01:35,316 DEBUG [Listener at localhost/38639] util.CommonFSUtils(699): |-------testInitTableSnapshotMapperJobConfig/ 2023-02-17 02:01:35,316 DEBUG [Listener at localhost/38639] util.CommonFSUtils(699): |----------b090cc996c90343b893637dd38d6e671/ 2023-02-17 02:01:35,316 DEBUG [Listener at localhost/38639] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 02:01:35,316 DEBUG [Listener at localhost/38639] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 02:01:35,317 DEBUG [Listener at localhost/38639] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=b090cc996c90343b893637dd38d6e671-bf581aab790346268f33238f44b08698 2023-02-17 02:01:35,317 DEBUG [Listener at localhost/38639] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 02:01:35,317 DEBUG [Listener at localhost/38639] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=b090cc996c90343b893637dd38d6e671-cb6c3b3f4c0342889a98e44cff2cc32b 2023-02-17 02:01:35,318 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "foo" 2023-02-17 02:01:35,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-17 02:01:35,321 INFO [Listener at localhost/38639] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-17 02:01:35,322 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testInitTableSnapshotMapperJobConfig 2023-02-17 02:01:35,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-17 02:01:35,325 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676599295325"}]},"ts":"1676599295325"} 2023-02-17 02:01:35,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-17 02:01:35,326 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLING in hbase:meta 2023-02-17 02:01:35,328 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testInitTableSnapshotMapperJobConfig to state=DISABLING 2023-02-17 02:01:35,328 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=b090cc996c90343b893637dd38d6e671, UNASSIGN}] 2023-02-17 02:01:35,330 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=b090cc996c90343b893637dd38d6e671, UNASSIGN 2023-02-17 02:01:35,330 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=b090cc996c90343b893637dd38d6e671, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41441,1676599292588 2023-02-17 02:01:35,330 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1676599293853.b090cc996c90343b893637dd38d6e671.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676599295330"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676599295330"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676599295330"}]},"ts":"1676599295330"} 2023-02-17 02:01:35,332 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure b090cc996c90343b893637dd38d6e671, server=jenkins-hbase4.apache.org,41441,1676599292588}] 2023-02-17 02:01:35,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-17 02:01:35,484 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close b090cc996c90343b893637dd38d6e671 2023-02-17 02:01:35,484 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing b090cc996c90343b893637dd38d6e671, disabling compactions & flushes 2023-02-17 02:01:35,484 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676599293853.b090cc996c90343b893637dd38d6e671. 2023-02-17 02:01:35,484 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676599293853.b090cc996c90343b893637dd38d6e671. 2023-02-17 02:01:35,484 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676599293853.b090cc996c90343b893637dd38d6e671. after waiting 0 ms 2023-02-17 02:01:35,484 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676599293853.b090cc996c90343b893637dd38d6e671. 2023-02-17 02:01:35,488 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/data/default/testInitTableSnapshotMapperJobConfig/b090cc996c90343b893637dd38d6e671/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 02:01:35,488 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676599293853.b090cc996c90343b893637dd38d6e671. 2023-02-17 02:01:35,488 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for b090cc996c90343b893637dd38d6e671: 2023-02-17 02:01:35,490 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed b090cc996c90343b893637dd38d6e671 2023-02-17 02:01:35,490 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=b090cc996c90343b893637dd38d6e671, regionState=CLOSED 2023-02-17 02:01:35,490 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1676599293853.b090cc996c90343b893637dd38d6e671.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676599295490"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676599295490"}]},"ts":"1676599295490"} 2023-02-17 02:01:35,493 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-17 02:01:35,493 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure b090cc996c90343b893637dd38d6e671, server=jenkins-hbase4.apache.org,41441,1676599292588 in 160 msec 2023-02-17 02:01:35,494 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-17 02:01:35,494 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=b090cc996c90343b893637dd38d6e671, UNASSIGN in 165 msec 2023-02-17 02:01:35,494 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676599295494"}]},"ts":"1676599295494"} 2023-02-17 02:01:35,495 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLED in hbase:meta 2023-02-17 02:01:35,498 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testInitTableSnapshotMapperJobConfig to state=DISABLED 2023-02-17 02:01:35,499 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig in 176 msec 2023-02-17 02:01:35,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-17 02:01:35,628 INFO [Listener at localhost/38639] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 15 completed 2023-02-17 02:01:35,629 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testInitTableSnapshotMapperJobConfig 2023-02-17 02:01:35,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-17 02:01:35,632 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-17 02:01:35,632 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-17 02:01:35,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-17 02:01:35,635 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/.tmp/data/default/testInitTableSnapshotMapperJobConfig/b090cc996c90343b893637dd38d6e671 2023-02-17 02:01:35,637 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/.tmp/data/default/testInitTableSnapshotMapperJobConfig/b090cc996c90343b893637dd38d6e671/f1, FileablePath, hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/.tmp/data/default/testInitTableSnapshotMapperJobConfig/b090cc996c90343b893637dd38d6e671/f2, FileablePath, hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/.tmp/data/default/testInitTableSnapshotMapperJobConfig/b090cc996c90343b893637dd38d6e671/recovered.edits] 2023-02-17 02:01:35,641 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/.tmp/data/default/testInitTableSnapshotMapperJobConfig/b090cc996c90343b893637dd38d6e671/f1/a448526e44284d1bb5fa886fcd8eab6f to hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/archive/data/default/testInitTableSnapshotMapperJobConfig/b090cc996c90343b893637dd38d6e671/f1/a448526e44284d1bb5fa886fcd8eab6f 2023-02-17 02:01:35,642 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/.tmp/data/default/testInitTableSnapshotMapperJobConfig/b090cc996c90343b893637dd38d6e671/f1/bf581aab790346268f33238f44b08698 to hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/archive/data/default/testInitTableSnapshotMapperJobConfig/b090cc996c90343b893637dd38d6e671/f1/bf581aab790346268f33238f44b08698 2023-02-17 02:01:35,645 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/.tmp/data/default/testInitTableSnapshotMapperJobConfig/b090cc996c90343b893637dd38d6e671/f2/87b158e60a5d4ff19e11cad77a1dfb9a to hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/archive/data/default/testInitTableSnapshotMapperJobConfig/b090cc996c90343b893637dd38d6e671/f2/87b158e60a5d4ff19e11cad77a1dfb9a 2023-02-17 02:01:35,646 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/.tmp/data/default/testInitTableSnapshotMapperJobConfig/b090cc996c90343b893637dd38d6e671/f2/cb6c3b3f4c0342889a98e44cff2cc32b to hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/archive/data/default/testInitTableSnapshotMapperJobConfig/b090cc996c90343b893637dd38d6e671/f2/cb6c3b3f4c0342889a98e44cff2cc32b 2023-02-17 02:01:35,648 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/.tmp/data/default/testInitTableSnapshotMapperJobConfig/b090cc996c90343b893637dd38d6e671/recovered.edits/12.seqid to hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/archive/data/default/testInitTableSnapshotMapperJobConfig/b090cc996c90343b893637dd38d6e671/recovered.edits/12.seqid 2023-02-17 02:01:35,649 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/.tmp/data/default/testInitTableSnapshotMapperJobConfig/b090cc996c90343b893637dd38d6e671 2023-02-17 02:01:35,649 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-17 02:01:35,650 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-17 02:01:35,652 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testInitTableSnapshotMapperJobConfig from hbase:meta 2023-02-17 02:01:35,654 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testInitTableSnapshotMapperJobConfig' descriptor. 2023-02-17 02:01:35,655 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-17 02:01:35,655 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testInitTableSnapshotMapperJobConfig' from region states. 2023-02-17 02:01:35,655 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig,,1676599293853.b090cc996c90343b893637dd38d6e671.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676599295655"}]},"ts":"9223372036854775807"} 2023-02-17 02:01:35,656 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-17 02:01:35,656 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => b090cc996c90343b893637dd38d6e671, NAME => 'testInitTableSnapshotMapperJobConfig,,1676599293853.b090cc996c90343b893637dd38d6e671.', STARTKEY => '', ENDKEY => ''}] 2023-02-17 02:01:35,656 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testInitTableSnapshotMapperJobConfig' as deleted. 2023-02-17 02:01:35,657 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676599295656"}]},"ts":"9223372036854775807"} 2023-02-17 02:01:35,660 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testInitTableSnapshotMapperJobConfig state from META 2023-02-17 02:01:35,662 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-17 02:01:35,663 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig in 33 msec 2023-02-17 02:01:35,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-17 02:01:35,734 INFO [Listener at localhost/38639] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 18 completed 2023-02-17 02:01:35,735 INFO [Listener at localhost/38639] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-17 02:01:35,735 INFO [Listener at localhost/38639] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-17 02:01:35,735 DEBUG [Listener at localhost/38639] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x37c7b0a0 to 127.0.0.1:55691 2023-02-17 02:01:35,735 DEBUG [Listener at localhost/38639] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 02:01:35,735 DEBUG [Listener at localhost/38639] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-17 02:01:35,735 DEBUG [Listener at localhost/38639] util.JVMClusterUtil(257): Found active master hash=1353580387, stopped=false 2023-02-17 02:01:35,735 INFO [Listener at localhost/38639] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,41793,1676599292544 2023-02-17 02:01:35,738 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): regionserver:41441-0x1006002dc330001, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-17 02:01:35,738 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006002dc330000, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-17 02:01:35,739 INFO [Listener at localhost/38639] procedure2.ProcedureExecutor(629): Stopping 2023-02-17 02:01:35,738 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): regionserver:45887-0x1006002dc330002, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-17 02:01:35,739 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006002dc330000, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 02:01:35,740 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41441-0x1006002dc330001, quorum=127.0.0.1:55691, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 02:01:35,740 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45887-0x1006002dc330002, quorum=127.0.0.1:55691, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 02:01:35,740 DEBUG [Listener at localhost/38639] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x78842134 to 127.0.0.1:55691 2023-02-17 02:01:35,740 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41793-0x1006002dc330000, quorum=127.0.0.1:55691, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 02:01:35,740 DEBUG [Listener at localhost/38639] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 02:01:35,741 INFO [Listener at localhost/38639] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,41441,1676599292588' ***** 2023-02-17 02:01:35,741 INFO [Listener at localhost/38639] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-17 02:01:35,741 INFO [Listener at localhost/38639] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,45887,1676599292615' ***** 2023-02-17 02:01:35,741 INFO [Listener at localhost/38639] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-17 02:01:35,741 INFO [RS:0;jenkins-hbase4:41441] regionserver.HeapMemoryManager(220): Stopping 2023-02-17 02:01:35,741 INFO [RS:0;jenkins-hbase4:41441] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-17 02:01:35,741 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-17 02:01:35,741 INFO [RS:0;jenkins-hbase4:41441] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-17 02:01:35,741 INFO [RS:0;jenkins-hbase4:41441] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,41441,1676599292588 2023-02-17 02:01:35,741 DEBUG [RS:0;jenkins-hbase4:41441] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x521ae249 to 127.0.0.1:55691 2023-02-17 02:01:35,741 DEBUG [RS:0;jenkins-hbase4:41441] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 02:01:35,741 INFO [RS:0;jenkins-hbase4:41441] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,41441,1676599292588; all regions closed. 2023-02-17 02:01:35,742 INFO [RS:1;jenkins-hbase4:45887] regionserver.HeapMemoryManager(220): Stopping 2023-02-17 02:01:35,743 INFO [RS:1;jenkins-hbase4:45887] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-17 02:01:35,743 INFO [RS:1;jenkins-hbase4:45887] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-17 02:01:35,743 INFO [RS:1;jenkins-hbase4:45887] regionserver.HRegionServer(3304): Received CLOSE for 17cca714e8ffe02e2c2e71e0cb0506f8 2023-02-17 02:01:35,743 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-17 02:01:35,743 INFO [RS:1;jenkins-hbase4:45887] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,45887,1676599292615 2023-02-17 02:01:35,743 DEBUG [RS:1;jenkins-hbase4:45887] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x32d56191 to 127.0.0.1:55691 2023-02-17 02:01:35,744 DEBUG [RS:1;jenkins-hbase4:45887] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 02:01:35,744 INFO [RS:1;jenkins-hbase4:45887] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-17 02:01:35,744 INFO [RS:1;jenkins-hbase4:45887] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-17 02:01:35,744 INFO [RS:1;jenkins-hbase4:45887] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-17 02:01:35,744 INFO [RS:1;jenkins-hbase4:45887] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-17 02:01:35,747 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 17cca714e8ffe02e2c2e71e0cb0506f8, disabling compactions & flushes 2023-02-17 02:01:35,747 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676599293192.17cca714e8ffe02e2c2e71e0cb0506f8. 2023-02-17 02:01:35,747 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676599293192.17cca714e8ffe02e2c2e71e0cb0506f8. 2023-02-17 02:01:35,747 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676599293192.17cca714e8ffe02e2c2e71e0cb0506f8. after waiting 0 ms 2023-02-17 02:01:35,747 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676599293192.17cca714e8ffe02e2c2e71e0cb0506f8. 2023-02-17 02:01:35,747 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 17cca714e8ffe02e2c2e71e0cb0506f8 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-17 02:01:35,747 INFO [RS:1;jenkins-hbase4:45887] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-17 02:01:35,755 DEBUG [RS:1;jenkins-hbase4:45887] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740, 17cca714e8ffe02e2c2e71e0cb0506f8=hbase:namespace,,1676599293192.17cca714e8ffe02e2c2e71e0cb0506f8.} 2023-02-17 02:01:35,755 DEBUG [RS:1;jenkins-hbase4:45887] regionserver.HRegionServer(1505): Waiting on 1588230740, 17cca714e8ffe02e2c2e71e0cb0506f8 2023-02-17 02:01:35,758 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-17 02:01:35,758 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-17 02:01:35,758 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-17 02:01:35,758 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-17 02:01:35,759 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-17 02:01:35,759 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.24 KB heapSize=7.64 KB 2023-02-17 02:01:35,759 DEBUG [RS:0;jenkins-hbase4:41441] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/oldWALs 2023-02-17 02:01:35,759 INFO [RS:0;jenkins-hbase4:41441] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41441%2C1676599292588:(num 1676599293940) 2023-02-17 02:01:35,759 DEBUG [RS:0;jenkins-hbase4:41441] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 02:01:35,759 INFO [RS:0;jenkins-hbase4:41441] regionserver.LeaseManager(133): Closed leases 2023-02-17 02:01:35,760 INFO [RS:0;jenkins-hbase4:41441] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-17 02:01:35,760 INFO [RS:0;jenkins-hbase4:41441] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-17 02:01:35,760 INFO [RS:0;jenkins-hbase4:41441] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-17 02:01:35,760 INFO [RS:0;jenkins-hbase4:41441] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-17 02:01:35,760 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-17 02:01:35,761 INFO [RS:0;jenkins-hbase4:41441] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41441 2023-02-17 02:01:35,764 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): regionserver:41441-0x1006002dc330001, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41441,1676599292588 2023-02-17 02:01:35,764 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006002dc330000, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 02:01:35,764 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): regionserver:45887-0x1006002dc330002, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41441,1676599292588 2023-02-17 02:01:35,764 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): regionserver:45887-0x1006002dc330002, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 02:01:35,764 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): regionserver:41441-0x1006002dc330001, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 02:01:35,765 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,41441,1676599292588] 2023-02-17 02:01:35,765 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,41441,1676599292588; numProcessing=1 2023-02-17 02:01:35,766 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,41441,1676599292588 already deleted, retry=false 2023-02-17 02:01:35,766 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,41441,1676599292588 expired; onlineServers=1 2023-02-17 02:01:35,771 ERROR [Listener at localhost/38639-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@77ef8692 rejected from java.util.concurrent.ThreadPoolExecutor@73d00cb7[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 02:01:35,792 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/data/hbase/namespace/17cca714e8ffe02e2c2e71e0cb0506f8/.tmp/info/5701f880a9b549ad937d4c521161d4b4 2023-02-17 02:01:35,799 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/data/hbase/namespace/17cca714e8ffe02e2c2e71e0cb0506f8/.tmp/info/5701f880a9b549ad937d4c521161d4b4 as hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/data/hbase/namespace/17cca714e8ffe02e2c2e71e0cb0506f8/info/5701f880a9b549ad937d4c521161d4b4 2023-02-17 02:01:35,800 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.60 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/data/hbase/meta/1588230740/.tmp/info/366430351743489da4ac1b1443274670 2023-02-17 02:01:35,806 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-17 02:01:35,806 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 366430351743489da4ac1b1443274670 2023-02-17 02:01:35,807 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/data/hbase/namespace/17cca714e8ffe02e2c2e71e0cb0506f8/info/5701f880a9b549ad937d4c521161d4b4, entries=2, sequenceid=6, filesize=4.8 K 2023-02-17 02:01:35,809 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 17cca714e8ffe02e2c2e71e0cb0506f8 in 62ms, sequenceid=6, compaction requested=false 2023-02-17 02:01:35,814 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/data/hbase/namespace/17cca714e8ffe02e2c2e71e0cb0506f8/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-17 02:01:35,815 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676599293192.17cca714e8ffe02e2c2e71e0cb0506f8. 2023-02-17 02:01:35,815 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 17cca714e8ffe02e2c2e71e0cb0506f8: 2023-02-17 02:01:35,815 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676599293192.17cca714e8ffe02e2c2e71e0cb0506f8. 2023-02-17 02:01:35,818 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=116 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/data/hbase/meta/1588230740/.tmp/rep_barrier/442321eeab0747b0bef3af100386c84a 2023-02-17 02:01:35,823 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 442321eeab0747b0bef3af100386c84a 2023-02-17 02:01:35,824 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-17 02:01:35,868 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=542 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/data/hbase/meta/1588230740/.tmp/table/14f1eab8f63b48a2aab054a76edb76e3 2023-02-17 02:01:35,873 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 14f1eab8f63b48a2aab054a76edb76e3 2023-02-17 02:01:35,874 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/data/hbase/meta/1588230740/.tmp/info/366430351743489da4ac1b1443274670 as hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/data/hbase/meta/1588230740/info/366430351743489da4ac1b1443274670 2023-02-17 02:01:35,879 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 366430351743489da4ac1b1443274670 2023-02-17 02:01:35,879 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/data/hbase/meta/1588230740/info/366430351743489da4ac1b1443274670, entries=12, sequenceid=21, filesize=6.3 K 2023-02-17 02:01:35,879 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/data/hbase/meta/1588230740/.tmp/rep_barrier/442321eeab0747b0bef3af100386c84a as hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/data/hbase/meta/1588230740/rep_barrier/442321eeab0747b0bef3af100386c84a 2023-02-17 02:01:35,884 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 442321eeab0747b0bef3af100386c84a 2023-02-17 02:01:35,884 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/data/hbase/meta/1588230740/rep_barrier/442321eeab0747b0bef3af100386c84a, entries=1, sequenceid=21, filesize=5.0 K 2023-02-17 02:01:35,885 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/data/hbase/meta/1588230740/.tmp/table/14f1eab8f63b48a2aab054a76edb76e3 as hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/data/hbase/meta/1588230740/table/14f1eab8f63b48a2aab054a76edb76e3 2023-02-17 02:01:35,892 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 14f1eab8f63b48a2aab054a76edb76e3 2023-02-17 02:01:35,893 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/data/hbase/meta/1588230740/table/14f1eab8f63b48a2aab054a76edb76e3, entries=4, sequenceid=21, filesize=5.1 K 2023-02-17 02:01:35,894 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.24 KB/4340, heapSize ~7.59 KB/7776, currentSize=0 B/0 for 1588230740 in 135ms, sequenceid=21, compaction requested=false 2023-02-17 02:01:35,912 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-17 02:01:35,913 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-17 02:01:35,913 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-17 02:01:35,913 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-17 02:01:35,913 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-17 02:01:35,918 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-17 02:01:35,918 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-17 02:01:35,940 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): regionserver:41441-0x1006002dc330001, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 02:01:35,940 INFO [RS:0;jenkins-hbase4:41441] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,41441,1676599292588; zookeeper connection closed. 2023-02-17 02:01:35,940 ERROR [Listener at localhost/38639-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@c7ec3eb rejected from java.util.concurrent.ThreadPoolExecutor@73d00cb7[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 02:01:35,940 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): regionserver:41441-0x1006002dc330001, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 02:01:35,940 ERROR [Listener at localhost/38639-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@74e80e16 rejected from java.util.concurrent.ThreadPoolExecutor@73d00cb7[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 02:01:35,951 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@35b5e13] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@35b5e13 2023-02-17 02:01:35,955 INFO [RS:1;jenkins-hbase4:45887] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,45887,1676599292615; all regions closed. 2023-02-17 02:01:35,963 DEBUG [RS:1;jenkins-hbase4:45887] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/oldWALs 2023-02-17 02:01:35,963 INFO [RS:1;jenkins-hbase4:45887] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45887%2C1676599292615.meta:.meta(num 1676599293134) 2023-02-17 02:01:35,980 DEBUG [RS:1;jenkins-hbase4:45887] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/oldWALs 2023-02-17 02:01:35,980 INFO [RS:1;jenkins-hbase4:45887] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45887%2C1676599292615:(num 1676599293544) 2023-02-17 02:01:35,980 DEBUG [RS:1;jenkins-hbase4:45887] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 02:01:35,980 INFO [RS:1;jenkins-hbase4:45887] regionserver.LeaseManager(133): Closed leases 2023-02-17 02:01:35,980 INFO [RS:1;jenkins-hbase4:45887] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-17 02:01:35,980 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-17 02:01:35,982 INFO [RS:1;jenkins-hbase4:45887] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45887 2023-02-17 02:01:35,983 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006002dc330000, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 02:01:35,983 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): regionserver:45887-0x1006002dc330002, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45887,1676599292615 2023-02-17 02:01:35,983 ERROR [Listener at localhost/38639-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1e64cc5d rejected from java.util.concurrent.ThreadPoolExecutor@1a5b4b49[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 02:01:35,984 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,45887,1676599292615] 2023-02-17 02:01:35,984 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,45887,1676599292615; numProcessing=2 2023-02-17 02:01:35,986 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,45887,1676599292615 already deleted, retry=false 2023-02-17 02:01:35,986 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,45887,1676599292615 expired; onlineServers=0 2023-02-17 02:01:35,986 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,41793,1676599292544' ***** 2023-02-17 02:01:35,986 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-17 02:01:35,987 DEBUG [M:0;jenkins-hbase4:41793] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@549271ae, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-17 02:01:35,987 INFO [M:0;jenkins-hbase4:41793] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,41793,1676599292544 2023-02-17 02:01:35,987 INFO [M:0;jenkins-hbase4:41793] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,41793,1676599292544; all regions closed. 2023-02-17 02:01:35,987 DEBUG [M:0;jenkins-hbase4:41793] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 02:01:35,988 DEBUG [M:0;jenkins-hbase4:41793] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-17 02:01:35,988 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-17 02:01:35,988 DEBUG [M:0;jenkins-hbase4:41793] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-17 02:01:35,988 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676599292773] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676599292773,5,FailOnTimeoutGroup] 2023-02-17 02:01:35,988 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676599292773] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676599292773,5,FailOnTimeoutGroup] 2023-02-17 02:01:35,988 INFO [M:0;jenkins-hbase4:41793] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-17 02:01:35,989 INFO [M:0;jenkins-hbase4:41793] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-17 02:01:35,989 INFO [M:0;jenkins-hbase4:41793] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-17 02:01:35,989 DEBUG [M:0;jenkins-hbase4:41793] master.HMaster(1512): Stopping service threads 2023-02-17 02:01:35,989 INFO [M:0;jenkins-hbase4:41793] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-17 02:01:35,990 ERROR [M:0;jenkins-hbase4:41793] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-17 02:01:35,990 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006002dc330000, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-17 02:01:35,990 INFO [M:0;jenkins-hbase4:41793] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-17 02:01:35,990 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006002dc330000, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 02:01:35,990 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-17 02:01:35,991 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41793-0x1006002dc330000, quorum=127.0.0.1:55691, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 02:01:35,991 DEBUG [M:0;jenkins-hbase4:41793] zookeeper.ZKUtil(398): master:41793-0x1006002dc330000, quorum=127.0.0.1:55691, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-17 02:01:35,991 WARN [M:0;jenkins-hbase4:41793] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-17 02:01:35,991 INFO [M:0;jenkins-hbase4:41793] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-17 02:01:35,991 INFO [M:0;jenkins-hbase4:41793] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-17 02:01:35,992 DEBUG [M:0;jenkins-hbase4:41793] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-17 02:01:35,992 INFO [M:0;jenkins-hbase4:41793] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 02:01:35,992 DEBUG [M:0;jenkins-hbase4:41793] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 02:01:35,992 DEBUG [M:0;jenkins-hbase4:41793] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-17 02:01:35,992 DEBUG [M:0;jenkins-hbase4:41793] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 02:01:35,992 INFO [M:0;jenkins-hbase4:41793] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=55.92 KB heapSize=66.89 KB 2023-02-17 02:01:36,006 INFO [M:0;jenkins-hbase4:41793] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=55.92 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/b00c2f04c45b4d06844ad31a7c853dc8 2023-02-17 02:01:36,012 DEBUG [M:0;jenkins-hbase4:41793] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/b00c2f04c45b4d06844ad31a7c853dc8 as hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/b00c2f04c45b4d06844ad31a7c853dc8 2023-02-17 02:01:36,016 INFO [M:0;jenkins-hbase4:41793] regionserver.HStore(1080): Added hdfs://localhost:35647/user/jenkins/test-data/bcd15f4e-942c-c893-80ec-c33554d8440b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/b00c2f04c45b4d06844ad31a7c853dc8, entries=17, sequenceid=132, filesize=8.7 K 2023-02-17 02:01:36,017 INFO [M:0;jenkins-hbase4:41793] regionserver.HRegion(2947): Finished flush of dataSize ~55.92 KB/57259, heapSize ~66.88 KB/68480, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 25ms, sequenceid=132, compaction requested=false 2023-02-17 02:01:36,018 INFO [M:0;jenkins-hbase4:41793] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 02:01:36,018 DEBUG [M:0;jenkins-hbase4:41793] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-17 02:01:36,022 INFO [M:0;jenkins-hbase4:41793] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-17 02:01:36,022 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-17 02:01:36,023 INFO [M:0;jenkins-hbase4:41793] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41793 2023-02-17 02:01:36,024 DEBUG [M:0;jenkins-hbase4:41793] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,41793,1676599292544 already deleted, retry=false 2023-02-17 02:01:36,341 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006002dc330000, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 02:01:36,341 INFO [M:0;jenkins-hbase4:41793] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,41793,1676599292544; zookeeper connection closed. 2023-02-17 02:01:36,341 ERROR [Listener at localhost/38639-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@177f42f4 rejected from java.util.concurrent.ThreadPoolExecutor@1340d4c3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 52] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 02:01:36,342 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006002dc330000, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 02:01:36,342 ERROR [Listener at localhost/38639-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@adb3093 rejected from java.util.concurrent.ThreadPoolExecutor@1340d4c3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 52] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 02:01:36,442 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): regionserver:45887-0x1006002dc330002, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 02:01:36,442 INFO [RS:1;jenkins-hbase4:45887] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,45887,1676599292615; zookeeper connection closed. 2023-02-17 02:01:36,442 ERROR [Listener at localhost/38639-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5672875c rejected from java.util.concurrent.ThreadPoolExecutor@1a5b4b49[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 02:01:36,443 DEBUG [Listener at localhost/38639-EventThread] zookeeper.ZKWatcher(600): regionserver:45887-0x1006002dc330002, quorum=127.0.0.1:55691, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 02:01:36,443 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1390fd10] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1390fd10 2023-02-17 02:01:36,443 ERROR [Listener at localhost/38639-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2e8da068 rejected from java.util.concurrent.ThreadPoolExecutor@1a5b4b49[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 02:01:36,443 INFO [Listener at localhost/38639] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-17 02:01:36,443 WARN [Listener at localhost/38639] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-17 02:01:36,447 INFO [Listener at localhost/38639] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-17 02:01:36,553 WARN [BP-824346576-172.31.14.131-1676599291806 heartbeating to localhost/127.0.0.1:35647] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-17 02:01:36,554 WARN [BP-824346576-172.31.14.131-1676599291806 heartbeating to localhost/127.0.0.1:35647] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-824346576-172.31.14.131-1676599291806 (Datanode Uuid b4ac1ed5-68e3-49f9-ac06-b2b2856f020b) service to localhost/127.0.0.1:35647 2023-02-17 02:01:36,555 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b95c4b67-2ebf-d7a6-fc30-de669ab715d0/cluster_606d4d2a-7354-0975-eec9-6025b3f65465/dfs/data/data3/current/BP-824346576-172.31.14.131-1676599291806] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 02:01:36,555 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b95c4b67-2ebf-d7a6-fc30-de669ab715d0/cluster_606d4d2a-7354-0975-eec9-6025b3f65465/dfs/data/data4/current/BP-824346576-172.31.14.131-1676599291806] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 02:01:36,558 WARN [Listener at localhost/38639] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-17 02:01:36,577 INFO [Listener at localhost/38639] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-17 02:01:36,681 WARN [BP-824346576-172.31.14.131-1676599291806 heartbeating to localhost/127.0.0.1:35647] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-17 02:01:36,682 WARN [BP-824346576-172.31.14.131-1676599291806 heartbeating to localhost/127.0.0.1:35647] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-824346576-172.31.14.131-1676599291806 (Datanode Uuid d876c189-dc76-45ff-8b95-2cd79b854c37) service to localhost/127.0.0.1:35647 2023-02-17 02:01:36,682 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b95c4b67-2ebf-d7a6-fc30-de669ab715d0/cluster_606d4d2a-7354-0975-eec9-6025b3f65465/dfs/data/data1/current/BP-824346576-172.31.14.131-1676599291806] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 02:01:36,683 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b95c4b67-2ebf-d7a6-fc30-de669ab715d0/cluster_606d4d2a-7354-0975-eec9-6025b3f65465/dfs/data/data2/current/BP-824346576-172.31.14.131-1676599291806] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 02:01:36,695 INFO [Listener at localhost/38639] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-17 02:01:36,809 INFO [Listener at localhost/38639] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-17 02:01:36,837 INFO [Listener at localhost/38639] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-17 02:01:36,852 INFO [Listener at localhost/38639] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=180 (was 155) Potentially hanging thread: RS-EventLoopGroup-11-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.5@localhost:35647 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1508527786) connection to localhost/127.0.0.1:35647 from jenkins.hfs.4 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins@localhost:35647 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1508527786) connection to localhost/127.0.0.1:35647 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: (jenkins-hbase4.apache.org,41793,1676599292544)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/38639 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1508527786) connection to localhost/127.0.0.1:35647 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-11-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.4@localhost:35647 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1508527786) connection to localhost/127.0.0.1:35647 from jenkins.hfs.5 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-11-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-8 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-9 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=571 (was 538) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=335 (was 347), ProcessCount=170 (was 170), AvailableMemoryMB=7550 (was 7717) 2023-02-17 02:01:36,864 INFO [Listener at localhost/38639] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=180, OpenFileDescriptor=571, MaxFileDescriptor=60000, SystemLoadAverage=335, ProcessCount=170, AvailableMemoryMB=7550 2023-02-17 02:01:36,877 INFO [Listener at localhost/38639] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b95c4b67-2ebf-d7a6-fc30-de669ab715d0/hadoop.log.dir so I do NOT create it in target/test-data/fa0ee6e0-39b1-6286-e115-44936a7d8bb6 2023-02-17 02:01:36,877 WARN [Listener at localhost/38639] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b95c4b67-2ebf-d7a6-fc30-de669ab715d0/hadoop.log.dir Erasing configuration value by system value. 2023-02-17 02:01:36,877 INFO [Listener at localhost/38639] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b95c4b67-2ebf-d7a6-fc30-de669ab715d0/hadoop.tmp.dir so I do NOT create it in target/test-data/fa0ee6e0-39b1-6286-e115-44936a7d8bb6 2023-02-17 02:01:36,877 WARN [Listener at localhost/38639] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b95c4b67-2ebf-d7a6-fc30-de669ab715d0/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-17 02:01:36,877 DEBUG [Listener at localhost/38639] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fa0ee6e0-39b1-6286-e115-44936a7d8bb6 2023-02-17 02:01:36,877 INFO [Listener at localhost/38639] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-17 02:01:36,877 INFO [Listener at localhost/38639] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fa0ee6e0-39b1-6286-e115-44936a7d8bb6/cluster_418c5021-b134-37cb-f05f-c6267f0b5fbc, deleteOnExit=true 2023-02-17 02:01:36,877 INFO [Listener at localhost/38639] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-17 02:01:36,877 INFO [Listener at localhost/38639] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fa0ee6e0-39b1-6286-e115-44936a7d8bb6/test.cache.data in system properties and HBase conf 2023-02-17 02:01:36,877 INFO [Listener at localhost/38639] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fa0ee6e0-39b1-6286-e115-44936a7d8bb6/hadoop.tmp.dir in system properties and HBase conf 2023-02-17 02:01:36,878 INFO [Listener at localhost/38639] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fa0ee6e0-39b1-6286-e115-44936a7d8bb6/hadoop.log.dir in system properties and HBase conf 2023-02-17 02:01:36,878 INFO [Listener at localhost/38639] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fa0ee6e0-39b1-6286-e115-44936a7d8bb6/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-17 02:01:36,878 INFO [Listener at localhost/38639] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fa0ee6e0-39b1-6286-e115-44936a7d8bb6/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-17 02:01:36,878 INFO [Listener at localhost/38639] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-17 02:01:36,878 DEBUG [Listener at localhost/38639] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-17 02:01:36,878 INFO [Listener at localhost/38639] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fa0ee6e0-39b1-6286-e115-44936a7d8bb6/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-17 02:01:36,878 INFO [Listener at localhost/38639] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fa0ee6e0-39b1-6286-e115-44936a7d8bb6/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-17 02:01:36,879 INFO [Listener at localhost/38639] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fa0ee6e0-39b1-6286-e115-44936a7d8bb6/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-17 02:01:36,879 INFO [Listener at localhost/38639] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fa0ee6e0-39b1-6286-e115-44936a7d8bb6/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-17 02:01:36,879 INFO [Listener at localhost/38639] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fa0ee6e0-39b1-6286-e115-44936a7d8bb6/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-17 02:01:36,879 INFO [Listener at localhost/38639] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fa0ee6e0-39b1-6286-e115-44936a7d8bb6/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-17 02:01:36,879 INFO [Listener at localhost/38639] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fa0ee6e0-39b1-6286-e115-44936a7d8bb6/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-17 02:01:36,879 INFO [Listener at localhost/38639] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fa0ee6e0-39b1-6286-e115-44936a7d8bb6/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-17 02:01:36,879 INFO [Listener at localhost/38639] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fa0ee6e0-39b1-6286-e115-44936a7d8bb6/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-17 02:01:36,879 INFO [Listener at localhost/38639] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fa0ee6e0-39b1-6286-e115-44936a7d8bb6/nfs.dump.dir in system properties and HBase conf 2023-02-17 02:01:36,879 INFO [Listener at localhost/38639] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fa0ee6e0-39b1-6286-e115-44936a7d8bb6/java.io.tmpdir in system properties and HBase conf 2023-02-17 02:01:36,879 INFO [Listener at localhost/38639] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fa0ee6e0-39b1-6286-e115-44936a7d8bb6/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-17 02:01:36,880 INFO [Listener at localhost/38639] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fa0ee6e0-39b1-6286-e115-44936a7d8bb6/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-17 02:01:36,880 INFO [Listener at localhost/38639] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fa0ee6e0-39b1-6286-e115-44936a7d8bb6/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-17 02:01:36,885 WARN [Listener at localhost/38639] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-17 02:01:36,885 WARN [Listener at localhost/38639] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-17 02:01:36,940 WARN [Listener at localhost/38639] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-17 02:01:36,942 INFO [Listener at localhost/38639] log.Slf4jLog(67): jetty-6.1.26 2023-02-17 02:01:36,953 INFO [Listener at localhost/38639] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fa0ee6e0-39b1-6286-e115-44936a7d8bb6/java.io.tmpdir/Jetty_localhost_37827_hdfs____.xzh4fx/webapp 2023-02-17 02:01:37,057 INFO [Listener at localhost/38639] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37827 2023-02-17 02:01:37,061 WARN [Listener at localhost/38639] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-17 02:01:37,061 WARN [Listener at localhost/38639] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-17 02:01:37,098 WARN [Listener at localhost/33493] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-17 02:01:37,109 WARN [Listener at localhost/33493] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-17 02:01:37,111 WARN [Listener at localhost/33493] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-17 02:01:37,112 INFO [Listener at localhost/33493] log.Slf4jLog(67): jetty-6.1.26 2023-02-17 02:01:37,117 INFO [Listener at localhost/33493] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fa0ee6e0-39b1-6286-e115-44936a7d8bb6/java.io.tmpdir/Jetty_localhost_36123_datanode____4s65hy/webapp 2023-02-17 02:01:37,219 INFO [Listener at localhost/33493] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36123 2023-02-17 02:01:37,236 WARN [Listener at localhost/36913] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-17 02:01:37,267 WARN [Listener at localhost/36913] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-17 02:01:37,269 WARN [Listener at localhost/36913] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-17 02:01:37,271 INFO [Listener at localhost/36913] log.Slf4jLog(67): jetty-6.1.26 2023-02-17 02:01:37,275 INFO [Listener at localhost/36913] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fa0ee6e0-39b1-6286-e115-44936a7d8bb6/java.io.tmpdir/Jetty_localhost_39803_datanode____smyph8/webapp 2023-02-17 02:01:37,350 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xac74aeff2a91be82: Processing first storage report for DS-1a82a9e9-95c0-44c9-8d42-657589901c45 from datanode 37b9f587-2da6-4c90-b8cf-80a19bca9ac5 2023-02-17 02:01:37,350 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xac74aeff2a91be82: from storage DS-1a82a9e9-95c0-44c9-8d42-657589901c45 node DatanodeRegistration(127.0.0.1:37139, datanodeUuid=37b9f587-2da6-4c90-b8cf-80a19bca9ac5, infoPort=36113, infoSecurePort=0, ipcPort=36913, storageInfo=lv=-57;cid=testClusterID;nsid=1958732301;c=1676599296888), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-17 02:01:37,350 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xac74aeff2a91be82: Processing first storage report for DS-38a382a0-9b36-460a-bee1-0610cb9061f9 from datanode 37b9f587-2da6-4c90-b8cf-80a19bca9ac5 2023-02-17 02:01:37,350 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xac74aeff2a91be82: from storage DS-38a382a0-9b36-460a-bee1-0610cb9061f9 node DatanodeRegistration(127.0.0.1:37139, datanodeUuid=37b9f587-2da6-4c90-b8cf-80a19bca9ac5, infoPort=36113, infoSecurePort=0, ipcPort=36913, storageInfo=lv=-57;cid=testClusterID;nsid=1958732301;c=1676599296888), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-17 02:01:37,387 INFO [Listener at localhost/36913] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39803 2023-02-17 02:01:37,403 WARN [Listener at localhost/42831] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-17 02:01:37,502 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf77933cf504ee756: Processing first storage report for DS-73c2fe1b-9d72-4e33-bb50-b95a13e3dbd5 from datanode 80e187cc-cf92-4205-91f7-3764636eafdb 2023-02-17 02:01:37,502 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf77933cf504ee756: from storage DS-73c2fe1b-9d72-4e33-bb50-b95a13e3dbd5 node DatanodeRegistration(127.0.0.1:36689, datanodeUuid=80e187cc-cf92-4205-91f7-3764636eafdb, infoPort=39181, infoSecurePort=0, ipcPort=42831, storageInfo=lv=-57;cid=testClusterID;nsid=1958732301;c=1676599296888), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-17 02:01:37,502 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf77933cf504ee756: Processing first storage report for DS-83375291-f9ae-4787-b211-c30592c941e0 from datanode 80e187cc-cf92-4205-91f7-3764636eafdb 2023-02-17 02:01:37,502 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf77933cf504ee756: from storage DS-83375291-f9ae-4787-b211-c30592c941e0 node DatanodeRegistration(127.0.0.1:36689, datanodeUuid=80e187cc-cf92-4205-91f7-3764636eafdb, infoPort=39181, infoSecurePort=0, ipcPort=42831, storageInfo=lv=-57;cid=testClusterID;nsid=1958732301;c=1676599296888), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-17 02:01:37,524 DEBUG [Listener at localhost/42831] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fa0ee6e0-39b1-6286-e115-44936a7d8bb6 2023-02-17 02:01:37,528 INFO [Listener at localhost/42831] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fa0ee6e0-39b1-6286-e115-44936a7d8bb6/cluster_418c5021-b134-37cb-f05f-c6267f0b5fbc/zookeeper_0, clientPort=49216, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fa0ee6e0-39b1-6286-e115-44936a7d8bb6/cluster_418c5021-b134-37cb-f05f-c6267f0b5fbc/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fa0ee6e0-39b1-6286-e115-44936a7d8bb6/cluster_418c5021-b134-37cb-f05f-c6267f0b5fbc/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-17 02:01:37,529 INFO [Listener at localhost/42831] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=49216 2023-02-17 02:01:37,529 INFO [Listener at localhost/42831] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 02:01:37,530 INFO [Listener at localhost/42831] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 02:01:37,543 INFO [Listener at localhost/42831] util.FSUtils(479): Created version file at hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902 with version=8 2023-02-17 02:01:37,543 INFO [Listener at localhost/42831] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 02:01:37,544 INFO [Listener at localhost/42831] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 02:01:37,545 INFO [Listener at localhost/42831] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:33493/user/jenkins/test-data/5842bbf8-60c5-814f-4a3e-f0f7b45dd79c/hbase-staging 2023-02-17 02:01:37,547 INFO [Listener at localhost/42831] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-17 02:01:37,547 INFO [Listener at localhost/42831] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 02:01:37,547 INFO [Listener at localhost/42831] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-17 02:01:37,547 INFO [Listener at localhost/42831] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-17 02:01:37,547 INFO [Listener at localhost/42831] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 02:01:37,547 INFO [Listener at localhost/42831] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-17 02:01:37,547 INFO [Listener at localhost/42831] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-17 02:01:37,548 INFO [Listener at localhost/42831] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44147 2023-02-17 02:01:37,548 INFO [Listener at localhost/42831] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 02:01:37,549 INFO [Listener at localhost/42831] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 02:01:37,550 INFO [Listener at localhost/42831] zookeeper.RecoverableZooKeeper(93): Process identifier=master:44147 connecting to ZooKeeper ensemble=127.0.0.1:49216 2023-02-17 02:01:37,556 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): master:441470x0, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-17 02:01:37,557 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:44147-0x1006002efba0000 connected 2023-02-17 02:01:37,574 DEBUG [Listener at localhost/42831] zookeeper.ZKUtil(164): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 02:01:37,574 DEBUG [Listener at localhost/42831] zookeeper.ZKUtil(164): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 02:01:37,575 DEBUG [Listener at localhost/42831] zookeeper.ZKUtil(164): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-17 02:01:37,575 DEBUG [Listener at localhost/42831] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44147 2023-02-17 02:01:37,575 DEBUG [Listener at localhost/42831] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44147 2023-02-17 02:01:37,575 DEBUG [Listener at localhost/42831] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44147 2023-02-17 02:01:37,576 DEBUG [Listener at localhost/42831] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44147 2023-02-17 02:01:37,576 DEBUG [Listener at localhost/42831] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44147 2023-02-17 02:01:37,576 INFO [Listener at localhost/42831] master.HMaster(444): hbase.rootdir=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902, hbase.cluster.distributed=false 2023-02-17 02:01:37,589 INFO [Listener at localhost/42831] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-17 02:01:37,589 INFO [Listener at localhost/42831] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 02:01:37,589 INFO [Listener at localhost/42831] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-17 02:01:37,589 INFO [Listener at localhost/42831] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-17 02:01:37,589 INFO [Listener at localhost/42831] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 02:01:37,589 INFO [Listener at localhost/42831] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-17 02:01:37,589 INFO [Listener at localhost/42831] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-17 02:01:37,590 INFO [Listener at localhost/42831] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33169 2023-02-17 02:01:37,590 INFO [Listener at localhost/42831] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-17 02:01:37,591 DEBUG [Listener at localhost/42831] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 02:01:37,592 INFO [Listener at localhost/42831] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 02:01:37,630 INFO [Listener at localhost/42831] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 02:01:37,631 INFO [Listener at localhost/42831] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:33169 connecting to ZooKeeper ensemble=127.0.0.1:49216 2023-02-17 02:01:37,634 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): regionserver:331690x0, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-17 02:01:37,636 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:33169-0x1006002efba0001 connected 2023-02-17 02:01:37,636 DEBUG [Listener at localhost/42831] zookeeper.ZKUtil(164): regionserver:33169-0x1006002efba0001, quorum=127.0.0.1:49216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 02:01:37,636 DEBUG [Listener at localhost/42831] zookeeper.ZKUtil(164): regionserver:33169-0x1006002efba0001, quorum=127.0.0.1:49216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 02:01:37,637 DEBUG [Listener at localhost/42831] zookeeper.ZKUtil(164): regionserver:33169-0x1006002efba0001, quorum=127.0.0.1:49216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-17 02:01:37,638 DEBUG [Listener at localhost/42831] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33169 2023-02-17 02:01:37,638 DEBUG [Listener at localhost/42831] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33169 2023-02-17 02:01:37,638 DEBUG [Listener at localhost/42831] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33169 2023-02-17 02:01:37,639 DEBUG [Listener at localhost/42831] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33169 2023-02-17 02:01:37,639 DEBUG [Listener at localhost/42831] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33169 2023-02-17 02:01:37,651 INFO [Listener at localhost/42831] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-17 02:01:37,651 INFO [Listener at localhost/42831] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 02:01:37,651 INFO [Listener at localhost/42831] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-17 02:01:37,652 INFO [Listener at localhost/42831] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-17 02:01:37,652 INFO [Listener at localhost/42831] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 02:01:37,652 INFO [Listener at localhost/42831] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-17 02:01:37,652 INFO [Listener at localhost/42831] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-17 02:01:37,653 INFO [Listener at localhost/42831] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40913 2023-02-17 02:01:37,653 INFO [Listener at localhost/42831] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-17 02:01:37,654 DEBUG [Listener at localhost/42831] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 02:01:37,655 INFO [Listener at localhost/42831] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 02:01:37,656 INFO [Listener at localhost/42831] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 02:01:37,657 INFO [Listener at localhost/42831] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40913 connecting to ZooKeeper ensemble=127.0.0.1:49216 2023-02-17 02:01:37,662 DEBUG [Listener at localhost/42831] zookeeper.ZKUtil(164): regionserver:409130x0, quorum=127.0.0.1:49216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 02:01:37,662 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): regionserver:409130x0, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-17 02:01:37,670 DEBUG [Listener at localhost/42831] zookeeper.ZKUtil(164): regionserver:409130x0, quorum=127.0.0.1:49216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 02:01:37,670 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:40913-0x1006002efba0002 connected 2023-02-17 02:01:37,671 DEBUG [Listener at localhost/42831] zookeeper.ZKUtil(164): regionserver:40913-0x1006002efba0002, quorum=127.0.0.1:49216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-17 02:01:37,677 DEBUG [Listener at localhost/42831] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40913 2023-02-17 02:01:37,678 DEBUG [Listener at localhost/42831] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40913 2023-02-17 02:01:37,678 DEBUG [Listener at localhost/42831] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40913 2023-02-17 02:01:37,679 DEBUG [Listener at localhost/42831] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40913 2023-02-17 02:01:37,679 DEBUG [Listener at localhost/42831] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40913 2023-02-17 02:01:37,682 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,44147,1676599297546 2023-02-17 02:01:37,684 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-17 02:01:37,685 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,44147,1676599297546 2023-02-17 02:01:37,686 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-17 02:01:37,686 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): regionserver:40913-0x1006002efba0002, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-17 02:01:37,686 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): regionserver:33169-0x1006002efba0001, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-17 02:01:37,686 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 02:01:37,688 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-17 02:01:37,689 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,44147,1676599297546 from backup master directory 2023-02-17 02:01:37,689 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-17 02:01:37,690 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,44147,1676599297546 2023-02-17 02:01:37,690 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-17 02:01:37,690 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-17 02:01:37,690 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,44147,1676599297546 2023-02-17 02:01:37,705 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/hbase.id with ID: 1eacd826-7eab-49b8-8466-8f4c7ef6e509 2023-02-17 02:01:37,715 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 02:01:37,717 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 02:01:37,725 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x3875192b to 127.0.0.1:49216 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 02:01:37,735 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@293d8d2c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 02:01:37,736 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-17 02:01:37,736 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-17 02:01:37,736 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 02:01:37,738 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/MasterData/data/master/store-tmp 2023-02-17 02:01:37,750 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:37,750 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-17 02:01:37,750 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 02:01:37,750 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 02:01:37,750 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-17 02:01:37,750 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 02:01:37,750 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 02:01:37,750 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-17 02:01:37,751 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/MasterData/WALs/jenkins-hbase4.apache.org,44147,1676599297546 2023-02-17 02:01:37,753 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44147%2C1676599297546, suffix=, logDir=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/MasterData/WALs/jenkins-hbase4.apache.org,44147,1676599297546, archiveDir=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/MasterData/oldWALs, maxLogs=10 2023-02-17 02:01:37,778 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37139,DS-1a82a9e9-95c0-44c9-8d42-657589901c45,DISK] 2023-02-17 02:01:37,779 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36689,DS-73c2fe1b-9d72-4e33-bb50-b95a13e3dbd5,DISK] 2023-02-17 02:01:37,782 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/MasterData/WALs/jenkins-hbase4.apache.org,44147,1676599297546/jenkins-hbase4.apache.org%2C44147%2C1676599297546.1676599297753 2023-02-17 02:01:37,782 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37139,DS-1a82a9e9-95c0-44c9-8d42-657589901c45,DISK], DatanodeInfoWithStorage[127.0.0.1:36689,DS-73c2fe1b-9d72-4e33-bb50-b95a13e3dbd5,DISK]] 2023-02-17 02:01:37,782 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-17 02:01:37,783 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:37,783 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-17 02:01:37,783 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-17 02:01:37,784 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-17 02:01:37,785 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-17 02:01:37,786 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-17 02:01:37,786 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:37,787 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-17 02:01:37,787 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-17 02:01:37,790 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-17 02:01:37,792 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 02:01:37,793 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68252238, jitterRate=0.01703760027885437}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-17 02:01:37,793 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-17 02:01:37,793 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-17 02:01:37,794 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-17 02:01:37,794 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-17 02:01:37,795 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-17 02:01:37,795 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-17 02:01:37,795 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-17 02:01:37,795 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-17 02:01:37,799 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-17 02:01:37,800 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-17 02:01:37,811 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-17 02:01:37,811 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-17 02:01:37,812 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-17 02:01:37,812 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-17 02:01:37,812 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-17 02:01:37,817 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 02:01:37,817 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-17 02:01:37,818 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-17 02:01:37,819 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-17 02:01:37,820 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-17 02:01:37,820 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 02:01:37,820 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): regionserver:33169-0x1006002efba0001, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-17 02:01:37,820 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): regionserver:40913-0x1006002efba0002, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-17 02:01:37,821 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,44147,1676599297546, sessionid=0x1006002efba0000, setting cluster-up flag (Was=false) 2023-02-17 02:01:37,826 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 02:01:37,830 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-17 02:01:37,831 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,44147,1676599297546 2023-02-17 02:01:37,835 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 02:01:37,843 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-17 02:01:37,844 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,44147,1676599297546 2023-02-17 02:01:37,845 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.hbase-snapshot/.tmp 2023-02-17 02:01:37,862 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-17 02:01:37,863 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-17 02:01:37,863 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-17 02:01:37,863 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-17 02:01:37,863 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-17 02:01:37,863 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-17 02:01:37,863 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:37,863 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-17 02:01:37,863 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:37,880 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-17 02:01:37,880 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-17 02:01:37,882 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-17 02:01:37,883 INFO [RS:0;jenkins-hbase4:33169] regionserver.HRegionServer(952): ClusterId : 1eacd826-7eab-49b8-8466-8f4c7ef6e509 2023-02-17 02:01:37,884 DEBUG [RS:0;jenkins-hbase4:33169] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-17 02:01:37,888 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676599327888 2023-02-17 02:01:37,890 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-17 02:01:37,890 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-17 02:01:37,890 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-17 02:01:37,890 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-17 02:01:37,890 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-17 02:01:37,891 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-17 02:01:37,890 DEBUG [RS:0;jenkins-hbase4:33169] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-17 02:01:37,891 DEBUG [RS:0;jenkins-hbase4:33169] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-17 02:01:37,898 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:37,899 INFO [RS:1;jenkins-hbase4:40913] regionserver.HRegionServer(952): ClusterId : 1eacd826-7eab-49b8-8466-8f4c7ef6e509 2023-02-17 02:01:37,899 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-17 02:01:37,899 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-17 02:01:37,905 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-17 02:01:37,899 DEBUG [RS:0;jenkins-hbase4:33169] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-17 02:01:37,912 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-17 02:01:37,912 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-17 02:01:37,912 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676599297912,5,FailOnTimeoutGroup] 2023-02-17 02:01:37,921 DEBUG [RS:1;jenkins-hbase4:40913] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-17 02:01:37,922 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676599297921,5,FailOnTimeoutGroup] 2023-02-17 02:01:37,922 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:37,922 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-17 02:01:37,922 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:37,922 DEBUG [RS:0;jenkins-hbase4:33169] zookeeper.ReadOnlyZKClient(139): Connect 0x2145d207 to 127.0.0.1:49216 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 02:01:37,922 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:37,925 DEBUG [RS:1;jenkins-hbase4:40913] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-17 02:01:37,925 DEBUG [RS:1;jenkins-hbase4:40913] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-17 02:01:37,927 DEBUG [RS:1;jenkins-hbase4:40913] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-17 02:01:37,930 DEBUG [RS:1;jenkins-hbase4:40913] zookeeper.ReadOnlyZKClient(139): Connect 0x25107751 to 127.0.0.1:49216 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 02:01:37,932 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-17 02:01:37,933 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-17 02:01:37,933 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902 2023-02-17 02:01:37,941 DEBUG [RS:0;jenkins-hbase4:33169] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2f82285f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 02:01:37,941 DEBUG [RS:0;jenkins-hbase4:33169] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2bbdb977, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-17 02:01:37,943 DEBUG [RS:1;jenkins-hbase4:40913] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2bd79d83, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 02:01:37,943 DEBUG [RS:1;jenkins-hbase4:40913] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2fe81c21, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-17 02:01:37,953 DEBUG [RS:0;jenkins-hbase4:33169] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:33169 2023-02-17 02:01:37,953 INFO [RS:0;jenkins-hbase4:33169] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-17 02:01:37,953 INFO [RS:0;jenkins-hbase4:33169] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-17 02:01:37,953 DEBUG [RS:0;jenkins-hbase4:33169] regionserver.HRegionServer(1023): About to register with Master. 2023-02-17 02:01:37,954 INFO [RS:0;jenkins-hbase4:33169] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,44147,1676599297546 with isa=jenkins-hbase4.apache.org/172.31.14.131:33169, startcode=1676599297588 2023-02-17 02:01:37,954 DEBUG [RS:0;jenkins-hbase4:33169] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-17 02:01:37,956 INFO [RS-EventLoopGroup-12-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54675, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.6 (auth:SIMPLE), service=RegionServerStatusService 2023-02-17 02:01:37,958 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,33169,1676599297588 2023-02-17 02:01:37,959 DEBUG [RS:0;jenkins-hbase4:33169] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902 2023-02-17 02:01:37,959 DEBUG [RS:0;jenkins-hbase4:33169] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:33493 2023-02-17 02:01:37,959 DEBUG [RS:0;jenkins-hbase4:33169] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-17 02:01:37,961 DEBUG [RS:1;jenkins-hbase4:40913] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:40913 2023-02-17 02:01:37,961 INFO [RS:1;jenkins-hbase4:40913] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-17 02:01:37,961 INFO [RS:1;jenkins-hbase4:40913] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-17 02:01:37,961 DEBUG [RS:1;jenkins-hbase4:40913] regionserver.HRegionServer(1023): About to register with Master. 2023-02-17 02:01:37,962 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 02:01:37,963 INFO [RS:1;jenkins-hbase4:40913] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,44147,1676599297546 with isa=jenkins-hbase4.apache.org/172.31.14.131:40913, startcode=1676599297651 2023-02-17 02:01:37,963 DEBUG [RS:1;jenkins-hbase4:40913] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-17 02:01:37,963 DEBUG [RS:0;jenkins-hbase4:33169] zookeeper.ZKUtil(162): regionserver:33169-0x1006002efba0001, quorum=127.0.0.1:49216, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33169,1676599297588 2023-02-17 02:01:37,963 WARN [RS:0;jenkins-hbase4:33169] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-17 02:01:37,963 INFO [RS:0;jenkins-hbase4:33169] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 02:01:37,963 DEBUG [RS:0;jenkins-hbase4:33169] regionserver.HRegionServer(1947): logDir=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/WALs/jenkins-hbase4.apache.org,33169,1676599297588 2023-02-17 02:01:37,969 INFO [RS-EventLoopGroup-12-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48543, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.7 (auth:SIMPLE), service=RegionServerStatusService 2023-02-17 02:01:37,970 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,33169,1676599297588] 2023-02-17 02:01:37,970 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,40913,1676599297651 2023-02-17 02:01:37,971 DEBUG [RS:1;jenkins-hbase4:40913] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902 2023-02-17 02:01:37,971 DEBUG [RS:1;jenkins-hbase4:40913] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:33493 2023-02-17 02:01:37,971 DEBUG [RS:1;jenkins-hbase4:40913] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-17 02:01:37,976 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): regionserver:33169-0x1006002efba0001, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 02:01:37,976 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 02:01:37,977 DEBUG [RS:0;jenkins-hbase4:33169] zookeeper.ZKUtil(162): regionserver:33169-0x1006002efba0001, quorum=127.0.0.1:49216, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33169,1676599297588 2023-02-17 02:01:37,977 DEBUG [RS:1;jenkins-hbase4:40913] zookeeper.ZKUtil(162): regionserver:40913-0x1006002efba0002, quorum=127.0.0.1:49216, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40913,1676599297651 2023-02-17 02:01:37,977 WARN [RS:1;jenkins-hbase4:40913] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-17 02:01:37,977 INFO [RS:1;jenkins-hbase4:40913] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 02:01:37,977 DEBUG [RS:1;jenkins-hbase4:40913] regionserver.HRegionServer(1947): logDir=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/WALs/jenkins-hbase4.apache.org,40913,1676599297651 2023-02-17 02:01:37,978 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40913,1676599297651] 2023-02-17 02:01:37,978 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:33169-0x1006002efba0001, quorum=127.0.0.1:49216, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33169,1676599297588 2023-02-17 02:01:37,980 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:33169-0x1006002efba0001, quorum=127.0.0.1:49216, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40913,1676599297651 2023-02-17 02:01:37,981 DEBUG [RS:0;jenkins-hbase4:33169] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-17 02:01:37,981 INFO [RS:0;jenkins-hbase4:33169] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-17 02:01:37,985 DEBUG [RS:1;jenkins-hbase4:40913] zookeeper.ZKUtil(162): regionserver:40913-0x1006002efba0002, quorum=127.0.0.1:49216, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33169,1676599297588 2023-02-17 02:01:37,986 DEBUG [RS:1;jenkins-hbase4:40913] zookeeper.ZKUtil(162): regionserver:40913-0x1006002efba0002, quorum=127.0.0.1:49216, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40913,1676599297651 2023-02-17 02:01:37,987 DEBUG [RS:1;jenkins-hbase4:40913] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-17 02:01:37,987 INFO [RS:1;jenkins-hbase4:40913] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-17 02:01:37,990 INFO [RS:0;jenkins-hbase4:33169] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-17 02:01:37,990 INFO [RS:1;jenkins-hbase4:40913] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-17 02:01:37,990 INFO [RS:0;jenkins-hbase4:33169] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-17 02:01:37,990 INFO [RS:0;jenkins-hbase4:33169] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:37,990 INFO [RS:1;jenkins-hbase4:40913] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-17 02:01:37,990 INFO [RS:1;jenkins-hbase4:40913] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:37,990 INFO [RS:0;jenkins-hbase4:33169] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-17 02:01:37,991 INFO [RS:1;jenkins-hbase4:40913] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-17 02:01:37,993 INFO [RS:1;jenkins-hbase4:40913] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:37,993 DEBUG [RS:1;jenkins-hbase4:40913] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:37,993 DEBUG [RS:1;jenkins-hbase4:40913] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:37,993 DEBUG [RS:1;jenkins-hbase4:40913] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:37,994 DEBUG [RS:1;jenkins-hbase4:40913] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:37,994 DEBUG [RS:1;jenkins-hbase4:40913] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:37,994 DEBUG [RS:1;jenkins-hbase4:40913] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-17 02:01:37,994 DEBUG [RS:1;jenkins-hbase4:40913] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:37,994 DEBUG [RS:1;jenkins-hbase4:40913] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:37,994 DEBUG [RS:1;jenkins-hbase4:40913] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:37,994 DEBUG [RS:1;jenkins-hbase4:40913] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:38,008 INFO [RS:0;jenkins-hbase4:33169] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:38,020 INFO [RS:1;jenkins-hbase4:40913] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:38,020 DEBUG [RS:0;jenkins-hbase4:33169] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:38,020 INFO [RS:1;jenkins-hbase4:40913] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:38,021 DEBUG [RS:0;jenkins-hbase4:33169] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:38,021 INFO [RS:1;jenkins-hbase4:40913] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:38,021 DEBUG [RS:0;jenkins-hbase4:33169] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:38,021 DEBUG [RS:0;jenkins-hbase4:33169] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:38,021 DEBUG [RS:0;jenkins-hbase4:33169] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:38,021 DEBUG [RS:0;jenkins-hbase4:33169] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-17 02:01:38,021 DEBUG [RS:0;jenkins-hbase4:33169] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:38,021 DEBUG [RS:0;jenkins-hbase4:33169] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:38,022 DEBUG [RS:0;jenkins-hbase4:33169] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:38,022 DEBUG [RS:0;jenkins-hbase4:33169] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:38,026 INFO [RS:0;jenkins-hbase4:33169] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:38,026 INFO [RS:0;jenkins-hbase4:33169] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:38,026 INFO [RS:0;jenkins-hbase4:33169] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:38,037 INFO [RS:1;jenkins-hbase4:40913] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-17 02:01:38,037 INFO [RS:1;jenkins-hbase4:40913] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40913,1676599297651-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:38,039 INFO [RS:0;jenkins-hbase4:33169] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-17 02:01:38,039 INFO [RS:0;jenkins-hbase4:33169] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33169,1676599297588-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:38,047 INFO [RS:1;jenkins-hbase4:40913] regionserver.Replication(203): jenkins-hbase4.apache.org,40913,1676599297651 started 2023-02-17 02:01:38,047 INFO [RS:1;jenkins-hbase4:40913] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,40913,1676599297651, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40913, sessionid=0x1006002efba0002 2023-02-17 02:01:38,047 DEBUG [RS:1;jenkins-hbase4:40913] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-17 02:01:38,047 DEBUG [RS:1;jenkins-hbase4:40913] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40913,1676599297651 2023-02-17 02:01:38,047 DEBUG [RS:1;jenkins-hbase4:40913] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40913,1676599297651' 2023-02-17 02:01:38,047 DEBUG [RS:1;jenkins-hbase4:40913] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 02:01:38,048 DEBUG [RS:1;jenkins-hbase4:40913] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 02:01:38,048 DEBUG [RS:1;jenkins-hbase4:40913] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-17 02:01:38,048 DEBUG [RS:1;jenkins-hbase4:40913] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-17 02:01:38,048 DEBUG [RS:1;jenkins-hbase4:40913] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40913,1676599297651 2023-02-17 02:01:38,048 DEBUG [RS:1;jenkins-hbase4:40913] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40913,1676599297651' 2023-02-17 02:01:38,048 DEBUG [RS:1;jenkins-hbase4:40913] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 02:01:38,049 DEBUG [RS:1;jenkins-hbase4:40913] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 02:01:38,049 DEBUG [RS:1;jenkins-hbase4:40913] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-17 02:01:38,049 INFO [RS:1;jenkins-hbase4:40913] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-17 02:01:38,049 INFO [RS:1;jenkins-hbase4:40913] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-17 02:01:38,049 INFO [RS:0;jenkins-hbase4:33169] regionserver.Replication(203): jenkins-hbase4.apache.org,33169,1676599297588 started 2023-02-17 02:01:38,049 INFO [RS:0;jenkins-hbase4:33169] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,33169,1676599297588, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:33169, sessionid=0x1006002efba0001 2023-02-17 02:01:38,049 DEBUG [RS:0;jenkins-hbase4:33169] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-17 02:01:38,049 DEBUG [RS:0;jenkins-hbase4:33169] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,33169,1676599297588 2023-02-17 02:01:38,049 DEBUG [RS:0;jenkins-hbase4:33169] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33169,1676599297588' 2023-02-17 02:01:38,049 DEBUG [RS:0;jenkins-hbase4:33169] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 02:01:38,050 DEBUG [RS:0;jenkins-hbase4:33169] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 02:01:38,050 DEBUG [RS:0;jenkins-hbase4:33169] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-17 02:01:38,050 DEBUG [RS:0;jenkins-hbase4:33169] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-17 02:01:38,050 DEBUG [RS:0;jenkins-hbase4:33169] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,33169,1676599297588 2023-02-17 02:01:38,050 DEBUG [RS:0;jenkins-hbase4:33169] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33169,1676599297588' 2023-02-17 02:01:38,050 DEBUG [RS:0;jenkins-hbase4:33169] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 02:01:38,050 DEBUG [RS:0;jenkins-hbase4:33169] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 02:01:38,051 DEBUG [RS:0;jenkins-hbase4:33169] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-17 02:01:38,051 INFO [RS:0;jenkins-hbase4:33169] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-17 02:01:38,051 INFO [RS:0;jenkins-hbase4:33169] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-17 02:01:38,351 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:38,353 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-17 02:01:38,354 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/hbase/meta/1588230740/info 2023-02-17 02:01:38,354 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-17 02:01:38,355 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:38,355 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-17 02:01:38,357 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/hbase/meta/1588230740/rep_barrier 2023-02-17 02:01:38,357 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-17 02:01:38,358 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:38,358 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-17 02:01:38,359 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/hbase/meta/1588230740/table 2023-02-17 02:01:38,360 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-17 02:01:38,360 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:38,361 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/hbase/meta/1588230740 2023-02-17 02:01:38,361 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/hbase/meta/1588230740 2023-02-17 02:01:38,363 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-17 02:01:38,364 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-17 02:01:38,366 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 02:01:38,367 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63275651, jitterRate=-0.057119324803352356}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-17 02:01:38,367 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-17 02:01:38,367 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-17 02:01:38,367 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-17 02:01:38,367 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-17 02:01:38,367 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-17 02:01:38,367 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-17 02:01:38,369 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-17 02:01:38,369 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-17 02:01:38,369 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-17 02:01:38,369 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-17 02:01:38,370 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-17 02:01:38,371 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-17 02:01:38,373 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-17 02:01:38,523 DEBUG [jenkins-hbase4:44147] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-17 02:01:38,523 DEBUG [jenkins-hbase4:44147] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-17 02:01:38,525 DEBUG [jenkins-hbase4:44147] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-17 02:01:38,525 DEBUG [jenkins-hbase4:44147] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-17 02:01:38,525 DEBUG [jenkins-hbase4:44147] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-17 02:01:38,526 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40913,1676599297651, state=OPENING 2023-02-17 02:01:38,529 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-17 02:01:38,530 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 02:01:38,530 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-17 02:01:38,530 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40913,1676599297651}] 2023-02-17 02:01:38,654 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-17 02:01:38,684 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,40913,1676599297651 2023-02-17 02:01:38,685 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-17 02:01:38,687 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44238, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-17 02:01:38,691 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-17 02:01:38,691 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 02:01:38,692 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40913%2C1676599297651.meta, suffix=.meta, logDir=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/WALs/jenkins-hbase4.apache.org,40913,1676599297651, archiveDir=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/oldWALs, maxLogs=32 2023-02-17 02:01:38,711 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36689,DS-73c2fe1b-9d72-4e33-bb50-b95a13e3dbd5,DISK] 2023-02-17 02:01:38,712 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37139,DS-1a82a9e9-95c0-44c9-8d42-657589901c45,DISK] 2023-02-17 02:01:38,714 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/WALs/jenkins-hbase4.apache.org,40913,1676599297651/jenkins-hbase4.apache.org%2C40913%2C1676599297651.meta.1676599298693.meta 2023-02-17 02:01:38,715 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36689,DS-73c2fe1b-9d72-4e33-bb50-b95a13e3dbd5,DISK], DatanodeInfoWithStorage[127.0.0.1:37139,DS-1a82a9e9-95c0-44c9-8d42-657589901c45,DISK]] 2023-02-17 02:01:38,715 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-17 02:01:38,715 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-17 02:01:38,715 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-17 02:01:38,715 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-17 02:01:38,715 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-17 02:01:38,715 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:38,715 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-17 02:01:38,715 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-17 02:01:38,717 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-17 02:01:38,718 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/hbase/meta/1588230740/info 2023-02-17 02:01:38,718 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/hbase/meta/1588230740/info 2023-02-17 02:01:38,718 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-17 02:01:38,719 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:38,719 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-17 02:01:38,720 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/hbase/meta/1588230740/rep_barrier 2023-02-17 02:01:38,721 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/hbase/meta/1588230740/rep_barrier 2023-02-17 02:01:38,722 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-17 02:01:38,724 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:38,724 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-17 02:01:38,725 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/hbase/meta/1588230740/table 2023-02-17 02:01:38,725 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/hbase/meta/1588230740/table 2023-02-17 02:01:38,725 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-17 02:01:38,726 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:38,728 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/hbase/meta/1588230740 2023-02-17 02:01:38,729 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/hbase/meta/1588230740 2023-02-17 02:01:38,731 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-17 02:01:38,732 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-17 02:01:38,733 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61004958, jitterRate=-0.09095528721809387}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-17 02:01:38,733 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-17 02:01:38,734 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676599298684 2023-02-17 02:01:38,739 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-17 02:01:38,739 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-17 02:01:38,739 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40913,1676599297651, state=OPEN 2023-02-17 02:01:38,741 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-17 02:01:38,741 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-17 02:01:38,743 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-17 02:01:38,743 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40913,1676599297651 in 211 msec 2023-02-17 02:01:38,744 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-17 02:01:38,744 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 373 msec 2023-02-17 02:01:38,746 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 884 msec 2023-02-17 02:01:38,746 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676599298746, completionTime=-1 2023-02-17 02:01:38,746 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-17 02:01:38,746 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-17 02:01:38,752 DEBUG [hconnection-0x34dc5c7-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 02:01:38,753 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44242, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 02:01:38,755 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-17 02:01:38,755 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676599358755 2023-02-17 02:01:38,755 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676599418755 2023-02-17 02:01:38,755 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 9 msec 2023-02-17 02:01:38,763 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44147,1676599297546-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:38,763 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44147,1676599297546-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:38,763 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44147,1676599297546-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:38,763 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:44147, period=300000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:38,763 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:38,763 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-17 02:01:38,763 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-17 02:01:38,764 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-17 02:01:38,765 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-17 02:01:38,765 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-17 02:01:38,766 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-17 02:01:38,768 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/hbase/namespace/3b68d31ac448617f8eedd3050b1aaae5 2023-02-17 02:01:38,768 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/hbase/namespace/3b68d31ac448617f8eedd3050b1aaae5 empty. 2023-02-17 02:01:38,769 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/hbase/namespace/3b68d31ac448617f8eedd3050b1aaae5 2023-02-17 02:01:38,769 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-17 02:01:38,779 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-17 02:01:38,780 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 3b68d31ac448617f8eedd3050b1aaae5, NAME => 'hbase:namespace,,1676599298763.3b68d31ac448617f8eedd3050b1aaae5.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp 2023-02-17 02:01:38,790 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676599298763.3b68d31ac448617f8eedd3050b1aaae5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:38,790 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 3b68d31ac448617f8eedd3050b1aaae5, disabling compactions & flushes 2023-02-17 02:01:38,790 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676599298763.3b68d31ac448617f8eedd3050b1aaae5. 2023-02-17 02:01:38,790 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676599298763.3b68d31ac448617f8eedd3050b1aaae5. 2023-02-17 02:01:38,790 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676599298763.3b68d31ac448617f8eedd3050b1aaae5. after waiting 0 ms 2023-02-17 02:01:38,790 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676599298763.3b68d31ac448617f8eedd3050b1aaae5. 2023-02-17 02:01:38,790 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676599298763.3b68d31ac448617f8eedd3050b1aaae5. 2023-02-17 02:01:38,790 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 3b68d31ac448617f8eedd3050b1aaae5: 2023-02-17 02:01:38,794 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-17 02:01:38,795 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676599298763.3b68d31ac448617f8eedd3050b1aaae5.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676599298795"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676599298795"}]},"ts":"1676599298795"} 2023-02-17 02:01:38,797 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-17 02:01:38,798 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-17 02:01:38,798 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676599298798"}]},"ts":"1676599298798"} 2023-02-17 02:01:38,799 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-17 02:01:38,802 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-17 02:01:38,803 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-17 02:01:38,803 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-17 02:01:38,803 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-17 02:01:38,806 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=3b68d31ac448617f8eedd3050b1aaae5, ASSIGN}] 2023-02-17 02:01:38,809 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=3b68d31ac448617f8eedd3050b1aaae5, ASSIGN 2023-02-17 02:01:38,810 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=3b68d31ac448617f8eedd3050b1aaae5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40913,1676599297651; forceNewPlan=false, retain=false 2023-02-17 02:01:38,960 INFO [jenkins-hbase4:44147] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-17 02:01:38,962 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=3b68d31ac448617f8eedd3050b1aaae5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40913,1676599297651 2023-02-17 02:01:38,962 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676599298763.3b68d31ac448617f8eedd3050b1aaae5.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676599298962"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676599298962"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676599298962"}]},"ts":"1676599298962"} 2023-02-17 02:01:38,964 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 3b68d31ac448617f8eedd3050b1aaae5, server=jenkins-hbase4.apache.org,40913,1676599297651}] 2023-02-17 02:01:39,051 INFO [RS:1;jenkins-hbase4:40913] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40913%2C1676599297651, suffix=, logDir=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/WALs/jenkins-hbase4.apache.org,40913,1676599297651, archiveDir=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/oldWALs, maxLogs=32 2023-02-17 02:01:39,052 INFO [RS:0;jenkins-hbase4:33169] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33169%2C1676599297588, suffix=, logDir=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/WALs/jenkins-hbase4.apache.org,33169,1676599297588, archiveDir=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/oldWALs, maxLogs=32 2023-02-17 02:01:39,070 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36689,DS-73c2fe1b-9d72-4e33-bb50-b95a13e3dbd5,DISK] 2023-02-17 02:01:39,071 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37139,DS-1a82a9e9-95c0-44c9-8d42-657589901c45,DISK] 2023-02-17 02:01:39,074 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37139,DS-1a82a9e9-95c0-44c9-8d42-657589901c45,DISK] 2023-02-17 02:01:39,074 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36689,DS-73c2fe1b-9d72-4e33-bb50-b95a13e3dbd5,DISK] 2023-02-17 02:01:39,076 INFO [RS:0;jenkins-hbase4:33169] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/WALs/jenkins-hbase4.apache.org,33169,1676599297588/jenkins-hbase4.apache.org%2C33169%2C1676599297588.1676599299053 2023-02-17 02:01:39,078 DEBUG [RS:0;jenkins-hbase4:33169] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37139,DS-1a82a9e9-95c0-44c9-8d42-657589901c45,DISK], DatanodeInfoWithStorage[127.0.0.1:36689,DS-73c2fe1b-9d72-4e33-bb50-b95a13e3dbd5,DISK]] 2023-02-17 02:01:39,078 INFO [RS:1;jenkins-hbase4:40913] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/WALs/jenkins-hbase4.apache.org,40913,1676599297651/jenkins-hbase4.apache.org%2C40913%2C1676599297651.1676599299051 2023-02-17 02:01:39,079 DEBUG [RS:1;jenkins-hbase4:40913] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36689,DS-73c2fe1b-9d72-4e33-bb50-b95a13e3dbd5,DISK], DatanodeInfoWithStorage[127.0.0.1:37139,DS-1a82a9e9-95c0-44c9-8d42-657589901c45,DISK]] 2023-02-17 02:01:39,119 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676599298763.3b68d31ac448617f8eedd3050b1aaae5. 2023-02-17 02:01:39,119 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3b68d31ac448617f8eedd3050b1aaae5, NAME => 'hbase:namespace,,1676599298763.3b68d31ac448617f8eedd3050b1aaae5.', STARTKEY => '', ENDKEY => ''} 2023-02-17 02:01:39,120 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 3b68d31ac448617f8eedd3050b1aaae5 2023-02-17 02:01:39,120 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676599298763.3b68d31ac448617f8eedd3050b1aaae5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:39,120 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 3b68d31ac448617f8eedd3050b1aaae5 2023-02-17 02:01:39,120 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 3b68d31ac448617f8eedd3050b1aaae5 2023-02-17 02:01:39,121 INFO [StoreOpener-3b68d31ac448617f8eedd3050b1aaae5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 3b68d31ac448617f8eedd3050b1aaae5 2023-02-17 02:01:39,122 DEBUG [StoreOpener-3b68d31ac448617f8eedd3050b1aaae5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/hbase/namespace/3b68d31ac448617f8eedd3050b1aaae5/info 2023-02-17 02:01:39,122 DEBUG [StoreOpener-3b68d31ac448617f8eedd3050b1aaae5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/hbase/namespace/3b68d31ac448617f8eedd3050b1aaae5/info 2023-02-17 02:01:39,123 INFO [StoreOpener-3b68d31ac448617f8eedd3050b1aaae5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3b68d31ac448617f8eedd3050b1aaae5 columnFamilyName info 2023-02-17 02:01:39,123 INFO [StoreOpener-3b68d31ac448617f8eedd3050b1aaae5-1] regionserver.HStore(310): Store=3b68d31ac448617f8eedd3050b1aaae5/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:39,124 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/hbase/namespace/3b68d31ac448617f8eedd3050b1aaae5 2023-02-17 02:01:39,124 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/hbase/namespace/3b68d31ac448617f8eedd3050b1aaae5 2023-02-17 02:01:39,126 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 3b68d31ac448617f8eedd3050b1aaae5 2023-02-17 02:01:39,128 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/hbase/namespace/3b68d31ac448617f8eedd3050b1aaae5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 02:01:39,128 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 3b68d31ac448617f8eedd3050b1aaae5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75365903, jitterRate=0.12303946912288666}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-17 02:01:39,128 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 3b68d31ac448617f8eedd3050b1aaae5: 2023-02-17 02:01:39,129 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676599298763.3b68d31ac448617f8eedd3050b1aaae5., pid=6, masterSystemTime=1676599299116 2023-02-17 02:01:39,131 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676599298763.3b68d31ac448617f8eedd3050b1aaae5. 2023-02-17 02:01:39,131 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676599298763.3b68d31ac448617f8eedd3050b1aaae5. 2023-02-17 02:01:39,132 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=3b68d31ac448617f8eedd3050b1aaae5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40913,1676599297651 2023-02-17 02:01:39,132 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676599298763.3b68d31ac448617f8eedd3050b1aaae5.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676599299132"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676599299132"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676599299132"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676599299132"}]},"ts":"1676599299132"} 2023-02-17 02:01:39,135 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-17 02:01:39,135 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 3b68d31ac448617f8eedd3050b1aaae5, server=jenkins-hbase4.apache.org,40913,1676599297651 in 169 msec 2023-02-17 02:01:39,136 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-17 02:01:39,136 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=3b68d31ac448617f8eedd3050b1aaae5, ASSIGN in 332 msec 2023-02-17 02:01:39,137 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-17 02:01:39,137 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676599299137"}]},"ts":"1676599299137"} 2023-02-17 02:01:39,138 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-17 02:01:39,140 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-17 02:01:39,141 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 377 msec 2023-02-17 02:01:39,165 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-17 02:01:39,167 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-17 02:01:39,167 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 02:01:39,170 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-17 02:01:39,177 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-17 02:01:39,180 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 10 msec 2023-02-17 02:01:39,182 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-17 02:01:39,188 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-17 02:01:39,191 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 9 msec 2023-02-17 02:01:39,196 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-17 02:01:39,198 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-17 02:01:39,198 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.508sec 2023-02-17 02:01:39,199 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-17 02:01:39,199 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-17 02:01:39,199 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-17 02:01:39,199 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44147,1676599297546-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-17 02:01:39,199 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44147,1676599297546-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-17 02:01:39,200 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-17 02:01:39,291 DEBUG [Listener at localhost/42831] zookeeper.ReadOnlyZKClient(139): Connect 0x40811ad4 to 127.0.0.1:49216 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 02:01:39,302 DEBUG [Listener at localhost/42831] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6308ec50, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 02:01:39,304 DEBUG [hconnection-0x2423cbaf-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 02:01:39,306 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44250, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 02:01:39,308 INFO [Listener at localhost/42831] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,44147,1676599297546 2023-02-17 02:01:39,308 DEBUG [Listener at localhost/42831] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-17 02:01:39,310 DEBUG [Listener at localhost/42831] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-17 02:01:39,311 INFO [RS-EventLoopGroup-12-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35004, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-17 02:01:39,312 INFO [Listener at localhost/42831] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-17 02:01:39,312 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceMultiRegion 2023-02-17 02:01:39,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-17 02:01:39,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 94 connection: 172.31.14.131:35004 deadline: 1676599359312, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion 2023-02-17 02:01:39,313 INFO [Listener at localhost/42831] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceMultiRegion' 2023-02-17 02:01:39,314 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-17 02:01:39,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-17 02:01:39,317 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-17 02:01:39,317 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceMultiRegion" procId is: 10 2023-02-17 02:01:39,318 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-17 02:01:39,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 02:01:39,325 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/033e5165635b9ba2e8fffe93154e637e 2023-02-17 02:01:39,325 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/7080b20bafef3fcca7e77fb1564444dc 2023-02-17 02:01:39,325 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/27286d7877e172b7626d8faac32266d5 2023-02-17 02:01:39,325 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/21311936f3c5e2464085c015fcb59dc0 2023-02-17 02:01:39,325 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/6b374f0b5a440ed43ee4cdab132cd165 2023-02-17 02:01:39,325 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/d34d6d8b8aee836a577ebac64f77206e 2023-02-17 02:01:39,325 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/c691d9a9a766414e01e1a5d1e977f7ef 2023-02-17 02:01:39,325 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/e59273498db883c4fe992b5078a4292b 2023-02-17 02:01:39,326 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/033e5165635b9ba2e8fffe93154e637e empty. 2023-02-17 02:01:39,326 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/7080b20bafef3fcca7e77fb1564444dc empty. 2023-02-17 02:01:39,326 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/d34d6d8b8aee836a577ebac64f77206e empty. 2023-02-17 02:01:39,327 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/7080b20bafef3fcca7e77fb1564444dc 2023-02-17 02:01:39,327 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/14f2c512e529cbb9d6867ebbf198fe39 2023-02-17 02:01:39,328 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/6b374f0b5a440ed43ee4cdab132cd165 empty. 2023-02-17 02:01:39,328 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/21311936f3c5e2464085c015fcb59dc0 empty. 2023-02-17 02:01:39,328 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/27286d7877e172b7626d8faac32266d5 empty. 2023-02-17 02:01:39,329 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/21311936f3c5e2464085c015fcb59dc0 2023-02-17 02:01:39,329 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/d34d6d8b8aee836a577ebac64f77206e 2023-02-17 02:01:39,329 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/c691d9a9a766414e01e1a5d1e977f7ef empty. 2023-02-17 02:01:39,329 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/e59273498db883c4fe992b5078a4292b empty. 2023-02-17 02:01:39,329 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/14f2c512e529cbb9d6867ebbf198fe39 empty. 2023-02-17 02:01:39,329 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/76c704a666ea47c826747b29fb61b262 2023-02-17 02:01:39,329 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/6b374f0b5a440ed43ee4cdab132cd165 2023-02-17 02:01:39,329 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/27286d7877e172b7626d8faac32266d5 2023-02-17 02:01:39,329 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/033e5165635b9ba2e8fffe93154e637e 2023-02-17 02:01:39,330 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/c691d9a9a766414e01e1a5d1e977f7ef 2023-02-17 02:01:39,330 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/14f2c512e529cbb9d6867ebbf198fe39 2023-02-17 02:01:39,330 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/e59273498db883c4fe992b5078a4292b 2023-02-17 02:01:39,334 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/76c704a666ea47c826747b29fb61b262 empty. 2023-02-17 02:01:39,335 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/76c704a666ea47c826747b29fb61b262 2023-02-17 02:01:39,335 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-17 02:01:39,352 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/.tabledesc/.tableinfo.0000000001 2023-02-17 02:01:39,353 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => d34d6d8b8aee836a577ebac64f77206e, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676599299314.d34d6d8b8aee836a577ebac64f77206e.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp 2023-02-17 02:01:39,353 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => e59273498db883c4fe992b5078a4292b, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676599299314.e59273498db883c4fe992b5078a4292b.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp 2023-02-17 02:01:39,353 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 033e5165635b9ba2e8fffe93154e637e, NAME => 'testWithMockedMapReduceMultiRegion,,1676599299314.033e5165635b9ba2e8fffe93154e637e.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp 2023-02-17 02:01:39,385 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676599299314.d34d6d8b8aee836a577ebac64f77206e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:39,385 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing d34d6d8b8aee836a577ebac64f77206e, disabling compactions & flushes 2023-02-17 02:01:39,385 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676599299314.d34d6d8b8aee836a577ebac64f77206e. 2023-02-17 02:01:39,386 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676599299314.d34d6d8b8aee836a577ebac64f77206e. 2023-02-17 02:01:39,386 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676599299314.d34d6d8b8aee836a577ebac64f77206e. after waiting 0 ms 2023-02-17 02:01:39,386 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676599299314.d34d6d8b8aee836a577ebac64f77206e. 2023-02-17 02:01:39,386 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676599299314.d34d6d8b8aee836a577ebac64f77206e. 2023-02-17 02:01:39,386 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for d34d6d8b8aee836a577ebac64f77206e: 2023-02-17 02:01:39,386 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => c691d9a9a766414e01e1a5d1e977f7ef, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676599299314.c691d9a9a766414e01e1a5d1e977f7ef.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp 2023-02-17 02:01:39,387 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676599299314.033e5165635b9ba2e8fffe93154e637e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:39,387 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 033e5165635b9ba2e8fffe93154e637e, disabling compactions & flushes 2023-02-17 02:01:39,387 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676599299314.033e5165635b9ba2e8fffe93154e637e. 2023-02-17 02:01:39,387 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676599299314.033e5165635b9ba2e8fffe93154e637e. 2023-02-17 02:01:39,387 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676599299314.033e5165635b9ba2e8fffe93154e637e. after waiting 0 ms 2023-02-17 02:01:39,387 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676599299314.033e5165635b9ba2e8fffe93154e637e. 2023-02-17 02:01:39,387 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676599299314.033e5165635b9ba2e8fffe93154e637e. 2023-02-17 02:01:39,387 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 033e5165635b9ba2e8fffe93154e637e: 2023-02-17 02:01:39,388 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 7080b20bafef3fcca7e77fb1564444dc, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676599299314.7080b20bafef3fcca7e77fb1564444dc.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp 2023-02-17 02:01:39,394 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676599299314.e59273498db883c4fe992b5078a4292b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:39,394 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing e59273498db883c4fe992b5078a4292b, disabling compactions & flushes 2023-02-17 02:01:39,394 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676599299314.e59273498db883c4fe992b5078a4292b. 2023-02-17 02:01:39,394 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676599299314.e59273498db883c4fe992b5078a4292b. 2023-02-17 02:01:39,394 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676599299314.e59273498db883c4fe992b5078a4292b. after waiting 0 ms 2023-02-17 02:01:39,394 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676599299314.e59273498db883c4fe992b5078a4292b. 2023-02-17 02:01:39,395 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676599299314.e59273498db883c4fe992b5078a4292b. 2023-02-17 02:01:39,395 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for e59273498db883c4fe992b5078a4292b: 2023-02-17 02:01:39,395 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 6b374f0b5a440ed43ee4cdab132cd165, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676599299314.6b374f0b5a440ed43ee4cdab132cd165.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp 2023-02-17 02:01:39,412 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676599299314.c691d9a9a766414e01e1a5d1e977f7ef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:39,412 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676599299314.7080b20bafef3fcca7e77fb1564444dc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:39,412 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing c691d9a9a766414e01e1a5d1e977f7ef, disabling compactions & flushes 2023-02-17 02:01:39,412 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 7080b20bafef3fcca7e77fb1564444dc, disabling compactions & flushes 2023-02-17 02:01:39,412 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676599299314.c691d9a9a766414e01e1a5d1e977f7ef. 2023-02-17 02:01:39,412 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676599299314.7080b20bafef3fcca7e77fb1564444dc. 2023-02-17 02:01:39,412 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676599299314.7080b20bafef3fcca7e77fb1564444dc. 2023-02-17 02:01:39,412 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676599299314.c691d9a9a766414e01e1a5d1e977f7ef. 2023-02-17 02:01:39,412 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676599299314.7080b20bafef3fcca7e77fb1564444dc. after waiting 0 ms 2023-02-17 02:01:39,413 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676599299314.7080b20bafef3fcca7e77fb1564444dc. 2023-02-17 02:01:39,413 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676599299314.c691d9a9a766414e01e1a5d1e977f7ef. after waiting 0 ms 2023-02-17 02:01:39,413 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676599299314.7080b20bafef3fcca7e77fb1564444dc. 2023-02-17 02:01:39,413 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676599299314.c691d9a9a766414e01e1a5d1e977f7ef. 2023-02-17 02:01:39,413 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 7080b20bafef3fcca7e77fb1564444dc: 2023-02-17 02:01:39,413 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676599299314.c691d9a9a766414e01e1a5d1e977f7ef. 2023-02-17 02:01:39,413 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for c691d9a9a766414e01e1a5d1e977f7ef: 2023-02-17 02:01:39,413 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 21311936f3c5e2464085c015fcb59dc0, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676599299314.21311936f3c5e2464085c015fcb59dc0.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp 2023-02-17 02:01:39,414 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 27286d7877e172b7626d8faac32266d5, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676599299314.27286d7877e172b7626d8faac32266d5.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp 2023-02-17 02:01:39,416 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676599299314.6b374f0b5a440ed43ee4cdab132cd165.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:39,416 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 6b374f0b5a440ed43ee4cdab132cd165, disabling compactions & flushes 2023-02-17 02:01:39,416 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676599299314.6b374f0b5a440ed43ee4cdab132cd165. 2023-02-17 02:01:39,416 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676599299314.6b374f0b5a440ed43ee4cdab132cd165. 2023-02-17 02:01:39,416 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676599299314.6b374f0b5a440ed43ee4cdab132cd165. after waiting 0 ms 2023-02-17 02:01:39,416 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676599299314.6b374f0b5a440ed43ee4cdab132cd165. 2023-02-17 02:01:39,416 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676599299314.6b374f0b5a440ed43ee4cdab132cd165. 2023-02-17 02:01:39,416 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 6b374f0b5a440ed43ee4cdab132cd165: 2023-02-17 02:01:39,417 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 14f2c512e529cbb9d6867ebbf198fe39, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676599299314.14f2c512e529cbb9d6867ebbf198fe39.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp 2023-02-17 02:01:39,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 02:01:39,424 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676599299314.27286d7877e172b7626d8faac32266d5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:39,424 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 27286d7877e172b7626d8faac32266d5, disabling compactions & flushes 2023-02-17 02:01:39,424 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676599299314.21311936f3c5e2464085c015fcb59dc0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:39,424 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676599299314.27286d7877e172b7626d8faac32266d5. 2023-02-17 02:01:39,424 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 21311936f3c5e2464085c015fcb59dc0, disabling compactions & flushes 2023-02-17 02:01:39,424 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676599299314.27286d7877e172b7626d8faac32266d5. 2023-02-17 02:01:39,424 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676599299314.21311936f3c5e2464085c015fcb59dc0. 2023-02-17 02:01:39,424 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676599299314.27286d7877e172b7626d8faac32266d5. after waiting 0 ms 2023-02-17 02:01:39,424 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676599299314.27286d7877e172b7626d8faac32266d5. 2023-02-17 02:01:39,424 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676599299314.21311936f3c5e2464085c015fcb59dc0. 2023-02-17 02:01:39,424 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676599299314.27286d7877e172b7626d8faac32266d5. 2023-02-17 02:01:39,424 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676599299314.21311936f3c5e2464085c015fcb59dc0. after waiting 0 ms 2023-02-17 02:01:39,424 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676599299314.21311936f3c5e2464085c015fcb59dc0. 2023-02-17 02:01:39,424 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 27286d7877e172b7626d8faac32266d5: 2023-02-17 02:01:39,424 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676599299314.21311936f3c5e2464085c015fcb59dc0. 2023-02-17 02:01:39,424 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 21311936f3c5e2464085c015fcb59dc0: 2023-02-17 02:01:39,425 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 76c704a666ea47c826747b29fb61b262, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676599299314.76c704a666ea47c826747b29fb61b262.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp 2023-02-17 02:01:39,428 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676599299314.14f2c512e529cbb9d6867ebbf198fe39.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:39,428 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 14f2c512e529cbb9d6867ebbf198fe39, disabling compactions & flushes 2023-02-17 02:01:39,428 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676599299314.14f2c512e529cbb9d6867ebbf198fe39. 2023-02-17 02:01:39,428 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676599299314.14f2c512e529cbb9d6867ebbf198fe39. 2023-02-17 02:01:39,428 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676599299314.14f2c512e529cbb9d6867ebbf198fe39. after waiting 0 ms 2023-02-17 02:01:39,428 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676599299314.14f2c512e529cbb9d6867ebbf198fe39. 2023-02-17 02:01:39,428 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676599299314.14f2c512e529cbb9d6867ebbf198fe39. 2023-02-17 02:01:39,428 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 14f2c512e529cbb9d6867ebbf198fe39: 2023-02-17 02:01:39,433 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676599299314.76c704a666ea47c826747b29fb61b262.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:39,433 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 76c704a666ea47c826747b29fb61b262, disabling compactions & flushes 2023-02-17 02:01:39,433 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676599299314.76c704a666ea47c826747b29fb61b262. 2023-02-17 02:01:39,433 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676599299314.76c704a666ea47c826747b29fb61b262. 2023-02-17 02:01:39,433 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676599299314.76c704a666ea47c826747b29fb61b262. after waiting 0 ms 2023-02-17 02:01:39,433 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676599299314.76c704a666ea47c826747b29fb61b262. 2023-02-17 02:01:39,433 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676599299314.76c704a666ea47c826747b29fb61b262. 2023-02-17 02:01:39,433 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 76c704a666ea47c826747b29fb61b262: 2023-02-17 02:01:39,435 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-17 02:01:39,436 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676599299314.d34d6d8b8aee836a577ebac64f77206e.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676599299436"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676599299436"}]},"ts":"1676599299436"} 2023-02-17 02:01:39,436 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1676599299314.033e5165635b9ba2e8fffe93154e637e.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676599299436"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676599299436"}]},"ts":"1676599299436"} 2023-02-17 02:01:39,436 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1676599299314.e59273498db883c4fe992b5078a4292b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676599299436"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676599299436"}]},"ts":"1676599299436"} 2023-02-17 02:01:39,436 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676599299314.7080b20bafef3fcca7e77fb1564444dc.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676599299436"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676599299436"}]},"ts":"1676599299436"} 2023-02-17 02:01:39,436 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676599299314.c691d9a9a766414e01e1a5d1e977f7ef.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676599299436"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676599299436"}]},"ts":"1676599299436"} 2023-02-17 02:01:39,436 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676599299314.6b374f0b5a440ed43ee4cdab132cd165.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676599299436"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676599299436"}]},"ts":"1676599299436"} 2023-02-17 02:01:39,437 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1676599299314.27286d7877e172b7626d8faac32266d5.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676599299436"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676599299436"}]},"ts":"1676599299436"} 2023-02-17 02:01:39,437 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676599299314.21311936f3c5e2464085c015fcb59dc0.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676599299436"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676599299436"}]},"ts":"1676599299436"} 2023-02-17 02:01:39,437 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1676599299314.14f2c512e529cbb9d6867ebbf198fe39.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676599299436"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676599299436"}]},"ts":"1676599299436"} 2023-02-17 02:01:39,437 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1676599299314.76c704a666ea47c826747b29fb61b262.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676599299436"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676599299436"}]},"ts":"1676599299436"} 2023-02-17 02:01:39,439 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-17 02:01:39,440 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-17 02:01:39,440 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676599299440"}]},"ts":"1676599299440"} 2023-02-17 02:01:39,441 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLING in hbase:meta 2023-02-17 02:01:39,446 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-17 02:01:39,452 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-17 02:01:39,452 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-17 02:01:39,452 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-17 02:01:39,453 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=033e5165635b9ba2e8fffe93154e637e, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e59273498db883c4fe992b5078a4292b, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d34d6d8b8aee836a577ebac64f77206e, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c691d9a9a766414e01e1a5d1e977f7ef, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7080b20bafef3fcca7e77fb1564444dc, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6b374f0b5a440ed43ee4cdab132cd165, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=21311936f3c5e2464085c015fcb59dc0, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=27286d7877e172b7626d8faac32266d5, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=14f2c512e529cbb9d6867ebbf198fe39, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=76c704a666ea47c826747b29fb61b262, ASSIGN}] 2023-02-17 02:01:39,455 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d34d6d8b8aee836a577ebac64f77206e, ASSIGN 2023-02-17 02:01:39,455 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e59273498db883c4fe992b5078a4292b, ASSIGN 2023-02-17 02:01:39,455 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=033e5165635b9ba2e8fffe93154e637e, ASSIGN 2023-02-17 02:01:39,455 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c691d9a9a766414e01e1a5d1e977f7ef, ASSIGN 2023-02-17 02:01:39,455 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d34d6d8b8aee836a577ebac64f77206e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33169,1676599297588; forceNewPlan=false, retain=false 2023-02-17 02:01:39,455 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=033e5165635b9ba2e8fffe93154e637e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40913,1676599297651; forceNewPlan=false, retain=false 2023-02-17 02:01:39,455 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e59273498db883c4fe992b5078a4292b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33169,1676599297588; forceNewPlan=false, retain=false 2023-02-17 02:01:39,455 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c691d9a9a766414e01e1a5d1e977f7ef, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33169,1676599297588; forceNewPlan=false, retain=false 2023-02-17 02:01:39,456 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=76c704a666ea47c826747b29fb61b262, ASSIGN 2023-02-17 02:01:39,456 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=14f2c512e529cbb9d6867ebbf198fe39, ASSIGN 2023-02-17 02:01:39,456 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=27286d7877e172b7626d8faac32266d5, ASSIGN 2023-02-17 02:01:39,456 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=21311936f3c5e2464085c015fcb59dc0, ASSIGN 2023-02-17 02:01:39,456 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=76c704a666ea47c826747b29fb61b262, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40913,1676599297651; forceNewPlan=false, retain=false 2023-02-17 02:01:39,456 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6b374f0b5a440ed43ee4cdab132cd165, ASSIGN 2023-02-17 02:01:39,457 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=14f2c512e529cbb9d6867ebbf198fe39, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33169,1676599297588; forceNewPlan=false, retain=false 2023-02-17 02:01:39,457 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=27286d7877e172b7626d8faac32266d5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33169,1676599297588; forceNewPlan=false, retain=false 2023-02-17 02:01:39,457 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=21311936f3c5e2464085c015fcb59dc0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40913,1676599297651; forceNewPlan=false, retain=false 2023-02-17 02:01:39,457 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7080b20bafef3fcca7e77fb1564444dc, ASSIGN 2023-02-17 02:01:39,457 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6b374f0b5a440ed43ee4cdab132cd165, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40913,1676599297651; forceNewPlan=false, retain=false 2023-02-17 02:01:39,457 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7080b20bafef3fcca7e77fb1564444dc, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40913,1676599297651; forceNewPlan=false, retain=false 2023-02-17 02:01:39,606 INFO [jenkins-hbase4:44147] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-17 02:01:39,614 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=6b374f0b5a440ed43ee4cdab132cd165, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40913,1676599297651 2023-02-17 02:01:39,614 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=7080b20bafef3fcca7e77fb1564444dc, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40913,1676599297651 2023-02-17 02:01:39,614 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=033e5165635b9ba2e8fffe93154e637e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40913,1676599297651 2023-02-17 02:01:39,614 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676599299314.7080b20bafef3fcca7e77fb1564444dc.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676599299614"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676599299614"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676599299614"}]},"ts":"1676599299614"} 2023-02-17 02:01:39,614 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=21311936f3c5e2464085c015fcb59dc0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40913,1676599297651 2023-02-17 02:01:39,614 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1676599299314.033e5165635b9ba2e8fffe93154e637e.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676599299614"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676599299614"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676599299614"}]},"ts":"1676599299614"} 2023-02-17 02:01:39,614 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676599299314.21311936f3c5e2464085c015fcb59dc0.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676599299614"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676599299614"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676599299614"}]},"ts":"1676599299614"} 2023-02-17 02:01:39,614 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676599299314.6b374f0b5a440ed43ee4cdab132cd165.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676599299614"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676599299614"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676599299614"}]},"ts":"1676599299614"} 2023-02-17 02:01:39,614 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=76c704a666ea47c826747b29fb61b262, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40913,1676599297651 2023-02-17 02:01:39,615 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1676599299314.76c704a666ea47c826747b29fb61b262.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676599299614"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676599299614"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676599299614"}]},"ts":"1676599299614"} 2023-02-17 02:01:39,616 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=15, state=RUNNABLE; OpenRegionProcedure 7080b20bafef3fcca7e77fb1564444dc, server=jenkins-hbase4.apache.org,40913,1676599297651}] 2023-02-17 02:01:39,617 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=11, state=RUNNABLE; OpenRegionProcedure 033e5165635b9ba2e8fffe93154e637e, server=jenkins-hbase4.apache.org,40913,1676599297651}] 2023-02-17 02:01:39,617 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=17, state=RUNNABLE; OpenRegionProcedure 21311936f3c5e2464085c015fcb59dc0, server=jenkins-hbase4.apache.org,40913,1676599297651}] 2023-02-17 02:01:39,618 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=16, state=RUNNABLE; OpenRegionProcedure 6b374f0b5a440ed43ee4cdab132cd165, server=jenkins-hbase4.apache.org,40913,1676599297651}] 2023-02-17 02:01:39,619 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=20, state=RUNNABLE; OpenRegionProcedure 76c704a666ea47c826747b29fb61b262, server=jenkins-hbase4.apache.org,40913,1676599297651}] 2023-02-17 02:01:39,620 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=27286d7877e172b7626d8faac32266d5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33169,1676599297588 2023-02-17 02:01:39,620 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1676599299314.27286d7877e172b7626d8faac32266d5.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676599299620"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676599299620"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676599299620"}]},"ts":"1676599299620"} 2023-02-17 02:01:39,621 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=c691d9a9a766414e01e1a5d1e977f7ef, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33169,1676599297588 2023-02-17 02:01:39,621 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676599299314.c691d9a9a766414e01e1a5d1e977f7ef.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676599299621"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676599299621"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676599299621"}]},"ts":"1676599299621"} 2023-02-17 02:01:39,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 02:01:39,622 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=14f2c512e529cbb9d6867ebbf198fe39, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33169,1676599297588 2023-02-17 02:01:39,622 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1676599299314.14f2c512e529cbb9d6867ebbf198fe39.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676599299622"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676599299622"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676599299622"}]},"ts":"1676599299622"} 2023-02-17 02:01:39,622 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=18, state=RUNNABLE; OpenRegionProcedure 27286d7877e172b7626d8faac32266d5, server=jenkins-hbase4.apache.org,33169,1676599297588}] 2023-02-17 02:01:39,622 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=e59273498db883c4fe992b5078a4292b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33169,1676599297588 2023-02-17 02:01:39,622 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1676599299314.e59273498db883c4fe992b5078a4292b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676599299622"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676599299622"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676599299622"}]},"ts":"1676599299622"} 2023-02-17 02:01:39,623 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=d34d6d8b8aee836a577ebac64f77206e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33169,1676599297588 2023-02-17 02:01:39,623 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676599299314.d34d6d8b8aee836a577ebac64f77206e.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676599299623"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676599299623"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676599299623"}]},"ts":"1676599299623"} 2023-02-17 02:01:39,623 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=14, state=RUNNABLE; OpenRegionProcedure c691d9a9a766414e01e1a5d1e977f7ef, server=jenkins-hbase4.apache.org,33169,1676599297588}] 2023-02-17 02:01:39,624 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=19, state=RUNNABLE; OpenRegionProcedure 14f2c512e529cbb9d6867ebbf198fe39, server=jenkins-hbase4.apache.org,33169,1676599297588}] 2023-02-17 02:01:39,626 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=12, state=RUNNABLE; OpenRegionProcedure e59273498db883c4fe992b5078a4292b, server=jenkins-hbase4.apache.org,33169,1676599297588}] 2023-02-17 02:01:39,626 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=13, state=RUNNABLE; OpenRegionProcedure d34d6d8b8aee836a577ebac64f77206e, server=jenkins-hbase4.apache.org,33169,1676599297588}] 2023-02-17 02:01:39,774 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,m\xED\xED,1676599299314.6b374f0b5a440ed43ee4cdab132cd165. 2023-02-17 02:01:39,774 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 6b374f0b5a440ed43ee4cdab132cd165, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676599299314.6b374f0b5a440ed43ee4cdab132cd165.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-17 02:01:39,774 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,33169,1676599297588 2023-02-17 02:01:39,774 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-17 02:01:39,774 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 6b374f0b5a440ed43ee4cdab132cd165 2023-02-17 02:01:39,775 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676599299314.6b374f0b5a440ed43ee4cdab132cd165.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:39,775 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 6b374f0b5a440ed43ee4cdab132cd165 2023-02-17 02:01:39,775 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 6b374f0b5a440ed43ee4cdab132cd165 2023-02-17 02:01:39,777 INFO [StoreOpener-6b374f0b5a440ed43ee4cdab132cd165-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 6b374f0b5a440ed43ee4cdab132cd165 2023-02-17 02:01:39,779 DEBUG [StoreOpener-6b374f0b5a440ed43ee4cdab132cd165-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/6b374f0b5a440ed43ee4cdab132cd165/f1 2023-02-17 02:01:39,779 DEBUG [StoreOpener-6b374f0b5a440ed43ee4cdab132cd165-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/6b374f0b5a440ed43ee4cdab132cd165/f1 2023-02-17 02:01:39,779 INFO [StoreOpener-6b374f0b5a440ed43ee4cdab132cd165-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6b374f0b5a440ed43ee4cdab132cd165 columnFamilyName f1 2023-02-17 02:01:39,780 INFO [StoreOpener-6b374f0b5a440ed43ee4cdab132cd165-1] regionserver.HStore(310): Store=6b374f0b5a440ed43ee4cdab132cd165/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:39,788 INFO [StoreOpener-6b374f0b5a440ed43ee4cdab132cd165-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 6b374f0b5a440ed43ee4cdab132cd165 2023-02-17 02:01:39,789 INFO [RS-EventLoopGroup-13-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57570, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-17 02:01:39,790 DEBUG [StoreOpener-6b374f0b5a440ed43ee4cdab132cd165-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/6b374f0b5a440ed43ee4cdab132cd165/f2 2023-02-17 02:01:39,790 DEBUG [StoreOpener-6b374f0b5a440ed43ee4cdab132cd165-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/6b374f0b5a440ed43ee4cdab132cd165/f2 2023-02-17 02:01:39,790 INFO [StoreOpener-6b374f0b5a440ed43ee4cdab132cd165-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6b374f0b5a440ed43ee4cdab132cd165 columnFamilyName f2 2023-02-17 02:01:39,791 INFO [StoreOpener-6b374f0b5a440ed43ee4cdab132cd165-1] regionserver.HStore(310): Store=6b374f0b5a440ed43ee4cdab132cd165/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:39,792 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/6b374f0b5a440ed43ee4cdab132cd165 2023-02-17 02:01:39,792 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676599299314.c691d9a9a766414e01e1a5d1e977f7ef. 2023-02-17 02:01:39,792 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c691d9a9a766414e01e1a5d1e977f7ef, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676599299314.c691d9a9a766414e01e1a5d1e977f7ef.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-17 02:01:39,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion c691d9a9a766414e01e1a5d1e977f7ef 2023-02-17 02:01:39,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676599299314.c691d9a9a766414e01e1a5d1e977f7ef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:39,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for c691d9a9a766414e01e1a5d1e977f7ef 2023-02-17 02:01:39,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for c691d9a9a766414e01e1a5d1e977f7ef 2023-02-17 02:01:39,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/6b374f0b5a440ed43ee4cdab132cd165 2023-02-17 02:01:39,795 INFO [StoreOpener-c691d9a9a766414e01e1a5d1e977f7ef-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c691d9a9a766414e01e1a5d1e977f7ef 2023-02-17 02:01:39,796 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 02:01:39,796 DEBUG [StoreOpener-c691d9a9a766414e01e1a5d1e977f7ef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/c691d9a9a766414e01e1a5d1e977f7ef/f1 2023-02-17 02:01:39,796 DEBUG [StoreOpener-c691d9a9a766414e01e1a5d1e977f7ef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/c691d9a9a766414e01e1a5d1e977f7ef/f1 2023-02-17 02:01:39,796 INFO [StoreOpener-c691d9a9a766414e01e1a5d1e977f7ef-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c691d9a9a766414e01e1a5d1e977f7ef columnFamilyName f1 2023-02-17 02:01:39,797 INFO [StoreOpener-c691d9a9a766414e01e1a5d1e977f7ef-1] regionserver.HStore(310): Store=c691d9a9a766414e01e1a5d1e977f7ef/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:39,797 INFO [StoreOpener-c691d9a9a766414e01e1a5d1e977f7ef-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c691d9a9a766414e01e1a5d1e977f7ef 2023-02-17 02:01:39,797 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 6b374f0b5a440ed43ee4cdab132cd165 2023-02-17 02:01:39,798 DEBUG [StoreOpener-c691d9a9a766414e01e1a5d1e977f7ef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/c691d9a9a766414e01e1a5d1e977f7ef/f2 2023-02-17 02:01:39,798 DEBUG [StoreOpener-c691d9a9a766414e01e1a5d1e977f7ef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/c691d9a9a766414e01e1a5d1e977f7ef/f2 2023-02-17 02:01:39,798 INFO [StoreOpener-c691d9a9a766414e01e1a5d1e977f7ef-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c691d9a9a766414e01e1a5d1e977f7ef columnFamilyName f2 2023-02-17 02:01:39,799 INFO [StoreOpener-c691d9a9a766414e01e1a5d1e977f7ef-1] regionserver.HStore(310): Store=c691d9a9a766414e01e1a5d1e977f7ef/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:39,800 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/6b374f0b5a440ed43ee4cdab132cd165/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 02:01:39,800 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/c691d9a9a766414e01e1a5d1e977f7ef 2023-02-17 02:01:39,801 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 6b374f0b5a440ed43ee4cdab132cd165; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67656712, jitterRate=0.00816357135772705}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 02:01:39,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/c691d9a9a766414e01e1a5d1e977f7ef 2023-02-17 02:01:39,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 6b374f0b5a440ed43ee4cdab132cd165: 2023-02-17 02:01:39,802 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,m\xED\xED,1676599299314.6b374f0b5a440ed43ee4cdab132cd165., pid=24, masterSystemTime=1676599299769 2023-02-17 02:01:39,803 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 02:01:39,803 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,m\xED\xED,1676599299314.6b374f0b5a440ed43ee4cdab132cd165. 2023-02-17 02:01:39,804 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,m\xED\xED,1676599299314.6b374f0b5a440ed43ee4cdab132cd165. 2023-02-17 02:01:39,804 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,,1676599299314.033e5165635b9ba2e8fffe93154e637e. 2023-02-17 02:01:39,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 033e5165635b9ba2e8fffe93154e637e, NAME => 'testWithMockedMapReduceMultiRegion,,1676599299314.033e5165635b9ba2e8fffe93154e637e.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-17 02:01:39,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 033e5165635b9ba2e8fffe93154e637e 2023-02-17 02:01:39,804 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=6b374f0b5a440ed43ee4cdab132cd165, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40913,1676599297651 2023-02-17 02:01:39,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676599299314.033e5165635b9ba2e8fffe93154e637e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:39,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 033e5165635b9ba2e8fffe93154e637e 2023-02-17 02:01:39,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 033e5165635b9ba2e8fffe93154e637e 2023-02-17 02:01:39,804 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676599299314.6b374f0b5a440ed43ee4cdab132cd165.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676599299804"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676599299804"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676599299804"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676599299804"}]},"ts":"1676599299804"} 2023-02-17 02:01:39,806 INFO [StoreOpener-033e5165635b9ba2e8fffe93154e637e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 033e5165635b9ba2e8fffe93154e637e 2023-02-17 02:01:39,806 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for c691d9a9a766414e01e1a5d1e977f7ef 2023-02-17 02:01:39,807 DEBUG [StoreOpener-033e5165635b9ba2e8fffe93154e637e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/033e5165635b9ba2e8fffe93154e637e/f1 2023-02-17 02:01:39,807 DEBUG [StoreOpener-033e5165635b9ba2e8fffe93154e637e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/033e5165635b9ba2e8fffe93154e637e/f1 2023-02-17 02:01:39,807 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=16 2023-02-17 02:01:39,808 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=16, state=SUCCESS; OpenRegionProcedure 6b374f0b5a440ed43ee4cdab132cd165, server=jenkins-hbase4.apache.org,40913,1676599297651 in 188 msec 2023-02-17 02:01:39,808 INFO [StoreOpener-033e5165635b9ba2e8fffe93154e637e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 033e5165635b9ba2e8fffe93154e637e columnFamilyName f1 2023-02-17 02:01:39,808 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/c691d9a9a766414e01e1a5d1e977f7ef/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 02:01:39,808 INFO [StoreOpener-033e5165635b9ba2e8fffe93154e637e-1] regionserver.HStore(310): Store=033e5165635b9ba2e8fffe93154e637e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:39,809 INFO [StoreOpener-033e5165635b9ba2e8fffe93154e637e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 033e5165635b9ba2e8fffe93154e637e 2023-02-17 02:01:39,809 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6b374f0b5a440ed43ee4cdab132cd165, ASSIGN in 354 msec 2023-02-17 02:01:39,809 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened c691d9a9a766414e01e1a5d1e977f7ef; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72739844, jitterRate=0.08390814065933228}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 02:01:39,809 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for c691d9a9a766414e01e1a5d1e977f7ef: 2023-02-17 02:01:39,810 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676599299314.c691d9a9a766414e01e1a5d1e977f7ef., pid=27, masterSystemTime=1676599299774 2023-02-17 02:01:39,811 DEBUG [StoreOpener-033e5165635b9ba2e8fffe93154e637e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/033e5165635b9ba2e8fffe93154e637e/f2 2023-02-17 02:01:39,811 DEBUG [StoreOpener-033e5165635b9ba2e8fffe93154e637e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/033e5165635b9ba2e8fffe93154e637e/f2 2023-02-17 02:01:39,812 INFO [StoreOpener-033e5165635b9ba2e8fffe93154e637e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 033e5165635b9ba2e8fffe93154e637e columnFamilyName f2 2023-02-17 02:01:39,812 INFO [StoreOpener-033e5165635b9ba2e8fffe93154e637e-1] regionserver.HStore(310): Store=033e5165635b9ba2e8fffe93154e637e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:39,813 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676599299314.c691d9a9a766414e01e1a5d1e977f7ef. 2023-02-17 02:01:39,813 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676599299314.c691d9a9a766414e01e1a5d1e977f7ef. 2023-02-17 02:01:39,813 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,wWV,1676599299314.14f2c512e529cbb9d6867ebbf198fe39. 2023-02-17 02:01:39,814 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=c691d9a9a766414e01e1a5d1e977f7ef, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33169,1676599297588 2023-02-17 02:01:39,814 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/033e5165635b9ba2e8fffe93154e637e 2023-02-17 02:01:39,814 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 14f2c512e529cbb9d6867ebbf198fe39, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676599299314.14f2c512e529cbb9d6867ebbf198fe39.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-17 02:01:39,814 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676599299314.c691d9a9a766414e01e1a5d1e977f7ef.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676599299813"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676599299813"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676599299813"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676599299813"}]},"ts":"1676599299813"} 2023-02-17 02:01:39,814 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 14f2c512e529cbb9d6867ebbf198fe39 2023-02-17 02:01:39,814 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/033e5165635b9ba2e8fffe93154e637e 2023-02-17 02:01:39,814 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676599299314.14f2c512e529cbb9d6867ebbf198fe39.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:39,814 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 14f2c512e529cbb9d6867ebbf198fe39 2023-02-17 02:01:39,814 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 14f2c512e529cbb9d6867ebbf198fe39 2023-02-17 02:01:39,815 INFO [StoreOpener-14f2c512e529cbb9d6867ebbf198fe39-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 14f2c512e529cbb9d6867ebbf198fe39 2023-02-17 02:01:39,817 DEBUG [StoreOpener-14f2c512e529cbb9d6867ebbf198fe39-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/14f2c512e529cbb9d6867ebbf198fe39/f1 2023-02-17 02:01:39,817 DEBUG [StoreOpener-14f2c512e529cbb9d6867ebbf198fe39-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/14f2c512e529cbb9d6867ebbf198fe39/f1 2023-02-17 02:01:39,817 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 02:01:39,817 INFO [StoreOpener-14f2c512e529cbb9d6867ebbf198fe39-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 14f2c512e529cbb9d6867ebbf198fe39 columnFamilyName f1 2023-02-17 02:01:39,818 INFO [StoreOpener-14f2c512e529cbb9d6867ebbf198fe39-1] regionserver.HStore(310): Store=14f2c512e529cbb9d6867ebbf198fe39/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:39,818 INFO [StoreOpener-14f2c512e529cbb9d6867ebbf198fe39-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 14f2c512e529cbb9d6867ebbf198fe39 2023-02-17 02:01:39,818 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=14 2023-02-17 02:01:39,818 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=14, state=SUCCESS; OpenRegionProcedure c691d9a9a766414e01e1a5d1e977f7ef, server=jenkins-hbase4.apache.org,33169,1676599297588 in 193 msec 2023-02-17 02:01:39,819 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 033e5165635b9ba2e8fffe93154e637e 2023-02-17 02:01:39,819 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c691d9a9a766414e01e1a5d1e977f7ef, ASSIGN in 365 msec 2023-02-17 02:01:39,819 DEBUG [StoreOpener-14f2c512e529cbb9d6867ebbf198fe39-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/14f2c512e529cbb9d6867ebbf198fe39/f2 2023-02-17 02:01:39,820 DEBUG [StoreOpener-14f2c512e529cbb9d6867ebbf198fe39-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/14f2c512e529cbb9d6867ebbf198fe39/f2 2023-02-17 02:01:39,820 INFO [StoreOpener-14f2c512e529cbb9d6867ebbf198fe39-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 14f2c512e529cbb9d6867ebbf198fe39 columnFamilyName f2 2023-02-17 02:01:39,820 INFO [StoreOpener-14f2c512e529cbb9d6867ebbf198fe39-1] regionserver.HStore(310): Store=14f2c512e529cbb9d6867ebbf198fe39/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:39,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/14f2c512e529cbb9d6867ebbf198fe39 2023-02-17 02:01:39,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/033e5165635b9ba2e8fffe93154e637e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 02:01:39,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/14f2c512e529cbb9d6867ebbf198fe39 2023-02-17 02:01:39,822 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 033e5165635b9ba2e8fffe93154e637e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63407362, jitterRate=-0.05515667796134949}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 02:01:39,822 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 033e5165635b9ba2e8fffe93154e637e: 2023-02-17 02:01:39,822 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,,1676599299314.033e5165635b9ba2e8fffe93154e637e., pid=22, masterSystemTime=1676599299769 2023-02-17 02:01:39,823 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 02:01:39,824 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,,1676599299314.033e5165635b9ba2e8fffe93154e637e. 2023-02-17 02:01:39,824 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,,1676599299314.033e5165635b9ba2e8fffe93154e637e. 2023-02-17 02:01:39,824 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,q\x11\x10,1676599299314.21311936f3c5e2464085c015fcb59dc0. 2023-02-17 02:01:39,824 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 21311936f3c5e2464085c015fcb59dc0, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676599299314.21311936f3c5e2464085c015fcb59dc0.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-17 02:01:39,824 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=033e5165635b9ba2e8fffe93154e637e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40913,1676599297651 2023-02-17 02:01:39,824 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 14f2c512e529cbb9d6867ebbf198fe39 2023-02-17 02:01:39,824 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,,1676599299314.033e5165635b9ba2e8fffe93154e637e.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676599299824"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676599299824"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676599299824"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676599299824"}]},"ts":"1676599299824"} 2023-02-17 02:01:39,824 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 21311936f3c5e2464085c015fcb59dc0 2023-02-17 02:01:39,824 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676599299314.21311936f3c5e2464085c015fcb59dc0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:39,824 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 21311936f3c5e2464085c015fcb59dc0 2023-02-17 02:01:39,825 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 21311936f3c5e2464085c015fcb59dc0 2023-02-17 02:01:39,827 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=11 2023-02-17 02:01:39,827 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=11, state=SUCCESS; OpenRegionProcedure 033e5165635b9ba2e8fffe93154e637e, server=jenkins-hbase4.apache.org,40913,1676599297651 in 209 msec 2023-02-17 02:01:39,831 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=033e5165635b9ba2e8fffe93154e637e, ASSIGN in 374 msec 2023-02-17 02:01:39,836 INFO [StoreOpener-21311936f3c5e2464085c015fcb59dc0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 21311936f3c5e2464085c015fcb59dc0 2023-02-17 02:01:39,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/14f2c512e529cbb9d6867ebbf198fe39/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 02:01:39,839 DEBUG [StoreOpener-21311936f3c5e2464085c015fcb59dc0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/21311936f3c5e2464085c015fcb59dc0/f1 2023-02-17 02:01:39,839 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 14f2c512e529cbb9d6867ebbf198fe39; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64202043, jitterRate=-0.04331500828266144}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 02:01:39,839 DEBUG [StoreOpener-21311936f3c5e2464085c015fcb59dc0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/21311936f3c5e2464085c015fcb59dc0/f1 2023-02-17 02:01:39,839 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 14f2c512e529cbb9d6867ebbf198fe39: 2023-02-17 02:01:39,839 INFO [StoreOpener-21311936f3c5e2464085c015fcb59dc0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 21311936f3c5e2464085c015fcb59dc0 columnFamilyName f1 2023-02-17 02:01:39,840 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,wWV,1676599299314.14f2c512e529cbb9d6867ebbf198fe39., pid=28, masterSystemTime=1676599299774 2023-02-17 02:01:39,840 INFO [StoreOpener-21311936f3c5e2464085c015fcb59dc0-1] regionserver.HStore(310): Store=21311936f3c5e2464085c015fcb59dc0/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:39,840 INFO [StoreOpener-21311936f3c5e2464085c015fcb59dc0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 21311936f3c5e2464085c015fcb59dc0 2023-02-17 02:01:39,842 DEBUG [StoreOpener-21311936f3c5e2464085c015fcb59dc0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/21311936f3c5e2464085c015fcb59dc0/f2 2023-02-17 02:01:39,842 DEBUG [StoreOpener-21311936f3c5e2464085c015fcb59dc0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/21311936f3c5e2464085c015fcb59dc0/f2 2023-02-17 02:01:39,842 INFO [StoreOpener-21311936f3c5e2464085c015fcb59dc0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 21311936f3c5e2464085c015fcb59dc0 columnFamilyName f2 2023-02-17 02:01:39,842 INFO [StoreOpener-21311936f3c5e2464085c015fcb59dc0-1] regionserver.HStore(310): Store=21311936f3c5e2464085c015fcb59dc0/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:39,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/21311936f3c5e2464085c015fcb59dc0 2023-02-17 02:01:39,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/21311936f3c5e2464085c015fcb59dc0 2023-02-17 02:01:39,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,wWV,1676599299314.14f2c512e529cbb9d6867ebbf198fe39. 2023-02-17 02:01:39,844 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,wWV,1676599299314.14f2c512e529cbb9d6867ebbf198fe39. 2023-02-17 02:01:39,845 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,t43,1676599299314.27286d7877e172b7626d8faac32266d5. 2023-02-17 02:01:39,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 27286d7877e172b7626d8faac32266d5, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676599299314.27286d7877e172b7626d8faac32266d5.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-17 02:01:39,845 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=14f2c512e529cbb9d6867ebbf198fe39, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33169,1676599297588 2023-02-17 02:01:39,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 02:01:39,845 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,wWV,1676599299314.14f2c512e529cbb9d6867ebbf198fe39.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676599299845"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676599299845"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676599299845"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676599299845"}]},"ts":"1676599299845"} 2023-02-17 02:01:39,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 27286d7877e172b7626d8faac32266d5 2023-02-17 02:01:39,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676599299314.27286d7877e172b7626d8faac32266d5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:39,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 27286d7877e172b7626d8faac32266d5 2023-02-17 02:01:39,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 27286d7877e172b7626d8faac32266d5 2023-02-17 02:01:39,846 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 21311936f3c5e2464085c015fcb59dc0 2023-02-17 02:01:39,846 INFO [StoreOpener-27286d7877e172b7626d8faac32266d5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 27286d7877e172b7626d8faac32266d5 2023-02-17 02:01:39,848 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=19 2023-02-17 02:01:39,848 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=19, state=SUCCESS; OpenRegionProcedure 14f2c512e529cbb9d6867ebbf198fe39, server=jenkins-hbase4.apache.org,33169,1676599297588 in 223 msec 2023-02-17 02:01:39,848 DEBUG [StoreOpener-27286d7877e172b7626d8faac32266d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/27286d7877e172b7626d8faac32266d5/f1 2023-02-17 02:01:39,848 DEBUG [StoreOpener-27286d7877e172b7626d8faac32266d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/27286d7877e172b7626d8faac32266d5/f1 2023-02-17 02:01:39,849 INFO [StoreOpener-27286d7877e172b7626d8faac32266d5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 27286d7877e172b7626d8faac32266d5 columnFamilyName f1 2023-02-17 02:01:39,849 INFO [StoreOpener-27286d7877e172b7626d8faac32266d5-1] regionserver.HStore(310): Store=27286d7877e172b7626d8faac32266d5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:39,849 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=14f2c512e529cbb9d6867ebbf198fe39, ASSIGN in 395 msec 2023-02-17 02:01:39,849 INFO [StoreOpener-27286d7877e172b7626d8faac32266d5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 27286d7877e172b7626d8faac32266d5 2023-02-17 02:01:39,850 DEBUG [StoreOpener-27286d7877e172b7626d8faac32266d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/27286d7877e172b7626d8faac32266d5/f2 2023-02-17 02:01:39,850 DEBUG [StoreOpener-27286d7877e172b7626d8faac32266d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/27286d7877e172b7626d8faac32266d5/f2 2023-02-17 02:01:39,850 INFO [StoreOpener-27286d7877e172b7626d8faac32266d5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 27286d7877e172b7626d8faac32266d5 columnFamilyName f2 2023-02-17 02:01:39,851 INFO [StoreOpener-27286d7877e172b7626d8faac32266d5-1] regionserver.HStore(310): Store=27286d7877e172b7626d8faac32266d5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:39,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/21311936f3c5e2464085c015fcb59dc0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 02:01:39,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/27286d7877e172b7626d8faac32266d5 2023-02-17 02:01:39,853 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 21311936f3c5e2464085c015fcb59dc0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72654708, jitterRate=0.08263951539993286}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 02:01:39,853 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/27286d7877e172b7626d8faac32266d5 2023-02-17 02:01:39,853 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 21311936f3c5e2464085c015fcb59dc0: 2023-02-17 02:01:39,853 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,q\x11\x10,1676599299314.21311936f3c5e2464085c015fcb59dc0., pid=23, masterSystemTime=1676599299769 2023-02-17 02:01:39,854 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 02:01:39,855 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,q\x11\x10,1676599299314.21311936f3c5e2464085c015fcb59dc0. 2023-02-17 02:01:39,855 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,q\x11\x10,1676599299314.21311936f3c5e2464085c015fcb59dc0. 2023-02-17 02:01:39,855 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676599299314.7080b20bafef3fcca7e77fb1564444dc. 2023-02-17 02:01:39,855 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 7080b20bafef3fcca7e77fb1564444dc, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676599299314.7080b20bafef3fcca7e77fb1564444dc.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-17 02:01:39,855 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=21311936f3c5e2464085c015fcb59dc0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40913,1676599297651 2023-02-17 02:01:39,855 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676599299314.21311936f3c5e2464085c015fcb59dc0.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676599299855"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676599299855"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676599299855"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676599299855"}]},"ts":"1676599299855"} 2023-02-17 02:01:39,855 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 7080b20bafef3fcca7e77fb1564444dc 2023-02-17 02:01:39,855 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676599299314.7080b20bafef3fcca7e77fb1564444dc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:39,855 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 27286d7877e172b7626d8faac32266d5 2023-02-17 02:01:39,856 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 7080b20bafef3fcca7e77fb1564444dc 2023-02-17 02:01:39,856 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 7080b20bafef3fcca7e77fb1564444dc 2023-02-17 02:01:39,857 INFO [StoreOpener-7080b20bafef3fcca7e77fb1564444dc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7080b20bafef3fcca7e77fb1564444dc 2023-02-17 02:01:39,858 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/27286d7877e172b7626d8faac32266d5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 02:01:39,858 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=17 2023-02-17 02:01:39,858 DEBUG [StoreOpener-7080b20bafef3fcca7e77fb1564444dc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/7080b20bafef3fcca7e77fb1564444dc/f1 2023-02-17 02:01:39,858 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 27286d7877e172b7626d8faac32266d5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59269742, jitterRate=-0.11681202054023743}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 02:01:39,858 DEBUG [StoreOpener-7080b20bafef3fcca7e77fb1564444dc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/7080b20bafef3fcca7e77fb1564444dc/f1 2023-02-17 02:01:39,858 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 27286d7877e172b7626d8faac32266d5: 2023-02-17 02:01:39,858 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=17, state=SUCCESS; OpenRegionProcedure 21311936f3c5e2464085c015fcb59dc0, server=jenkins-hbase4.apache.org,40913,1676599297651 in 240 msec 2023-02-17 02:01:39,859 INFO [StoreOpener-7080b20bafef3fcca7e77fb1564444dc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7080b20bafef3fcca7e77fb1564444dc columnFamilyName f1 2023-02-17 02:01:39,859 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,t43,1676599299314.27286d7877e172b7626d8faac32266d5., pid=26, masterSystemTime=1676599299774 2023-02-17 02:01:39,859 INFO [StoreOpener-7080b20bafef3fcca7e77fb1564444dc-1] regionserver.HStore(310): Store=7080b20bafef3fcca7e77fb1564444dc/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:39,859 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=21311936f3c5e2464085c015fcb59dc0, ASSIGN in 405 msec 2023-02-17 02:01:39,859 INFO [StoreOpener-7080b20bafef3fcca7e77fb1564444dc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7080b20bafef3fcca7e77fb1564444dc 2023-02-17 02:01:39,860 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,t43,1676599299314.27286d7877e172b7626d8faac32266d5. 2023-02-17 02:01:39,860 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,t43,1676599299314.27286d7877e172b7626d8faac32266d5. 2023-02-17 02:01:39,861 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,d\x84\x84,1676599299314.d34d6d8b8aee836a577ebac64f77206e. 2023-02-17 02:01:39,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d34d6d8b8aee836a577ebac64f77206e, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676599299314.d34d6d8b8aee836a577ebac64f77206e.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-17 02:01:39,861 DEBUG [StoreOpener-7080b20bafef3fcca7e77fb1564444dc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/7080b20bafef3fcca7e77fb1564444dc/f2 2023-02-17 02:01:39,861 DEBUG [StoreOpener-7080b20bafef3fcca7e77fb1564444dc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/7080b20bafef3fcca7e77fb1564444dc/f2 2023-02-17 02:01:39,861 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=27286d7877e172b7626d8faac32266d5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33169,1676599297588 2023-02-17 02:01:39,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion d34d6d8b8aee836a577ebac64f77206e 2023-02-17 02:01:39,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676599299314.d34d6d8b8aee836a577ebac64f77206e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:39,861 INFO [StoreOpener-7080b20bafef3fcca7e77fb1564444dc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7080b20bafef3fcca7e77fb1564444dc columnFamilyName f2 2023-02-17 02:01:39,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for d34d6d8b8aee836a577ebac64f77206e 2023-02-17 02:01:39,861 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,t43,1676599299314.27286d7877e172b7626d8faac32266d5.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676599299861"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676599299861"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676599299861"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676599299861"}]},"ts":"1676599299861"} 2023-02-17 02:01:39,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for d34d6d8b8aee836a577ebac64f77206e 2023-02-17 02:01:39,861 INFO [StoreOpener-7080b20bafef3fcca7e77fb1564444dc-1] regionserver.HStore(310): Store=7080b20bafef3fcca7e77fb1564444dc/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:39,862 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/7080b20bafef3fcca7e77fb1564444dc 2023-02-17 02:01:39,862 INFO [StoreOpener-d34d6d8b8aee836a577ebac64f77206e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d34d6d8b8aee836a577ebac64f77206e 2023-02-17 02:01:39,862 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/7080b20bafef3fcca7e77fb1564444dc 2023-02-17 02:01:39,863 DEBUG [StoreOpener-d34d6d8b8aee836a577ebac64f77206e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/d34d6d8b8aee836a577ebac64f77206e/f1 2023-02-17 02:01:39,864 DEBUG [StoreOpener-d34d6d8b8aee836a577ebac64f77206e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/d34d6d8b8aee836a577ebac64f77206e/f1 2023-02-17 02:01:39,864 INFO [StoreOpener-d34d6d8b8aee836a577ebac64f77206e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d34d6d8b8aee836a577ebac64f77206e columnFamilyName f1 2023-02-17 02:01:39,864 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=18 2023-02-17 02:01:39,864 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=18, state=SUCCESS; OpenRegionProcedure 27286d7877e172b7626d8faac32266d5, server=jenkins-hbase4.apache.org,33169,1676599297588 in 240 msec 2023-02-17 02:01:39,864 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 02:01:39,864 INFO [StoreOpener-d34d6d8b8aee836a577ebac64f77206e-1] regionserver.HStore(310): Store=d34d6d8b8aee836a577ebac64f77206e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:39,865 INFO [StoreOpener-d34d6d8b8aee836a577ebac64f77206e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d34d6d8b8aee836a577ebac64f77206e 2023-02-17 02:01:39,865 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=27286d7877e172b7626d8faac32266d5, ASSIGN in 411 msec 2023-02-17 02:01:39,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 7080b20bafef3fcca7e77fb1564444dc 2023-02-17 02:01:39,866 DEBUG [StoreOpener-d34d6d8b8aee836a577ebac64f77206e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/d34d6d8b8aee836a577ebac64f77206e/f2 2023-02-17 02:01:39,866 DEBUG [StoreOpener-d34d6d8b8aee836a577ebac64f77206e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/d34d6d8b8aee836a577ebac64f77206e/f2 2023-02-17 02:01:39,866 INFO [StoreOpener-d34d6d8b8aee836a577ebac64f77206e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d34d6d8b8aee836a577ebac64f77206e columnFamilyName f2 2023-02-17 02:01:39,866 INFO [StoreOpener-d34d6d8b8aee836a577ebac64f77206e-1] regionserver.HStore(310): Store=d34d6d8b8aee836a577ebac64f77206e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:39,867 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/7080b20bafef3fcca7e77fb1564444dc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 02:01:39,867 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/d34d6d8b8aee836a577ebac64f77206e 2023-02-17 02:01:39,867 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/d34d6d8b8aee836a577ebac64f77206e 2023-02-17 02:01:39,867 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 7080b20bafef3fcca7e77fb1564444dc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68084132, jitterRate=0.014532625675201416}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 02:01:39,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 7080b20bafef3fcca7e77fb1564444dc: 2023-02-17 02:01:39,868 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676599299314.7080b20bafef3fcca7e77fb1564444dc., pid=21, masterSystemTime=1676599299769 2023-02-17 02:01:39,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 02:01:39,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676599299314.7080b20bafef3fcca7e77fb1564444dc. 2023-02-17 02:01:39,870 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676599299314.7080b20bafef3fcca7e77fb1564444dc. 2023-02-17 02:01:39,870 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,zz{,1676599299314.76c704a666ea47c826747b29fb61b262. 2023-02-17 02:01:39,870 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=7080b20bafef3fcca7e77fb1564444dc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40913,1676599297651 2023-02-17 02:01:39,870 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 76c704a666ea47c826747b29fb61b262, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676599299314.76c704a666ea47c826747b29fb61b262.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-17 02:01:39,870 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676599299314.7080b20bafef3fcca7e77fb1564444dc.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676599299870"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676599299870"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676599299870"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676599299870"}]},"ts":"1676599299870"} 2023-02-17 02:01:39,870 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 76c704a666ea47c826747b29fb61b262 2023-02-17 02:01:39,870 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676599299314.76c704a666ea47c826747b29fb61b262.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:39,870 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 76c704a666ea47c826747b29fb61b262 2023-02-17 02:01:39,870 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 76c704a666ea47c826747b29fb61b262 2023-02-17 02:01:39,870 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for d34d6d8b8aee836a577ebac64f77206e 2023-02-17 02:01:39,871 INFO [StoreOpener-76c704a666ea47c826747b29fb61b262-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 76c704a666ea47c826747b29fb61b262 2023-02-17 02:01:39,873 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=15 2023-02-17 02:01:39,873 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=15, state=SUCCESS; OpenRegionProcedure 7080b20bafef3fcca7e77fb1564444dc, server=jenkins-hbase4.apache.org,40913,1676599297651 in 255 msec 2023-02-17 02:01:39,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/d34d6d8b8aee836a577ebac64f77206e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 02:01:39,873 DEBUG [StoreOpener-76c704a666ea47c826747b29fb61b262-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/76c704a666ea47c826747b29fb61b262/f1 2023-02-17 02:01:39,873 DEBUG [StoreOpener-76c704a666ea47c826747b29fb61b262-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/76c704a666ea47c826747b29fb61b262/f1 2023-02-17 02:01:39,873 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened d34d6d8b8aee836a577ebac64f77206e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69905057, jitterRate=0.04166652262210846}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 02:01:39,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for d34d6d8b8aee836a577ebac64f77206e: 2023-02-17 02:01:39,874 INFO [StoreOpener-76c704a666ea47c826747b29fb61b262-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 76c704a666ea47c826747b29fb61b262 columnFamilyName f1 2023-02-17 02:01:39,874 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,d\x84\x84,1676599299314.d34d6d8b8aee836a577ebac64f77206e., pid=30, masterSystemTime=1676599299774 2023-02-17 02:01:39,874 INFO [StoreOpener-76c704a666ea47c826747b29fb61b262-1] regionserver.HStore(310): Store=76c704a666ea47c826747b29fb61b262/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:39,874 INFO [StoreOpener-76c704a666ea47c826747b29fb61b262-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 76c704a666ea47c826747b29fb61b262 2023-02-17 02:01:39,875 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7080b20bafef3fcca7e77fb1564444dc, ASSIGN in 420 msec 2023-02-17 02:01:39,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,d\x84\x84,1676599299314.d34d6d8b8aee836a577ebac64f77206e. 2023-02-17 02:01:39,876 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,d\x84\x84,1676599299314.d34d6d8b8aee836a577ebac64f77206e. 2023-02-17 02:01:39,876 DEBUG [StoreOpener-76c704a666ea47c826747b29fb61b262-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/76c704a666ea47c826747b29fb61b262/f2 2023-02-17 02:01:39,876 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=d34d6d8b8aee836a577ebac64f77206e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33169,1676599297588 2023-02-17 02:01:39,876 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,aaa,1676599299314.e59273498db883c4fe992b5078a4292b. 2023-02-17 02:01:39,876 DEBUG [StoreOpener-76c704a666ea47c826747b29fb61b262-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/76c704a666ea47c826747b29fb61b262/f2 2023-02-17 02:01:39,876 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676599299314.d34d6d8b8aee836a577ebac64f77206e.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676599299876"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676599299876"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676599299876"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676599299876"}]},"ts":"1676599299876"} 2023-02-17 02:01:39,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e59273498db883c4fe992b5078a4292b, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676599299314.e59273498db883c4fe992b5078a4292b.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-17 02:01:39,876 INFO [StoreOpener-76c704a666ea47c826747b29fb61b262-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 76c704a666ea47c826747b29fb61b262 columnFamilyName f2 2023-02-17 02:01:39,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion e59273498db883c4fe992b5078a4292b 2023-02-17 02:01:39,877 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676599299314.e59273498db883c4fe992b5078a4292b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:39,877 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for e59273498db883c4fe992b5078a4292b 2023-02-17 02:01:39,877 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for e59273498db883c4fe992b5078a4292b 2023-02-17 02:01:39,878 INFO [StoreOpener-76c704a666ea47c826747b29fb61b262-1] regionserver.HStore(310): Store=76c704a666ea47c826747b29fb61b262/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:39,878 INFO [StoreOpener-e59273498db883c4fe992b5078a4292b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e59273498db883c4fe992b5078a4292b 2023-02-17 02:01:39,879 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/76c704a666ea47c826747b29fb61b262 2023-02-17 02:01:39,879 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/76c704a666ea47c826747b29fb61b262 2023-02-17 02:01:39,880 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=13 2023-02-17 02:01:39,880 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=13, state=SUCCESS; OpenRegionProcedure d34d6d8b8aee836a577ebac64f77206e, server=jenkins-hbase4.apache.org,33169,1676599297588 in 252 msec 2023-02-17 02:01:39,880 DEBUG [StoreOpener-e59273498db883c4fe992b5078a4292b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/e59273498db883c4fe992b5078a4292b/f1 2023-02-17 02:01:39,880 DEBUG [StoreOpener-e59273498db883c4fe992b5078a4292b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/e59273498db883c4fe992b5078a4292b/f1 2023-02-17 02:01:39,880 INFO [StoreOpener-e59273498db883c4fe992b5078a4292b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e59273498db883c4fe992b5078a4292b columnFamilyName f1 2023-02-17 02:01:39,881 INFO [StoreOpener-e59273498db883c4fe992b5078a4292b-1] regionserver.HStore(310): Store=e59273498db883c4fe992b5078a4292b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:39,881 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d34d6d8b8aee836a577ebac64f77206e, ASSIGN in 427 msec 2023-02-17 02:01:39,881 INFO [StoreOpener-e59273498db883c4fe992b5078a4292b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e59273498db883c4fe992b5078a4292b 2023-02-17 02:01:39,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 02:01:39,882 DEBUG [StoreOpener-e59273498db883c4fe992b5078a4292b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/e59273498db883c4fe992b5078a4292b/f2 2023-02-17 02:01:39,882 DEBUG [StoreOpener-e59273498db883c4fe992b5078a4292b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/e59273498db883c4fe992b5078a4292b/f2 2023-02-17 02:01:39,882 INFO [StoreOpener-e59273498db883c4fe992b5078a4292b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e59273498db883c4fe992b5078a4292b columnFamilyName f2 2023-02-17 02:01:39,883 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 76c704a666ea47c826747b29fb61b262 2023-02-17 02:01:39,883 INFO [StoreOpener-e59273498db883c4fe992b5078a4292b-1] regionserver.HStore(310): Store=e59273498db883c4fe992b5078a4292b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:39,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/e59273498db883c4fe992b5078a4292b 2023-02-17 02:01:39,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/e59273498db883c4fe992b5078a4292b 2023-02-17 02:01:39,885 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/76c704a666ea47c826747b29fb61b262/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 02:01:39,885 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 76c704a666ea47c826747b29fb61b262; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75234488, jitterRate=0.12108123302459717}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 02:01:39,885 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 76c704a666ea47c826747b29fb61b262: 2023-02-17 02:01:39,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 02:01:39,886 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,zz{,1676599299314.76c704a666ea47c826747b29fb61b262., pid=25, masterSystemTime=1676599299769 2023-02-17 02:01:39,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for e59273498db883c4fe992b5078a4292b 2023-02-17 02:01:39,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,zz{,1676599299314.76c704a666ea47c826747b29fb61b262. 2023-02-17 02:01:39,887 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,zz{,1676599299314.76c704a666ea47c826747b29fb61b262. 2023-02-17 02:01:39,888 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=76c704a666ea47c826747b29fb61b262, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40913,1676599297651 2023-02-17 02:01:39,888 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,zz{,1676599299314.76c704a666ea47c826747b29fb61b262.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676599299887"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676599299887"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676599299887"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676599299887"}]},"ts":"1676599299887"} 2023-02-17 02:01:39,889 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/e59273498db883c4fe992b5078a4292b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 02:01:39,889 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened e59273498db883c4fe992b5078a4292b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72912021, jitterRate=0.08647377789020538}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 02:01:39,889 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for e59273498db883c4fe992b5078a4292b: 2023-02-17 02:01:39,890 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,aaa,1676599299314.e59273498db883c4fe992b5078a4292b., pid=29, masterSystemTime=1676599299774 2023-02-17 02:01:39,891 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=20 2023-02-17 02:01:39,891 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=20, state=SUCCESS; OpenRegionProcedure 76c704a666ea47c826747b29fb61b262, server=jenkins-hbase4.apache.org,40913,1676599297651 in 270 msec 2023-02-17 02:01:39,891 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,aaa,1676599299314.e59273498db883c4fe992b5078a4292b. 2023-02-17 02:01:39,892 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,aaa,1676599299314.e59273498db883c4fe992b5078a4292b. 2023-02-17 02:01:39,892 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=76c704a666ea47c826747b29fb61b262, ASSIGN in 438 msec 2023-02-17 02:01:39,892 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=e59273498db883c4fe992b5078a4292b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33169,1676599297588 2023-02-17 02:01:39,892 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,aaa,1676599299314.e59273498db883c4fe992b5078a4292b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676599299892"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676599299892"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676599299892"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676599299892"}]},"ts":"1676599299892"} 2023-02-17 02:01:39,895 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=12 2023-02-17 02:01:39,895 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=12, state=SUCCESS; OpenRegionProcedure e59273498db883c4fe992b5078a4292b, server=jenkins-hbase4.apache.org,33169,1676599297588 in 268 msec 2023-02-17 02:01:39,896 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=10 2023-02-17 02:01:39,896 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e59273498db883c4fe992b5078a4292b, ASSIGN in 442 msec 2023-02-17 02:01:39,897 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-17 02:01:39,897 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676599299897"}]},"ts":"1676599299897"} 2023-02-17 02:01:39,898 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLED in hbase:meta 2023-02-17 02:01:39,901 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-17 02:01:39,902 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceMultiRegion in 586 msec 2023-02-17 02:01:39,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 02:01:39,923 INFO [Listener at localhost/42831] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 10 completed 2023-02-17 02:01:39,923 DEBUG [Listener at localhost/42831] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceMultiRegion get assigned. Timeout = 60000ms 2023-02-17 02:01:39,923 INFO [Listener at localhost/42831] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-17 02:01:39,926 INFO [Listener at localhost/42831] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceMultiRegion assigned to meta. Checking AM states. 2023-02-17 02:01:39,926 INFO [Listener at localhost/42831] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-17 02:01:39,926 INFO [Listener at localhost/42831] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceMultiRegion assigned. 2023-02-17 02:01:39,926 INFO [Listener at localhost/42831] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-17 02:01:39,966 DEBUG [hconnection-0x2423cbaf-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 02:01:39,977 INFO [RS-EventLoopGroup-13-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57576, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 02:01:39,977 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40913] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6084 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676599299314.7080b20bafef3fcca7e77fb1564444dc. 2023-02-17 02:01:39,986 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33169] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 11492 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1676599299314.e59273498db883c4fe992b5078a4292b. 2023-02-17 02:01:40,054 INFO [Listener at localhost/42831] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-17 02:01:40,054 INFO [Listener at localhost/42831] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-17 02:01:40,055 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-17 02:01:40,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676599300055 (current time:1676599300055). 2023-02-17 02:01:40,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-17 02:01:40,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] zookeeper.ReadOnlyZKClient(139): Connect 0x79fccdae to 127.0.0.1:49216 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 02:01:40,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@103105ed, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 02:01:40,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 02:01:40,064 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44266, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 02:01:40,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x79fccdae to 127.0.0.1:49216 2023-02-17 02:01:40,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 02:01:40,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-17 02:01:40,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-17 02:01:40,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-17 02:01:40,068 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-17 02:01:40,069 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE; timeout=600000, timestamp=1676599900069 2023-02-17 02:01:40,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-17 02:01:40,069 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion 2023-02-17 02:01:40,071 DEBUG [Listener at localhost/42831] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-17 02:01:40,071 DEBUG [Listener at localhost/42831] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-17 02:01:40,072 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-17 02:01:40,072 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-17 02:01:40,073 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE in 6 msec 2023-02-17 02:01:40,073 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-17 02:01:40,074 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED; timeout=600000, timestamp=1676599900074 2023-02-17 02:01:40,085 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-17 02:01:40,085 INFO [(jenkins-hbase4.apache.org,44147,1676599297546)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-17 02:01:40,085 DEBUG [(jenkins-hbase4.apache.org,44147,1676599297546)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-17 02:01:40,086 DEBUG [(jenkins-hbase4.apache.org,44147,1676599297546)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-17 02:01:40,086 DEBUG [(jenkins-hbase4.apache.org,44147,1676599297546)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-17 02:01:40,087 DEBUG [(jenkins-hbase4.apache.org,44147,1676599297546)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-17 02:01:40,087 DEBUG [(jenkins-hbase4.apache.org,44147,1676599297546)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-17 02:01:40,088 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): regionserver:40913-0x1006002efba0002, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 02:01:40,088 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): regionserver:33169-0x1006002efba0001, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 02:01:40,088 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 02:01:40,088 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 02:01:40,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 02:01:40,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 02:01:40,088 DEBUG [(jenkins-hbase4.apache.org,44147,1676599297546)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33169,1676599297588 2023-02-17 02:01:40,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-17 02:01:40,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-17 02:01:40,089 DEBUG [(jenkins-hbase4.apache.org,44147,1676599297546)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33169,1676599297588 2023-02-17 02:01:40,089 DEBUG [(jenkins-hbase4.apache.org,44147,1676599297546)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40913,1676599297651 2023-02-17 02:01:40,089 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40913-0x1006002efba0002, quorum=127.0.0.1:49216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-17 02:01:40,089 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33169-0x1006002efba0001, quorum=127.0.0.1:49216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-17 02:01:40,089 DEBUG [(jenkins-hbase4.apache.org,44147,1676599297546)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40913,1676599297651 2023-02-17 02:01:40,089 DEBUG [(jenkins-hbase4.apache.org,44147,1676599297546)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-17 02:01:40,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-17 02:01:40,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-17 02:01:40,089 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-17 02:01:40,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-17 02:01:40,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-17 02:01:40,090 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-17 02:01:40,090 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-17 02:01:40,090 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-17 02:01:40,090 DEBUG [member: 'jenkins-hbase4.apache.org,40913,1676599297651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-17 02:01:40,090 DEBUG [member: 'jenkins-hbase4.apache.org,40913,1676599297651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-17 02:01:40,090 DEBUG [member: 'jenkins-hbase4.apache.org,33169,1676599297588' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-17 02:01:40,090 DEBUG [member: 'jenkins-hbase4.apache.org,33169,1676599297588' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-17 02:01:40,093 DEBUG [member: 'jenkins-hbase4.apache.org,40913,1676599297651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-17 02:01:40,093 DEBUG [member: 'jenkins-hbase4.apache.org,40913,1676599297651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-17 02:01:40,093 DEBUG [member: 'jenkins-hbase4.apache.org,33169,1676599297588' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-17 02:01:40,093 DEBUG [member: 'jenkins-hbase4.apache.org,33169,1676599297588' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-17 02:01:40,093 DEBUG [member: 'jenkins-hbase4.apache.org,33169,1676599297588' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33169,1676599297588' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-17 02:01:40,093 DEBUG [member: 'jenkins-hbase4.apache.org,40913,1676599297651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40913,1676599297651' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-17 02:01:40,095 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33169,1676599297588 2023-02-17 02:01:40,095 DEBUG [member: 'jenkins-hbase4.apache.org,33169,1676599297588' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-17 02:01:40,095 DEBUG [member: 'jenkins-hbase4.apache.org,40913,1676599297651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-17 02:01:40,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33169,1676599297588 2023-02-17 02:01:40,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 02:01:40,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-17 02:01:40,095 DEBUG [member: 'jenkins-hbase4.apache.org,33169,1676599297588' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33169-0x1006002efba0001, quorum=127.0.0.1:49216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-17 02:01:40,095 DEBUG [member: 'jenkins-hbase4.apache.org,33169,1676599297588' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 02:01:40,095 DEBUG [member: 'jenkins-hbase4.apache.org,40913,1676599297651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40913-0x1006002efba0002, quorum=127.0.0.1:49216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-17 02:01:40,095 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40913,1676599297651 2023-02-17 02:01:40,095 DEBUG [member: 'jenkins-hbase4.apache.org,40913,1676599297651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 02:01:40,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 02:01:40,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 02:01:40,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-17 02:01:40,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33169,1676599297588 2023-02-17 02:01:40,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40913,1676599297651 2023-02-17 02:01:40,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 02:01:40,097 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33169,1676599297588' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-17 02:01:40,097 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3441e248[Count = 1] remaining members to acquire global barrier 2023-02-17 02:01:40,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40913,1676599297651 2023-02-17 02:01:40,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 02:01:40,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-17 02:01:40,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 02:01:40,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 02:01:40,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-17 02:01:40,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33169,1676599297588 2023-02-17 02:01:40,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40913,1676599297651 2023-02-17 02:01:40,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 02:01:40,098 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40913,1676599297651' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-17 02:01:40,098 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3441e248[Count = 0] remaining members to acquire global barrier 2023-02-17 02:01:40,098 DEBUG [(jenkins-hbase4.apache.org,44147,1676599297546)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-17 02:01:40,099 DEBUG [(jenkins-hbase4.apache.org,44147,1676599297546)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-17 02:01:40,100 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): regionserver:33169-0x1006002efba0001, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-17 02:01:40,100 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): regionserver:40913-0x1006002efba0002, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-17 02:01:40,100 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-17 02:01:40,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-17 02:01:40,100 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-17 02:01:40,100 DEBUG [member: 'jenkins-hbase4.apache.org,33169,1676599297588' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-17 02:01:40,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-17 02:01:40,100 DEBUG [(jenkins-hbase4.apache.org,44147,1676599297546)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33169,1676599297588 2023-02-17 02:01:40,100 DEBUG [member: 'jenkins-hbase4.apache.org,40913,1676599297651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-17 02:01:40,100 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1676599299314.14f2c512e529cbb9d6867ebbf198fe39. 2023-02-17 02:01:40,100 DEBUG [(jenkins-hbase4.apache.org,44147,1676599297546)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40913,1676599297651 2023-02-17 02:01:40,100 DEBUG [(jenkins-hbase4.apache.org,44147,1676599297546)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-17 02:01:40,100 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1676599299314.e59273498db883c4fe992b5078a4292b. 2023-02-17 02:01:40,100 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1676599299314.14f2c512e529cbb9d6867ebbf198fe39. started... 2023-02-17 02:01:40,100 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676599299314.21311936f3c5e2464085c015fcb59dc0. 2023-02-17 02:01:40,100 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1676599299314.e59273498db883c4fe992b5078a4292b. started... 2023-02-17 02:01:40,101 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1676599299314.21311936f3c5e2464085c015fcb59dc0. started... 2023-02-17 02:01:40,102 DEBUG [member: 'jenkins-hbase4.apache.org,33169,1676599297588' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-17 02:01:40,103 DEBUG [member: 'jenkins-hbase4.apache.org,33169,1676599297588' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-17 02:01:40,103 INFO [rs(jenkins-hbase4.apache.org,40913,1676599297651)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 21311936f3c5e2464085c015fcb59dc0 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-17 02:01:40,103 INFO [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 14f2c512e529cbb9d6867ebbf198fe39 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-17 02:01:40,103 INFO [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-1] regionserver.HRegion(2744): Flushing e59273498db883c4fe992b5078a4292b 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-17 02:01:40,103 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676599299314.c691d9a9a766414e01e1a5d1e977f7ef. 2023-02-17 02:01:40,103 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,,1676599299314.033e5165635b9ba2e8fffe93154e637e. 2023-02-17 02:01:40,103 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676599299314.c691d9a9a766414e01e1a5d1e977f7ef. started... 2023-02-17 02:01:40,103 DEBUG [member: 'jenkins-hbase4.apache.org,40913,1676599297651' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-17 02:01:40,103 DEBUG [member: 'jenkins-hbase4.apache.org,40913,1676599297651' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-17 02:01:40,103 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676599299314.7080b20bafef3fcca7e77fb1564444dc. 2023-02-17 02:01:40,103 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1676599299314.033e5165635b9ba2e8fffe93154e637e. started... 2023-02-17 02:01:40,104 INFO [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-2] regionserver.HRegion(2744): Flushing c691d9a9a766414e01e1a5d1e977f7ef 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-17 02:01:40,103 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676599299314.7080b20bafef3fcca7e77fb1564444dc. started... 2023-02-17 02:01:40,105 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 033e5165635b9ba2e8fffe93154e637e: 2023-02-17 02:01:40,105 INFO [rs(jenkins-hbase4.apache.org,40913,1676599297651)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 7080b20bafef3fcca7e77fb1564444dc 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-17 02:01:40,106 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,,1676599299314.033e5165635b9ba2e8fffe93154e637e.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-17 02:01:40,106 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 02:01:40,106 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-17 02:01:40,106 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-17 02:01:40,128 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1676599299314.033e5165635b9ba2e8fffe93154e637e. completed. 2023-02-17 02:01:40,128 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,,1676599299314.033e5165635b9ba2e8fffe93154e637e. 2023-02-17 02:01:40,128 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1676599299314.76c704a666ea47c826747b29fb61b262. 2023-02-17 02:01:40,128 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1676599299314.76c704a666ea47c826747b29fb61b262. started... 2023-02-17 02:01:40,130 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 76c704a666ea47c826747b29fb61b262: 2023-02-17 02:01:40,130 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,zz{,1676599299314.76c704a666ea47c826747b29fb61b262.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-17 02:01:40,130 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 02:01:40,130 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-17 02:01:40,130 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-17 02:01:40,132 DEBUG [member: 'jenkins-hbase4.apache.org,40913,1676599297651' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-17 02:01:40,132 INFO [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/e59273498db883c4fe992b5078a4292b/.tmp/f1/7859f50f6bc7464ba81ed31b021042bc 2023-02-17 02:01:40,139 INFO [rs(jenkins-hbase4.apache.org,40913,1676599297651)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/7080b20bafef3fcca7e77fb1564444dc/.tmp/f1/ab16a9abe6424f00872cdac7c4986916 2023-02-17 02:01:40,144 INFO [rs(jenkins-hbase4.apache.org,40913,1676599297651)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/21311936f3c5e2464085c015fcb59dc0/.tmp/f1/eecf0269b9ae450f88e892cf69d0e0cf 2023-02-17 02:01:40,157 INFO [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/c691d9a9a766414e01e1a5d1e977f7ef/.tmp/f1/11a8cdc80a2d44f1bffce0cee2d27545 2023-02-17 02:01:40,172 DEBUG [Listener at localhost/42831] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-17 02:01:40,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-17 02:01:40,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-17 02:01:40,174 DEBUG [Listener at localhost/42831] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-17 02:01:40,177 INFO [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/e59273498db883c4fe992b5078a4292b/.tmp/f2/1eca9fd903224bae93f53e7968116387 2023-02-17 02:01:40,177 INFO [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/14f2c512e529cbb9d6867ebbf198fe39/.tmp/f1/5fa203364e084b90b7dd58f7350af22a 2023-02-17 02:01:40,182 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/e59273498db883c4fe992b5078a4292b/.tmp/f1/7859f50f6bc7464ba81ed31b021042bc as hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/e59273498db883c4fe992b5078a4292b/f1/7859f50f6bc7464ba81ed31b021042bc 2023-02-17 02:01:40,188 INFO [rs(jenkins-hbase4.apache.org,40913,1676599297651)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/7080b20bafef3fcca7e77fb1564444dc/.tmp/f2/4480550c813a461ba99f421240031d32 2023-02-17 02:01:40,192 INFO [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/e59273498db883c4fe992b5078a4292b/f1/7859f50f6bc7464ba81ed31b021042bc, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-17 02:01:40,197 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1676599299314.76c704a666ea47c826747b29fb61b262. completed. 2023-02-17 02:01:40,197 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1676599299314.76c704a666ea47c826747b29fb61b262. 2023-02-17 02:01:40,197 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676599299314.6b374f0b5a440ed43ee4cdab132cd165. 2023-02-17 02:01:40,197 DEBUG [member: 'jenkins-hbase4.apache.org,40913,1676599297651' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-17 02:01:40,197 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1676599299314.6b374f0b5a440ed43ee4cdab132cd165. started... 2023-02-17 02:01:40,197 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/e59273498db883c4fe992b5078a4292b/.tmp/f2/1eca9fd903224bae93f53e7968116387 as hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/e59273498db883c4fe992b5078a4292b/f2/1eca9fd903224bae93f53e7968116387 2023-02-17 02:01:40,198 INFO [rs(jenkins-hbase4.apache.org,40913,1676599297651)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 6b374f0b5a440ed43ee4cdab132cd165 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-17 02:01:40,204 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/7080b20bafef3fcca7e77fb1564444dc/.tmp/f1/ab16a9abe6424f00872cdac7c4986916 as hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/7080b20bafef3fcca7e77fb1564444dc/f1/ab16a9abe6424f00872cdac7c4986916 2023-02-17 02:01:40,208 INFO [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/c691d9a9a766414e01e1a5d1e977f7ef/.tmp/f2/5981aab5c8ae4fe59385233bb285c2e5 2023-02-17 02:01:40,210 INFO [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/e59273498db883c4fe992b5078a4292b/f2/1eca9fd903224bae93f53e7968116387, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-17 02:01:40,211 INFO [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for e59273498db883c4fe992b5078a4292b in 109ms, sequenceid=5, compaction requested=false 2023-02-17 02:01:40,211 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceMultiRegion' 2023-02-17 02:01:40,212 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for e59273498db883c4fe992b5078a4292b: 2023-02-17 02:01:40,212 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,aaa,1676599299314.e59273498db883c4fe992b5078a4292b.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-17 02:01:40,215 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 02:01:40,215 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/e59273498db883c4fe992b5078a4292b/f1/7859f50f6bc7464ba81ed31b021042bc] hfiles 2023-02-17 02:01:40,215 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/e59273498db883c4fe992b5078a4292b/f1/7859f50f6bc7464ba81ed31b021042bc for snapshot=testWithMockedMapReduceMultiRegion 2023-02-17 02:01:40,215 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/e59273498db883c4fe992b5078a4292b/f2/1eca9fd903224bae93f53e7968116387] hfiles 2023-02-17 02:01:40,216 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/e59273498db883c4fe992b5078a4292b/f2/1eca9fd903224bae93f53e7968116387 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-17 02:01:40,217 INFO [rs(jenkins-hbase4.apache.org,40913,1676599297651)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/7080b20bafef3fcca7e77fb1564444dc/f1/ab16a9abe6424f00872cdac7c4986916, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 02:01:40,217 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/c691d9a9a766414e01e1a5d1e977f7ef/.tmp/f1/11a8cdc80a2d44f1bffce0cee2d27545 as hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/c691d9a9a766414e01e1a5d1e977f7ef/f1/11a8cdc80a2d44f1bffce0cee2d27545 2023-02-17 02:01:40,218 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/7080b20bafef3fcca7e77fb1564444dc/.tmp/f2/4480550c813a461ba99f421240031d32 as hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/7080b20bafef3fcca7e77fb1564444dc/f2/4480550c813a461ba99f421240031d32 2023-02-17 02:01:40,220 INFO [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/14f2c512e529cbb9d6867ebbf198fe39/.tmp/f2/d62d74424c98482f8468af99ea6c0a4f 2023-02-17 02:01:40,222 INFO [rs(jenkins-hbase4.apache.org,40913,1676599297651)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/7080b20bafef3fcca7e77fb1564444dc/f2/4480550c813a461ba99f421240031d32, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 02:01:40,223 INFO [rs(jenkins-hbase4.apache.org,40913,1676599297651)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 7080b20bafef3fcca7e77fb1564444dc in 118ms, sequenceid=5, compaction requested=false 2023-02-17 02:01:40,228 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 7080b20bafef3fcca7e77fb1564444dc: 2023-02-17 02:01:40,228 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676599299314.7080b20bafef3fcca7e77fb1564444dc.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-17 02:01:40,228 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 02:01:40,228 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/7080b20bafef3fcca7e77fb1564444dc/f1/ab16a9abe6424f00872cdac7c4986916] hfiles 2023-02-17 02:01:40,228 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/7080b20bafef3fcca7e77fb1564444dc/f1/ab16a9abe6424f00872cdac7c4986916 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-17 02:01:40,228 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/7080b20bafef3fcca7e77fb1564444dc/f2/4480550c813a461ba99f421240031d32] hfiles 2023-02-17 02:01:40,228 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/7080b20bafef3fcca7e77fb1564444dc/f2/4480550c813a461ba99f421240031d32 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-17 02:01:40,230 INFO [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/c691d9a9a766414e01e1a5d1e977f7ef/f1/11a8cdc80a2d44f1bffce0cee2d27545, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 02:01:40,231 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/c691d9a9a766414e01e1a5d1e977f7ef/.tmp/f2/5981aab5c8ae4fe59385233bb285c2e5 as hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/c691d9a9a766414e01e1a5d1e977f7ef/f2/5981aab5c8ae4fe59385233bb285c2e5 2023-02-17 02:01:40,237 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/14f2c512e529cbb9d6867ebbf198fe39/.tmp/f1/5fa203364e084b90b7dd58f7350af22a as hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/14f2c512e529cbb9d6867ebbf198fe39/f1/5fa203364e084b90b7dd58f7350af22a 2023-02-17 02:01:40,240 INFO [rs(jenkins-hbase4.apache.org,40913,1676599297651)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/6b374f0b5a440ed43ee4cdab132cd165/.tmp/f1/788355db401b48529ec690ced656df37 2023-02-17 02:01:40,242 INFO [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/14f2c512e529cbb9d6867ebbf198fe39/f1/5fa203364e084b90b7dd58f7350af22a, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-17 02:01:40,243 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/14f2c512e529cbb9d6867ebbf198fe39/.tmp/f2/d62d74424c98482f8468af99ea6c0a4f as hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/14f2c512e529cbb9d6867ebbf198fe39/f2/d62d74424c98482f8468af99ea6c0a4f 2023-02-17 02:01:40,244 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1676599299314.e59273498db883c4fe992b5078a4292b. completed. 2023-02-17 02:01:40,244 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1676599299314.e59273498db883c4fe992b5078a4292b. 2023-02-17 02:01:40,244 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676599299314.d34d6d8b8aee836a577ebac64f77206e. 2023-02-17 02:01:40,244 DEBUG [member: 'jenkins-hbase4.apache.org,33169,1676599297588' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-17 02:01:40,244 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1676599299314.d34d6d8b8aee836a577ebac64f77206e. started... 2023-02-17 02:01:40,245 INFO [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/c691d9a9a766414e01e1a5d1e977f7ef/f2/5981aab5c8ae4fe59385233bb285c2e5, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 02:01:40,246 INFO [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for c691d9a9a766414e01e1a5d1e977f7ef in 142ms, sequenceid=5, compaction requested=false 2023-02-17 02:01:40,246 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for c691d9a9a766414e01e1a5d1e977f7ef: 2023-02-17 02:01:40,246 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676599299314.c691d9a9a766414e01e1a5d1e977f7ef.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-17 02:01:40,246 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 02:01:40,246 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/c691d9a9a766414e01e1a5d1e977f7ef/f1/11a8cdc80a2d44f1bffce0cee2d27545] hfiles 2023-02-17 02:01:40,246 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/c691d9a9a766414e01e1a5d1e977f7ef/f1/11a8cdc80a2d44f1bffce0cee2d27545 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-17 02:01:40,246 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/c691d9a9a766414e01e1a5d1e977f7ef/f2/5981aab5c8ae4fe59385233bb285c2e5] hfiles 2023-02-17 02:01:40,246 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/c691d9a9a766414e01e1a5d1e977f7ef/f2/5981aab5c8ae4fe59385233bb285c2e5 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-17 02:01:40,253 INFO [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-1] regionserver.HRegion(2744): Flushing d34d6d8b8aee836a577ebac64f77206e 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-17 02:01:40,256 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676599299314.7080b20bafef3fcca7e77fb1564444dc. completed. 2023-02-17 02:01:40,256 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676599299314.7080b20bafef3fcca7e77fb1564444dc. 2023-02-17 02:01:40,256 DEBUG [member: 'jenkins-hbase4.apache.org,40913,1676599297651' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-17 02:01:40,257 INFO [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/14f2c512e529cbb9d6867ebbf198fe39/f2/d62d74424c98482f8468af99ea6c0a4f, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-17 02:01:40,261 INFO [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 14f2c512e529cbb9d6867ebbf198fe39 in 159ms, sequenceid=5, compaction requested=false 2023-02-17 02:01:40,261 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 14f2c512e529cbb9d6867ebbf198fe39: 2023-02-17 02:01:40,261 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,wWV,1676599299314.14f2c512e529cbb9d6867ebbf198fe39.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-17 02:01:40,261 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 02:01:40,261 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/14f2c512e529cbb9d6867ebbf198fe39/f1/5fa203364e084b90b7dd58f7350af22a] hfiles 2023-02-17 02:01:40,261 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/14f2c512e529cbb9d6867ebbf198fe39/f1/5fa203364e084b90b7dd58f7350af22a for snapshot=testWithMockedMapReduceMultiRegion 2023-02-17 02:01:40,261 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/14f2c512e529cbb9d6867ebbf198fe39/f2/d62d74424c98482f8468af99ea6c0a4f] hfiles 2023-02-17 02:01:40,262 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/14f2c512e529cbb9d6867ebbf198fe39/f2/d62d74424c98482f8468af99ea6c0a4f for snapshot=testWithMockedMapReduceMultiRegion 2023-02-17 02:01:40,264 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676599299314.c691d9a9a766414e01e1a5d1e977f7ef. completed. 2023-02-17 02:01:40,264 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676599299314.c691d9a9a766414e01e1a5d1e977f7ef. 2023-02-17 02:01:40,264 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,t43,1676599299314.27286d7877e172b7626d8faac32266d5. 2023-02-17 02:01:40,264 DEBUG [member: 'jenkins-hbase4.apache.org,33169,1676599297588' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-17 02:01:40,264 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1676599299314.27286d7877e172b7626d8faac32266d5. started... 2023-02-17 02:01:40,269 INFO [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 27286d7877e172b7626d8faac32266d5 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-17 02:01:40,280 INFO [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/d34d6d8b8aee836a577ebac64f77206e/.tmp/f1/c998db2d8e68420ea00f02987c2a8019 2023-02-17 02:01:40,291 INFO [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/27286d7877e172b7626d8faac32266d5/.tmp/f1/a930e3556eac46578a1753b460ab39e8 2023-02-17 02:01:40,306 INFO [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/27286d7877e172b7626d8faac32266d5/.tmp/f2/dc9baabcc9ce45d8a21443cf9630582b 2023-02-17 02:01:40,311 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/27286d7877e172b7626d8faac32266d5/.tmp/f1/a930e3556eac46578a1753b460ab39e8 as hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/27286d7877e172b7626d8faac32266d5/f1/a930e3556eac46578a1753b460ab39e8 2023-02-17 02:01:40,315 INFO [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/27286d7877e172b7626d8faac32266d5/f1/a930e3556eac46578a1753b460ab39e8, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 02:01:40,316 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/27286d7877e172b7626d8faac32266d5/.tmp/f2/dc9baabcc9ce45d8a21443cf9630582b as hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/27286d7877e172b7626d8faac32266d5/f2/dc9baabcc9ce45d8a21443cf9630582b 2023-02-17 02:01:40,320 INFO [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/27286d7877e172b7626d8faac32266d5/f2/dc9baabcc9ce45d8a21443cf9630582b, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 02:01:40,321 INFO [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 27286d7877e172b7626d8faac32266d5 in 52ms, sequenceid=5, compaction requested=false 2023-02-17 02:01:40,321 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 27286d7877e172b7626d8faac32266d5: 2023-02-17 02:01:40,321 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,t43,1676599299314.27286d7877e172b7626d8faac32266d5.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-17 02:01:40,321 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 02:01:40,322 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/27286d7877e172b7626d8faac32266d5/f1/a930e3556eac46578a1753b460ab39e8] hfiles 2023-02-17 02:01:40,322 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/27286d7877e172b7626d8faac32266d5/f1/a930e3556eac46578a1753b460ab39e8 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-17 02:01:40,322 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/27286d7877e172b7626d8faac32266d5/f2/dc9baabcc9ce45d8a21443cf9630582b] hfiles 2023-02-17 02:01:40,322 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/27286d7877e172b7626d8faac32266d5/f2/dc9baabcc9ce45d8a21443cf9630582b for snapshot=testWithMockedMapReduceMultiRegion 2023-02-17 02:01:40,329 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1676599299314.27286d7877e172b7626d8faac32266d5. completed. 2023-02-17 02:01:40,329 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,t43,1676599299314.27286d7877e172b7626d8faac32266d5. 2023-02-17 02:01:40,329 DEBUG [member: 'jenkins-hbase4.apache.org,33169,1676599297588' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-17 02:01:40,374 DEBUG [Listener at localhost/42831] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-17 02:01:40,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-17 02:01:40,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-17 02:01:40,376 DEBUG [Listener at localhost/42831] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-17 02:01:40,598 INFO [rs(jenkins-hbase4.apache.org,40913,1676599297651)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/21311936f3c5e2464085c015fcb59dc0/.tmp/f2/fc09d0ad57684cdfbef52e06095b34fa 2023-02-17 02:01:40,603 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/21311936f3c5e2464085c015fcb59dc0/.tmp/f1/eecf0269b9ae450f88e892cf69d0e0cf as hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/21311936f3c5e2464085c015fcb59dc0/f1/eecf0269b9ae450f88e892cf69d0e0cf 2023-02-17 02:01:40,607 INFO [rs(jenkins-hbase4.apache.org,40913,1676599297651)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/21311936f3c5e2464085c015fcb59dc0/f1/eecf0269b9ae450f88e892cf69d0e0cf, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 02:01:40,607 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/21311936f3c5e2464085c015fcb59dc0/.tmp/f2/fc09d0ad57684cdfbef52e06095b34fa as hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/21311936f3c5e2464085c015fcb59dc0/f2/fc09d0ad57684cdfbef52e06095b34fa 2023-02-17 02:01:40,612 INFO [rs(jenkins-hbase4.apache.org,40913,1676599297651)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/21311936f3c5e2464085c015fcb59dc0/f2/fc09d0ad57684cdfbef52e06095b34fa, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 02:01:40,612 INFO [rs(jenkins-hbase4.apache.org,40913,1676599297651)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 21311936f3c5e2464085c015fcb59dc0 in 510ms, sequenceid=5, compaction requested=false 2023-02-17 02:01:40,612 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 21311936f3c5e2464085c015fcb59dc0: 2023-02-17 02:01:40,613 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676599299314.21311936f3c5e2464085c015fcb59dc0.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-17 02:01:40,613 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 02:01:40,613 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/21311936f3c5e2464085c015fcb59dc0/f1/eecf0269b9ae450f88e892cf69d0e0cf] hfiles 2023-02-17 02:01:40,613 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/21311936f3c5e2464085c015fcb59dc0/f1/eecf0269b9ae450f88e892cf69d0e0cf for snapshot=testWithMockedMapReduceMultiRegion 2023-02-17 02:01:40,613 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/21311936f3c5e2464085c015fcb59dc0/f2/fc09d0ad57684cdfbef52e06095b34fa] hfiles 2023-02-17 02:01:40,613 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/21311936f3c5e2464085c015fcb59dc0/f2/fc09d0ad57684cdfbef52e06095b34fa for snapshot=testWithMockedMapReduceMultiRegion 2023-02-17 02:01:40,619 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1676599299314.21311936f3c5e2464085c015fcb59dc0. completed. 2023-02-17 02:01:40,619 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676599299314.21311936f3c5e2464085c015fcb59dc0. 2023-02-17 02:01:40,619 DEBUG [member: 'jenkins-hbase4.apache.org,40913,1676599297651' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-17 02:01:40,676 DEBUG [Listener at localhost/42831] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-17 02:01:40,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-17 02:01:40,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-17 02:01:40,677 DEBUG [Listener at localhost/42831] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-17 02:01:40,679 INFO [rs(jenkins-hbase4.apache.org,40913,1676599297651)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/6b374f0b5a440ed43ee4cdab132cd165/.tmp/f2/8ac7e9d1168e4d818482016e67eaee9a 2023-02-17 02:01:40,683 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1676599299314.14f2c512e529cbb9d6867ebbf198fe39. completed. 2023-02-17 02:01:40,683 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1676599299314.14f2c512e529cbb9d6867ebbf198fe39. 2023-02-17 02:01:40,683 DEBUG [member: 'jenkins-hbase4.apache.org,33169,1676599297588' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-17 02:01:40,685 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/6b374f0b5a440ed43ee4cdab132cd165/.tmp/f1/788355db401b48529ec690ced656df37 as hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/6b374f0b5a440ed43ee4cdab132cd165/f1/788355db401b48529ec690ced656df37 2023-02-17 02:01:40,689 INFO [rs(jenkins-hbase4.apache.org,40913,1676599297651)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/6b374f0b5a440ed43ee4cdab132cd165/f1/788355db401b48529ec690ced656df37, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 02:01:40,690 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/6b374f0b5a440ed43ee4cdab132cd165/.tmp/f2/8ac7e9d1168e4d818482016e67eaee9a as hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/6b374f0b5a440ed43ee4cdab132cd165/f2/8ac7e9d1168e4d818482016e67eaee9a 2023-02-17 02:01:40,694 INFO [rs(jenkins-hbase4.apache.org,40913,1676599297651)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/6b374f0b5a440ed43ee4cdab132cd165/f2/8ac7e9d1168e4d818482016e67eaee9a, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 02:01:40,695 INFO [rs(jenkins-hbase4.apache.org,40913,1676599297651)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 6b374f0b5a440ed43ee4cdab132cd165 in 497ms, sequenceid=5, compaction requested=false 2023-02-17 02:01:40,695 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 6b374f0b5a440ed43ee4cdab132cd165: 2023-02-17 02:01:40,695 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676599299314.6b374f0b5a440ed43ee4cdab132cd165.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-17 02:01:40,695 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 02:01:40,695 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/6b374f0b5a440ed43ee4cdab132cd165/f1/788355db401b48529ec690ced656df37] hfiles 2023-02-17 02:01:40,695 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/6b374f0b5a440ed43ee4cdab132cd165/f1/788355db401b48529ec690ced656df37 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-17 02:01:40,695 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/6b374f0b5a440ed43ee4cdab132cd165/f2/8ac7e9d1168e4d818482016e67eaee9a] hfiles 2023-02-17 02:01:40,695 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/6b374f0b5a440ed43ee4cdab132cd165/f2/8ac7e9d1168e4d818482016e67eaee9a for snapshot=testWithMockedMapReduceMultiRegion 2023-02-17 02:01:40,698 INFO [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/d34d6d8b8aee836a577ebac64f77206e/.tmp/f2/1498be0e208e4dc5b9364280a44fff12 2023-02-17 02:01:40,701 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1676599299314.6b374f0b5a440ed43ee4cdab132cd165. completed. 2023-02-17 02:01:40,701 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676599299314.6b374f0b5a440ed43ee4cdab132cd165. 2023-02-17 02:01:40,701 DEBUG [member: 'jenkins-hbase4.apache.org,40913,1676599297651' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-17 02:01:40,701 DEBUG [member: 'jenkins-hbase4.apache.org,40913,1676599297651' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-17 02:01:40,701 DEBUG [member: 'jenkins-hbase4.apache.org,40913,1676599297651' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40913,1676599297651 2023-02-17 02:01:40,701 DEBUG [member: 'jenkins-hbase4.apache.org,40913,1676599297651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-17 02:01:40,701 DEBUG [member: 'jenkins-hbase4.apache.org,40913,1676599297651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,40913,1676599297651' in zk 2023-02-17 02:01:40,703 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/d34d6d8b8aee836a577ebac64f77206e/.tmp/f1/c998db2d8e68420ea00f02987c2a8019 as hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/d34d6d8b8aee836a577ebac64f77206e/f1/c998db2d8e68420ea00f02987c2a8019 2023-02-17 02:01:40,703 DEBUG [member: 'jenkins-hbase4.apache.org,40913,1676599297651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-17 02:01:40,703 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40913,1676599297651 2023-02-17 02:01:40,703 DEBUG [member: 'jenkins-hbase4.apache.org,40913,1676599297651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 02:01:40,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40913,1676599297651 2023-02-17 02:01:40,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 02:01:40,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-17 02:01:40,703 DEBUG [member: 'jenkins-hbase4.apache.org,40913,1676599297651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-17 02:01:40,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 02:01:40,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 02:01:40,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-17 02:01:40,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33169,1676599297588 2023-02-17 02:01:40,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40913,1676599297651 2023-02-17 02:01:40,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 02:01:40,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-17 02:01:40,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40913,1676599297651 2023-02-17 02:01:40,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,40913,1676599297651': 2023-02-17 02:01:40,706 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40913,1676599297651' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-17 02:01:40,707 INFO [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/d34d6d8b8aee836a577ebac64f77206e/f1/c998db2d8e68420ea00f02987c2a8019, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 02:01:40,708 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/d34d6d8b8aee836a577ebac64f77206e/.tmp/f2/1498be0e208e4dc5b9364280a44fff12 as hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/d34d6d8b8aee836a577ebac64f77206e/f2/1498be0e208e4dc5b9364280a44fff12 2023-02-17 02:01:40,711 INFO [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/d34d6d8b8aee836a577ebac64f77206e/f2/1498be0e208e4dc5b9364280a44fff12, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 02:01:40,712 INFO [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for d34d6d8b8aee836a577ebac64f77206e in 459ms, sequenceid=5, compaction requested=false 2023-02-17 02:01:40,712 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for d34d6d8b8aee836a577ebac64f77206e: 2023-02-17 02:01:40,712 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676599299314.d34d6d8b8aee836a577ebac64f77206e.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-17 02:01:40,712 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 02:01:40,712 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/d34d6d8b8aee836a577ebac64f77206e/f1/c998db2d8e68420ea00f02987c2a8019] hfiles 2023-02-17 02:01:40,712 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/d34d6d8b8aee836a577ebac64f77206e/f1/c998db2d8e68420ea00f02987c2a8019 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-17 02:01:40,712 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/d34d6d8b8aee836a577ebac64f77206e/f2/1498be0e208e4dc5b9364280a44fff12] hfiles 2023-02-17 02:01:40,712 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/d34d6d8b8aee836a577ebac64f77206e/f2/1498be0e208e4dc5b9364280a44fff12 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-17 02:01:40,717 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1676599299314.d34d6d8b8aee836a577ebac64f77206e. completed. 2023-02-17 02:01:40,718 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676599299314.d34d6d8b8aee836a577ebac64f77206e. 2023-02-17 02:01:40,718 DEBUG [member: 'jenkins-hbase4.apache.org,33169,1676599297588' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-17 02:01:40,718 DEBUG [member: 'jenkins-hbase4.apache.org,33169,1676599297588' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-17 02:01:40,718 DEBUG [member: 'jenkins-hbase4.apache.org,33169,1676599297588' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33169,1676599297588 2023-02-17 02:01:40,718 DEBUG [member: 'jenkins-hbase4.apache.org,33169,1676599297588' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-17 02:01:40,718 DEBUG [member: 'jenkins-hbase4.apache.org,33169,1676599297588' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,33169,1676599297588' in zk 2023-02-17 02:01:40,720 DEBUG [member: 'jenkins-hbase4.apache.org,33169,1676599297588' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-17 02:01:40,720 DEBUG [member: 'jenkins-hbase4.apache.org,33169,1676599297588' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 02:01:40,720 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33169,1676599297588 2023-02-17 02:01:40,720 DEBUG [member: 'jenkins-hbase4.apache.org,33169,1676599297588' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-17 02:01:40,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33169,1676599297588 2023-02-17 02:01:40,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 02:01:40,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-17 02:01:40,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 02:01:40,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 02:01:40,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-17 02:01:40,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33169,1676599297588 2023-02-17 02:01:40,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40913,1676599297651 2023-02-17 02:01:40,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 02:01:40,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-17 02:01:40,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33169,1676599297588 2023-02-17 02:01:40,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40913,1676599297651 2023-02-17 02:01:40,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,33169,1676599297588': 2023-02-17 02:01:40,722 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33169,1676599297588' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-17 02:01:40,722 INFO [(jenkins-hbase4.apache.org,44147,1676599297546)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-17 02:01:40,722 DEBUG [(jenkins-hbase4.apache.org,44147,1676599297546)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-17 02:01:40,722 DEBUG [(jenkins-hbase4.apache.org,44147,1676599297546)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-17 02:01:40,723 DEBUG [(jenkins-hbase4.apache.org,44147,1676599297546)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-17 02:01:40,723 INFO [(jenkins-hbase4.apache.org,44147,1676599297546)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-17 02:01:40,724 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-17 02:01:40,724 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): regionserver:40913-0x1006002efba0002, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-17 02:01:40,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-17 02:01:40,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 02:01:40,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-17 02:01:40,724 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-17 02:01:40,724 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): regionserver:40913-0x1006002efba0002, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 02:01:40,724 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): regionserver:33169-0x1006002efba0001, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-17 02:01:40,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-17 02:01:40,724 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-17 02:01:40,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-17 02:01:40,724 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): regionserver:33169-0x1006002efba0001, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 02:01:40,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 02:01:40,725 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 02:01:40,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 02:01:40,725 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 02:01:40,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-17 02:01:40,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 02:01:40,725 DEBUG [(jenkins-hbase4.apache.org,44147,1676599297546)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33169,1676599297588 2023-02-17 02:01:40,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-17 02:01:40,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 02:01:40,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-17 02:01:40,725 DEBUG [(jenkins-hbase4.apache.org,44147,1676599297546)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40913,1676599297651 2023-02-17 02:01:40,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-17 02:01:40,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33169,1676599297588 2023-02-17 02:01:40,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40913,1676599297651 2023-02-17 02:01:40,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 02:01:40,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-17 02:01:40,727 DEBUG [(jenkins-hbase4.apache.org,44147,1676599297546)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33169,1676599297588 2023-02-17 02:01:40,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33169,1676599297588 2023-02-17 02:01:40,727 DEBUG [(jenkins-hbase4.apache.org,44147,1676599297546)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40913,1676599297651 2023-02-17 02:01:40,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40913,1676599297651 2023-02-17 02:01:40,734 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): regionserver:33169-0x1006002efba0001, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 02:01:40,734 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): regionserver:40913-0x1006002efba0002, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 02:01:40,734 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): regionserver:33169-0x1006002efba0001, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 02:01:40,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 02:01:40,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 02:01:40,734 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): regionserver:40913-0x1006002efba0002, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 02:01:40,734 DEBUG [(jenkins-hbase4.apache.org,44147,1676599297546)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 02:01:40,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 02:01:40,734 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40913,1676599297651 2023-02-17 02:01:40,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 02:01:40,734 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceMultiRegion 2023-02-17 02:01:40,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 02:01:40,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 02:01:40,734 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-17 02:01:40,734 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceMultiRegion 2023-02-17 02:01:40,734 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33169,1676599297588 2023-02-17 02:01:40,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 02:01:40,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 02:01:40,734 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-17 02:01:40,735 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40913,1676599297651 2023-02-17 02:01:40,735 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-17 02:01:40,735 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33169,1676599297588 2023-02-17 02:01:40,735 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-17 02:01:40,735 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-17 02:01:40,735 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-17 02:01:40,765 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion to hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.hbase-snapshot/testWithMockedMapReduceMultiRegion 2023-02-17 02:01:40,782 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed 2023-02-17 02:01:40,782 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-17 02:01:40,782 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-17 02:01:40,782 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion at 1676599300069Consolidate snapshot: testWithMockedMapReduceMultiRegion at 1676599300734 (+665 ms)Loading Region manifests for testWithMockedMapReduceMultiRegion at 1676599300734Writing data manifest for testWithMockedMapReduceMultiRegion at 1676599300744 (+10 ms)Verifying snapshot: testWithMockedMapReduceMultiRegion at 1676599300751 (+7 ms)Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed at 1676599300782 (+31 ms) 2023-02-17 02:01:40,784 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-17 02:01:40,785 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED in 713 msec 2023-02-17 02:01:41,178 DEBUG [Listener at localhost/42831] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-17 02:01:41,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-17 02:01:41,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-17 02:01:41,179 INFO [Listener at localhost/42831] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-17 02:01:41,184 INFO [Listener at localhost/42831] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-17 02:01:41,191 INFO [Listener at localhost/42831] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-17 02:01:41,218 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40913] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6084 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676599299314.7080b20bafef3fcca7e77fb1564444dc. 2023-02-17 02:01:41,228 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33169] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 11492 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1676599299314.e59273498db883c4fe992b5078a4292b. 2023-02-17 02:01:41,297 INFO [Listener at localhost/42831] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-17 02:01:41,305 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-17 02:01:41,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-17 02:01:41,307 INFO [(jenkins-hbase4.apache.org,44147,1676599297546)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-17 02:01:41,307 DEBUG [(jenkins-hbase4.apache.org,44147,1676599297546)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-17 02:01:41,308 DEBUG [(jenkins-hbase4.apache.org,44147,1676599297546)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-17 02:01:41,308 DEBUG [(jenkins-hbase4.apache.org,44147,1676599297546)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-17 02:01:41,309 DEBUG [(jenkins-hbase4.apache.org,44147,1676599297546)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-17 02:01:41,309 DEBUG [(jenkins-hbase4.apache.org,44147,1676599297546)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-17 02:01:41,311 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): regionserver:33169-0x1006002efba0001, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 02:01:41,311 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): regionserver:40913-0x1006002efba0002, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 02:01:41,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 02:01:41,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 02:01:41,311 DEBUG [(jenkins-hbase4.apache.org,44147,1676599297546)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33169,1676599297588 2023-02-17 02:01:41,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 02:01:41,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 02:01:41,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-17 02:01:41,312 DEBUG [(jenkins-hbase4.apache.org,44147,1676599297546)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33169,1676599297588 2023-02-17 02:01:41,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-17 02:01:41,312 DEBUG [(jenkins-hbase4.apache.org,44147,1676599297546)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40913,1676599297651 2023-02-17 02:01:41,312 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33169-0x1006002efba0001, quorum=127.0.0.1:49216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-17 02:01:41,312 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40913-0x1006002efba0002, quorum=127.0.0.1:49216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-17 02:01:41,312 DEBUG [(jenkins-hbase4.apache.org,44147,1676599297546)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40913,1676599297651 2023-02-17 02:01:41,312 DEBUG [(jenkins-hbase4.apache.org,44147,1676599297546)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-17 02:01:41,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-17 02:01:41,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-17 02:01:41,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-17 02:01:41,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-17 02:01:41,313 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-17 02:01:41,313 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-17 02:01:41,313 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-17 02:01:41,313 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-17 02:01:41,313 DEBUG [member: 'jenkins-hbase4.apache.org,40913,1676599297651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-17 02:01:41,313 DEBUG [member: 'jenkins-hbase4.apache.org,40913,1676599297651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-17 02:01:41,313 DEBUG [member: 'jenkins-hbase4.apache.org,33169,1676599297588' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-17 02:01:41,314 DEBUG [member: 'jenkins-hbase4.apache.org,33169,1676599297588' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-17 02:01:41,314 DEBUG [member: 'jenkins-hbase4.apache.org,40913,1676599297651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-17 02:01:41,315 DEBUG [member: 'jenkins-hbase4.apache.org,33169,1676599297588' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-17 02:01:41,315 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676599299314.21311936f3c5e2464085c015fcb59dc0. 2023-02-17 02:01:41,315 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,q\x11\x10,1676599299314.21311936f3c5e2464085c015fcb59dc0. started... 2023-02-17 02:01:41,315 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,wWV,1676599299314.14f2c512e529cbb9d6867ebbf198fe39. 2023-02-17 02:01:41,315 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,wWV,1676599299314.14f2c512e529cbb9d6867ebbf198fe39. started... 2023-02-17 02:01:41,315 INFO [rs(jenkins-hbase4.apache.org,40913,1676599297651)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 21311936f3c5e2464085c015fcb59dc0 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-17 02:01:41,315 INFO [rs(jenkins-hbase4.apache.org,33169,1676599297588)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 14f2c512e529cbb9d6867ebbf198fe39 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-17 02:01:41,316 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676599299314.7080b20bafef3fcca7e77fb1564444dc. 2023-02-17 02:01:41,316 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676599299314.7080b20bafef3fcca7e77fb1564444dc. started... 2023-02-17 02:01:41,316 INFO [rs(jenkins-hbase4.apache.org,40913,1676599297651)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 7080b20bafef3fcca7e77fb1564444dc 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-17 02:01:41,320 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,aaa,1676599299314.e59273498db883c4fe992b5078a4292b. 2023-02-17 02:01:41,320 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,aaa,1676599299314.e59273498db883c4fe992b5078a4292b. started... 2023-02-17 02:01:41,320 INFO [rs(jenkins-hbase4.apache.org,33169,1676599297588)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing e59273498db883c4fe992b5078a4292b 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-17 02:01:41,328 DEBUG [member: 'jenkins-hbase4.apache.org,33169,1676599297588' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-17 02:01:41,328 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676599299314.c691d9a9a766414e01e1a5d1e977f7ef. 2023-02-17 02:01:41,340 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,,1676599299314.033e5165635b9ba2e8fffe93154e637e. 2023-02-17 02:01:41,341 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,,1676599299314.033e5165635b9ba2e8fffe93154e637e. started... 2023-02-17 02:01:41,340 DEBUG [member: 'jenkins-hbase4.apache.org,40913,1676599297651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-17 02:01:41,341 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 033e5165635b9ba2e8fffe93154e637e: 2023-02-17 02:01:41,341 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,,1676599299314.033e5165635b9ba2e8fffe93154e637e. 2023-02-17 02:01:41,328 DEBUG [member: 'jenkins-hbase4.apache.org,33169,1676599297588' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-17 02:01:41,341 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,zz{,1676599299314.76c704a666ea47c826747b29fb61b262. 2023-02-17 02:01:41,341 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,zz{,1676599299314.76c704a666ea47c826747b29fb61b262. started... 2023-02-17 02:01:41,341 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 76c704a666ea47c826747b29fb61b262: 2023-02-17 02:01:41,341 DEBUG [member: 'jenkins-hbase4.apache.org,40913,1676599297651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-17 02:01:41,341 DEBUG [member: 'jenkins-hbase4.apache.org,40913,1676599297651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-17 02:01:41,340 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676599299314.c691d9a9a766414e01e1a5d1e977f7ef. started... 2023-02-17 02:01:41,341 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,zz{,1676599299314.76c704a666ea47c826747b29fb61b262. 2023-02-17 02:01:41,342 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676599299314.6b374f0b5a440ed43ee4cdab132cd165. 2023-02-17 02:01:41,342 DEBUG [member: 'jenkins-hbase4.apache.org,40913,1676599297651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-17 02:01:41,342 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,m\xED\xED,1676599299314.6b374f0b5a440ed43ee4cdab132cd165. started... 2023-02-17 02:01:41,342 INFO [rs(jenkins-hbase4.apache.org,40913,1676599297651)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 6b374f0b5a440ed43ee4cdab132cd165 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-17 02:01:41,342 INFO [rs(jenkins-hbase4.apache.org,33169,1676599297588)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing c691d9a9a766414e01e1a5d1e977f7ef 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-17 02:01:41,388 INFO [rs(jenkins-hbase4.apache.org,40913,1676599297651)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/21311936f3c5e2464085c015fcb59dc0/.tmp/f1/eeb694a439a04f429d6a5867600bcb21 2023-02-17 02:01:41,401 INFO [rs(jenkins-hbase4.apache.org,33169,1676599297588)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/c691d9a9a766414e01e1a5d1e977f7ef/.tmp/f1/7bb204714ca64fb0bdda5213d751b397 2023-02-17 02:01:41,405 INFO [rs(jenkins-hbase4.apache.org,33169,1676599297588)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/14f2c512e529cbb9d6867ebbf198fe39/.tmp/f1/a3f7d54f085f4e45a89049a95f9b9636 2023-02-17 02:01:41,408 INFO [rs(jenkins-hbase4.apache.org,33169,1676599297588)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/e59273498db883c4fe992b5078a4292b/.tmp/f1/3f2b693199834e449a362a11772a952d 2023-02-17 02:01:41,413 INFO [rs(jenkins-hbase4.apache.org,40913,1676599297651)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/7080b20bafef3fcca7e77fb1564444dc/.tmp/f1/a93bfbe028cd4051b7c93e254c5e0879 2023-02-17 02:01:41,432 INFO [rs(jenkins-hbase4.apache.org,40913,1676599297651)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/6b374f0b5a440ed43ee4cdab132cd165/.tmp/f1/2f8e5709d7fb49bfab4dace6f4d8084a 2023-02-17 02:01:41,465 INFO [rs(jenkins-hbase4.apache.org,40913,1676599297651)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/21311936f3c5e2464085c015fcb59dc0/.tmp/f2/2cbb9bd16d80444d8a670bff63832515 2023-02-17 02:01:41,467 INFO [rs(jenkins-hbase4.apache.org,33169,1676599297588)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/c691d9a9a766414e01e1a5d1e977f7ef/.tmp/f2/1fa85784b2ca41fb9490f4b68ce4c94e 2023-02-17 02:01:41,472 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/21311936f3c5e2464085c015fcb59dc0/.tmp/f1/eeb694a439a04f429d6a5867600bcb21 as hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/21311936f3c5e2464085c015fcb59dc0/f1/eeb694a439a04f429d6a5867600bcb21 2023-02-17 02:01:41,472 INFO [rs(jenkins-hbase4.apache.org,40913,1676599297651)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/7080b20bafef3fcca7e77fb1564444dc/.tmp/f2/a41a42f58aa6425c8295c530473f7116 2023-02-17 02:01:41,475 INFO [rs(jenkins-hbase4.apache.org,33169,1676599297588)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/14f2c512e529cbb9d6867ebbf198fe39/.tmp/f2/2621c32192244d74b076facaa42807a4 2023-02-17 02:01:41,475 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/c691d9a9a766414e01e1a5d1e977f7ef/.tmp/f1/7bb204714ca64fb0bdda5213d751b397 as hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/c691d9a9a766414e01e1a5d1e977f7ef/f1/7bb204714ca64fb0bdda5213d751b397 2023-02-17 02:01:41,478 INFO [rs(jenkins-hbase4.apache.org,40913,1676599297651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/21311936f3c5e2464085c015fcb59dc0/f1/eeb694a439a04f429d6a5867600bcb21, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 02:01:41,479 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/21311936f3c5e2464085c015fcb59dc0/.tmp/f2/2cbb9bd16d80444d8a670bff63832515 as hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/21311936f3c5e2464085c015fcb59dc0/f2/2cbb9bd16d80444d8a670bff63832515 2023-02-17 02:01:41,479 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/7080b20bafef3fcca7e77fb1564444dc/.tmp/f1/a93bfbe028cd4051b7c93e254c5e0879 as hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/7080b20bafef3fcca7e77fb1564444dc/f1/a93bfbe028cd4051b7c93e254c5e0879 2023-02-17 02:01:41,480 INFO [rs(jenkins-hbase4.apache.org,33169,1676599297588)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/c691d9a9a766414e01e1a5d1e977f7ef/f1/7bb204714ca64fb0bdda5213d751b397, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 02:01:41,481 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/14f2c512e529cbb9d6867ebbf198fe39/.tmp/f1/a3f7d54f085f4e45a89049a95f9b9636 as hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/14f2c512e529cbb9d6867ebbf198fe39/f1/a3f7d54f085f4e45a89049a95f9b9636 2023-02-17 02:01:41,481 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/c691d9a9a766414e01e1a5d1e977f7ef/.tmp/f2/1fa85784b2ca41fb9490f4b68ce4c94e as hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/c691d9a9a766414e01e1a5d1e977f7ef/f2/1fa85784b2ca41fb9490f4b68ce4c94e 2023-02-17 02:01:41,485 INFO [rs(jenkins-hbase4.apache.org,40913,1676599297651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/21311936f3c5e2464085c015fcb59dc0/f2/2cbb9bd16d80444d8a670bff63832515, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 02:01:41,485 INFO [rs(jenkins-hbase4.apache.org,40913,1676599297651)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/7080b20bafef3fcca7e77fb1564444dc/f1/a93bfbe028cd4051b7c93e254c5e0879, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 02:01:41,486 INFO [rs(jenkins-hbase4.apache.org,40913,1676599297651)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 21311936f3c5e2464085c015fcb59dc0 in 171ms, sequenceid=9, compaction requested=false 2023-02-17 02:01:41,486 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/7080b20bafef3fcca7e77fb1564444dc/.tmp/f2/a41a42f58aa6425c8295c530473f7116 as hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/7080b20bafef3fcca7e77fb1564444dc/f2/a41a42f58aa6425c8295c530473f7116 2023-02-17 02:01:41,486 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 21311936f3c5e2464085c015fcb59dc0: 2023-02-17 02:01:41,486 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676599299314.21311936f3c5e2464085c015fcb59dc0. 2023-02-17 02:01:41,486 DEBUG [member: 'jenkins-hbase4.apache.org,40913,1676599297651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-17 02:01:41,486 INFO [rs(jenkins-hbase4.apache.org,33169,1676599297588)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/c691d9a9a766414e01e1a5d1e977f7ef/f2/1fa85784b2ca41fb9490f4b68ce4c94e, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 02:01:41,487 INFO [rs(jenkins-hbase4.apache.org,33169,1676599297588)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for c691d9a9a766414e01e1a5d1e977f7ef in 145ms, sequenceid=9, compaction requested=false 2023-02-17 02:01:41,487 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for c691d9a9a766414e01e1a5d1e977f7ef: 2023-02-17 02:01:41,487 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676599299314.c691d9a9a766414e01e1a5d1e977f7ef. 2023-02-17 02:01:41,488 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676599299314.d34d6d8b8aee836a577ebac64f77206e. 2023-02-17 02:01:41,488 DEBUG [member: 'jenkins-hbase4.apache.org,33169,1676599297588' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-17 02:01:41,488 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,d\x84\x84,1676599299314.d34d6d8b8aee836a577ebac64f77206e. started... 2023-02-17 02:01:41,488 INFO [rs(jenkins-hbase4.apache.org,33169,1676599297588)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing d34d6d8b8aee836a577ebac64f77206e 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-17 02:01:41,491 INFO [rs(jenkins-hbase4.apache.org,33169,1676599297588)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/14f2c512e529cbb9d6867ebbf198fe39/f1/a3f7d54f085f4e45a89049a95f9b9636, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-17 02:01:41,493 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/14f2c512e529cbb9d6867ebbf198fe39/.tmp/f2/2621c32192244d74b076facaa42807a4 as hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/14f2c512e529cbb9d6867ebbf198fe39/f2/2621c32192244d74b076facaa42807a4 2023-02-17 02:01:41,493 INFO [rs(jenkins-hbase4.apache.org,40913,1676599297651)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/7080b20bafef3fcca7e77fb1564444dc/f2/a41a42f58aa6425c8295c530473f7116, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 02:01:41,494 INFO [rs(jenkins-hbase4.apache.org,40913,1676599297651)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 7080b20bafef3fcca7e77fb1564444dc in 178ms, sequenceid=9, compaction requested=false 2023-02-17 02:01:41,494 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 7080b20bafef3fcca7e77fb1564444dc: 2023-02-17 02:01:41,494 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676599299314.7080b20bafef3fcca7e77fb1564444dc. 2023-02-17 02:01:41,495 DEBUG [member: 'jenkins-hbase4.apache.org,40913,1676599297651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-17 02:01:41,496 INFO [rs(jenkins-hbase4.apache.org,33169,1676599297588)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/e59273498db883c4fe992b5078a4292b/.tmp/f2/ec0ef30c275c4975b46cc4fcafc317d1 2023-02-17 02:01:41,499 INFO [rs(jenkins-hbase4.apache.org,33169,1676599297588)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/14f2c512e529cbb9d6867ebbf198fe39/f2/2621c32192244d74b076facaa42807a4, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-17 02:01:41,500 INFO [rs(jenkins-hbase4.apache.org,40913,1676599297651)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/6b374f0b5a440ed43ee4cdab132cd165/.tmp/f2/c1db5d251c37406d862662f17457cc20 2023-02-17 02:01:41,500 INFO [rs(jenkins-hbase4.apache.org,33169,1676599297588)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 14f2c512e529cbb9d6867ebbf198fe39 in 185ms, sequenceid=9, compaction requested=false 2023-02-17 02:01:41,500 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 14f2c512e529cbb9d6867ebbf198fe39: 2023-02-17 02:01:41,500 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,wWV,1676599299314.14f2c512e529cbb9d6867ebbf198fe39. 2023-02-17 02:01:41,500 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,t43,1676599299314.27286d7877e172b7626d8faac32266d5. 2023-02-17 02:01:41,500 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,t43,1676599299314.27286d7877e172b7626d8faac32266d5. started... 2023-02-17 02:01:41,500 DEBUG [member: 'jenkins-hbase4.apache.org,33169,1676599297588' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-17 02:01:41,500 INFO [rs(jenkins-hbase4.apache.org,33169,1676599297588)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 27286d7877e172b7626d8faac32266d5 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-17 02:01:41,504 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/e59273498db883c4fe992b5078a4292b/.tmp/f1/3f2b693199834e449a362a11772a952d as hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/e59273498db883c4fe992b5078a4292b/f1/3f2b693199834e449a362a11772a952d 2023-02-17 02:01:41,509 INFO [rs(jenkins-hbase4.apache.org,33169,1676599297588)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/e59273498db883c4fe992b5078a4292b/f1/3f2b693199834e449a362a11772a952d, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-17 02:01:41,510 INFO [rs(jenkins-hbase4.apache.org,33169,1676599297588)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/d34d6d8b8aee836a577ebac64f77206e/.tmp/f1/0ed6be2bf0694169b8e7133ed14a29a0 2023-02-17 02:01:41,510 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/e59273498db883c4fe992b5078a4292b/.tmp/f2/ec0ef30c275c4975b46cc4fcafc317d1 as hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/e59273498db883c4fe992b5078a4292b/f2/ec0ef30c275c4975b46cc4fcafc317d1 2023-02-17 02:01:41,511 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/6b374f0b5a440ed43ee4cdab132cd165/.tmp/f1/2f8e5709d7fb49bfab4dace6f4d8084a as hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/6b374f0b5a440ed43ee4cdab132cd165/f1/2f8e5709d7fb49bfab4dace6f4d8084a 2023-02-17 02:01:41,514 INFO [rs(jenkins-hbase4.apache.org,33169,1676599297588)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/27286d7877e172b7626d8faac32266d5/.tmp/f1/77ee731d4d9546dcb8e7dae87c05d7af 2023-02-17 02:01:41,516 INFO [rs(jenkins-hbase4.apache.org,40913,1676599297651)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/6b374f0b5a440ed43ee4cdab132cd165/f1/2f8e5709d7fb49bfab4dace6f4d8084a, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 02:01:41,516 INFO [rs(jenkins-hbase4.apache.org,33169,1676599297588)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/e59273498db883c4fe992b5078a4292b/f2/ec0ef30c275c4975b46cc4fcafc317d1, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-17 02:01:41,517 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/6b374f0b5a440ed43ee4cdab132cd165/.tmp/f2/c1db5d251c37406d862662f17457cc20 as hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/6b374f0b5a440ed43ee4cdab132cd165/f2/c1db5d251c37406d862662f17457cc20 2023-02-17 02:01:41,517 INFO [rs(jenkins-hbase4.apache.org,33169,1676599297588)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for e59273498db883c4fe992b5078a4292b in 197ms, sequenceid=9, compaction requested=false 2023-02-17 02:01:41,517 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for e59273498db883c4fe992b5078a4292b: 2023-02-17 02:01:41,517 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,aaa,1676599299314.e59273498db883c4fe992b5078a4292b. 2023-02-17 02:01:41,517 DEBUG [member: 'jenkins-hbase4.apache.org,33169,1676599297588' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-17 02:01:41,524 INFO [rs(jenkins-hbase4.apache.org,40913,1676599297651)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/6b374f0b5a440ed43ee4cdab132cd165/f2/c1db5d251c37406d862662f17457cc20, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 02:01:41,525 INFO [rs(jenkins-hbase4.apache.org,40913,1676599297651)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 6b374f0b5a440ed43ee4cdab132cd165 in 183ms, sequenceid=9, compaction requested=false 2023-02-17 02:01:41,525 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 6b374f0b5a440ed43ee4cdab132cd165: 2023-02-17 02:01:41,525 DEBUG [rs(jenkins-hbase4.apache.org,40913,1676599297651)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676599299314.6b374f0b5a440ed43ee4cdab132cd165. 2023-02-17 02:01:41,525 DEBUG [member: 'jenkins-hbase4.apache.org,40913,1676599297651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-17 02:01:41,525 DEBUG [member: 'jenkins-hbase4.apache.org,40913,1676599297651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-17 02:01:41,525 DEBUG [member: 'jenkins-hbase4.apache.org,40913,1676599297651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40913,1676599297651 2023-02-17 02:01:41,527 DEBUG [member: 'jenkins-hbase4.apache.org,40913,1676599297651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-17 02:01:41,527 DEBUG [member: 'jenkins-hbase4.apache.org,40913,1676599297651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40913,1676599297651' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-17 02:01:41,529 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40913,1676599297651 2023-02-17 02:01:41,529 DEBUG [member: 'jenkins-hbase4.apache.org,40913,1676599297651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-17 02:01:41,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40913,1676599297651 2023-02-17 02:01:41,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 02:01:41,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-17 02:01:41,529 DEBUG [member: 'jenkins-hbase4.apache.org,40913,1676599297651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40913-0x1006002efba0002, quorum=127.0.0.1:49216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-17 02:01:41,529 DEBUG [member: 'jenkins-hbase4.apache.org,40913,1676599297651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 02:01:41,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 02:01:41,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 02:01:41,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-17 02:01:41,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40913,1676599297651 2023-02-17 02:01:41,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 02:01:41,531 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40913,1676599297651' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-17 02:01:41,531 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@307e6018[Count = 1] remaining members to acquire global barrier 2023-02-17 02:01:41,535 INFO [rs(jenkins-hbase4.apache.org,33169,1676599297588)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/d34d6d8b8aee836a577ebac64f77206e/.tmp/f2/e75efa8fd7214151953e4467e101fb5d 2023-02-17 02:01:41,535 INFO [rs(jenkins-hbase4.apache.org,33169,1676599297588)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/27286d7877e172b7626d8faac32266d5/.tmp/f2/40a73e218a09463187b4f7383b5448b5 2023-02-17 02:01:41,543 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/d34d6d8b8aee836a577ebac64f77206e/.tmp/f1/0ed6be2bf0694169b8e7133ed14a29a0 as hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/d34d6d8b8aee836a577ebac64f77206e/f1/0ed6be2bf0694169b8e7133ed14a29a0 2023-02-17 02:01:41,543 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/27286d7877e172b7626d8faac32266d5/.tmp/f1/77ee731d4d9546dcb8e7dae87c05d7af as hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/27286d7877e172b7626d8faac32266d5/f1/77ee731d4d9546dcb8e7dae87c05d7af 2023-02-17 02:01:41,547 INFO [rs(jenkins-hbase4.apache.org,33169,1676599297588)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/d34d6d8b8aee836a577ebac64f77206e/f1/0ed6be2bf0694169b8e7133ed14a29a0, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 02:01:41,548 INFO [rs(jenkins-hbase4.apache.org,33169,1676599297588)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/27286d7877e172b7626d8faac32266d5/f1/77ee731d4d9546dcb8e7dae87c05d7af, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 02:01:41,549 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/d34d6d8b8aee836a577ebac64f77206e/.tmp/f2/e75efa8fd7214151953e4467e101fb5d as hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/d34d6d8b8aee836a577ebac64f77206e/f2/e75efa8fd7214151953e4467e101fb5d 2023-02-17 02:01:41,549 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/27286d7877e172b7626d8faac32266d5/.tmp/f2/40a73e218a09463187b4f7383b5448b5 as hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/27286d7877e172b7626d8faac32266d5/f2/40a73e218a09463187b4f7383b5448b5 2023-02-17 02:01:41,555 INFO [rs(jenkins-hbase4.apache.org,33169,1676599297588)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/27286d7877e172b7626d8faac32266d5/f2/40a73e218a09463187b4f7383b5448b5, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 02:01:41,555 INFO [rs(jenkins-hbase4.apache.org,33169,1676599297588)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/d34d6d8b8aee836a577ebac64f77206e/f2/e75efa8fd7214151953e4467e101fb5d, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 02:01:41,555 INFO [rs(jenkins-hbase4.apache.org,33169,1676599297588)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 27286d7877e172b7626d8faac32266d5 in 55ms, sequenceid=9, compaction requested=false 2023-02-17 02:01:41,556 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 27286d7877e172b7626d8faac32266d5: 2023-02-17 02:01:41,556 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,t43,1676599299314.27286d7877e172b7626d8faac32266d5. 2023-02-17 02:01:41,556 DEBUG [member: 'jenkins-hbase4.apache.org,33169,1676599297588' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-17 02:01:41,556 INFO [rs(jenkins-hbase4.apache.org,33169,1676599297588)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for d34d6d8b8aee836a577ebac64f77206e in 68ms, sequenceid=9, compaction requested=false 2023-02-17 02:01:41,556 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for d34d6d8b8aee836a577ebac64f77206e: 2023-02-17 02:01:41,556 DEBUG [rs(jenkins-hbase4.apache.org,33169,1676599297588)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676599299314.d34d6d8b8aee836a577ebac64f77206e. 2023-02-17 02:01:41,556 DEBUG [member: 'jenkins-hbase4.apache.org,33169,1676599297588' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-17 02:01:41,556 DEBUG [member: 'jenkins-hbase4.apache.org,33169,1676599297588' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-17 02:01:41,556 DEBUG [member: 'jenkins-hbase4.apache.org,33169,1676599297588' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,33169,1676599297588 2023-02-17 02:01:41,556 DEBUG [member: 'jenkins-hbase4.apache.org,33169,1676599297588' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-17 02:01:41,556 DEBUG [member: 'jenkins-hbase4.apache.org,33169,1676599297588' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33169,1676599297588' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-17 02:01:41,559 DEBUG [member: 'jenkins-hbase4.apache.org,33169,1676599297588' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-17 02:01:41,559 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33169,1676599297588 2023-02-17 02:01:41,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33169,1676599297588 2023-02-17 02:01:41,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 02:01:41,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-17 02:01:41,560 DEBUG [member: 'jenkins-hbase4.apache.org,33169,1676599297588' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33169-0x1006002efba0001, quorum=127.0.0.1:49216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-17 02:01:41,560 DEBUG [member: 'jenkins-hbase4.apache.org,33169,1676599297588' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 02:01:41,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 02:01:41,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 02:01:41,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-17 02:01:41,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33169,1676599297588 2023-02-17 02:01:41,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40913,1676599297651 2023-02-17 02:01:41,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 02:01:41,562 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33169,1676599297588' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-17 02:01:41,562 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@307e6018[Count = 0] remaining members to acquire global barrier 2023-02-17 02:01:41,562 DEBUG [(jenkins-hbase4.apache.org,44147,1676599297546)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-17 02:01:41,562 DEBUG [(jenkins-hbase4.apache.org,44147,1676599297546)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-17 02:01:41,564 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): regionserver:33169-0x1006002efba0001, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-17 02:01:41,564 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): regionserver:40913-0x1006002efba0002, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-17 02:01:41,564 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-17 02:01:41,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-17 02:01:41,564 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-17 02:01:41,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-17 02:01:41,564 DEBUG [member: 'jenkins-hbase4.apache.org,33169,1676599297588' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-17 02:01:41,564 DEBUG [member: 'jenkins-hbase4.apache.org,33169,1676599297588' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-17 02:01:41,564 DEBUG [member: 'jenkins-hbase4.apache.org,40913,1676599297651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-17 02:01:41,564 DEBUG [member: 'jenkins-hbase4.apache.org,40913,1676599297651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-17 02:01:41,564 DEBUG [(jenkins-hbase4.apache.org,44147,1676599297546)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40913,1676599297651 2023-02-17 02:01:41,564 DEBUG [member: 'jenkins-hbase4.apache.org,40913,1676599297651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,40913,1676599297651' in zk 2023-02-17 02:01:41,564 DEBUG [member: 'jenkins-hbase4.apache.org,33169,1676599297588' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,33169,1676599297588' in zk 2023-02-17 02:01:41,564 DEBUG [(jenkins-hbase4.apache.org,44147,1676599297546)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33169,1676599297588 2023-02-17 02:01:41,564 DEBUG [(jenkins-hbase4.apache.org,44147,1676599297546)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-17 02:01:41,566 DEBUG [member: 'jenkins-hbase4.apache.org,40913,1676599297651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-17 02:01:41,566 DEBUG [member: 'jenkins-hbase4.apache.org,40913,1676599297651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 02:01:41,566 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40913,1676599297651 2023-02-17 02:01:41,566 DEBUG [member: 'jenkins-hbase4.apache.org,40913,1676599297651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-17 02:01:41,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40913,1676599297651 2023-02-17 02:01:41,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 02:01:41,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-17 02:01:41,572 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33169,1676599297588 2023-02-17 02:01:41,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 02:01:41,572 DEBUG [member: 'jenkins-hbase4.apache.org,33169,1676599297588' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-17 02:01:41,572 DEBUG [member: 'jenkins-hbase4.apache.org,33169,1676599297588' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 02:01:41,572 DEBUG [member: 'jenkins-hbase4.apache.org,33169,1676599297588' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-17 02:01:41,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 02:01:41,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-17 02:01:41,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33169,1676599297588 2023-02-17 02:01:41,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40913,1676599297651 2023-02-17 02:01:41,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 02:01:41,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-17 02:01:41,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33169,1676599297588 2023-02-17 02:01:41,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40913,1676599297651 2023-02-17 02:01:41,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,40913,1676599297651': 2023-02-17 02:01:41,575 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40913,1676599297651' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-17 02:01:41,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33169,1676599297588 2023-02-17 02:01:41,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 02:01:41,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-17 02:01:41,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 02:01:41,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 02:01:41,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-17 02:01:41,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33169,1676599297588 2023-02-17 02:01:41,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40913,1676599297651 2023-02-17 02:01:41,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 02:01:41,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-17 02:01:41,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33169,1676599297588 2023-02-17 02:01:41,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40913,1676599297651 2023-02-17 02:01:41,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,33169,1676599297588': 2023-02-17 02:01:41,578 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33169,1676599297588' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-17 02:01:41,578 INFO [(jenkins-hbase4.apache.org,44147,1676599297546)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-17 02:01:41,578 DEBUG [(jenkins-hbase4.apache.org,44147,1676599297546)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-17 02:01:41,578 DEBUG [(jenkins-hbase4.apache.org,44147,1676599297546)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-17 02:01:41,578 DEBUG [(jenkins-hbase4.apache.org,44147,1676599297546)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-17 02:01:41,578 INFO [(jenkins-hbase4.apache.org,44147,1676599297546)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-17 02:01:41,580 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-17 02:01:41,580 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): regionserver:33169-0x1006002efba0001, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-17 02:01:41,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-17 02:01:41,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-17 02:01:41,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 02:01:41,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-17 02:01:41,580 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): regionserver:33169-0x1006002efba0001, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 02:01:41,580 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): regionserver:40913-0x1006002efba0002, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-17 02:01:41,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-17 02:01:41,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-17 02:01:41,580 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): regionserver:40913-0x1006002efba0002, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 02:01:41,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-17 02:01:41,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 02:01:41,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 02:01:41,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 02:01:41,580 DEBUG [(jenkins-hbase4.apache.org,44147,1676599297546)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33169,1676599297588 2023-02-17 02:01:41,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 02:01:41,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-17 02:01:41,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 02:01:41,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-17 02:01:41,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-17 02:01:41,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 02:01:41,582 DEBUG [(jenkins-hbase4.apache.org,44147,1676599297546)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40913,1676599297651 2023-02-17 02:01:41,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-17 02:01:41,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33169,1676599297588 2023-02-17 02:01:41,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40913,1676599297651 2023-02-17 02:01:41,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 02:01:41,583 DEBUG [(jenkins-hbase4.apache.org,44147,1676599297546)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33169,1676599297588 2023-02-17 02:01:41,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-17 02:01:41,584 DEBUG [(jenkins-hbase4.apache.org,44147,1676599297546)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40913,1676599297651 2023-02-17 02:01:41,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33169,1676599297588 2023-02-17 02:01:41,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40913,1676599297651 2023-02-17 02:01:41,587 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40913,1676599297651 2023-02-17 02:01:41,588 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-17 02:01:41,588 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): regionserver:40913-0x1006002efba0002, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 02:01:41,588 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33169,1676599297588 2023-02-17 02:01:41,588 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): regionserver:40913-0x1006002efba0002, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 02:01:41,588 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-17 02:01:41,588 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40913,1676599297651 2023-02-17 02:01:41,588 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): regionserver:33169-0x1006002efba0001, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 02:01:41,588 DEBUG [(jenkins-hbase4.apache.org,44147,1676599297546)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 02:01:41,588 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 02:01:41,588 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): regionserver:33169-0x1006002efba0001, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 02:01:41,588 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceMultiRegion' 2023-02-17 02:01:41,588 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-17 02:01:41,588 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-17 02:01:41,588 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 02:01:41,588 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33169,1676599297588 2023-02-17 02:01:41,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 02:01:41,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 02:01:41,588 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-17 02:01:41,588 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-17 02:01:41,588 DEBUG [Listener at localhost/42831] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceMultiRegion'' to complete. (max 20000 ms per retry) 2023-02-17 02:01:41,589 DEBUG [Listener at localhost/42831] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-17 02:01:41,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 02:01:41,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 02:01:41,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 02:01:41,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 02:01:41,689 DEBUG [Listener at localhost/42831] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-17 02:01:41,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-17 02:01:41,695 INFO [Listener at localhost/42831] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1676599300055 type: FLUSH version: 2 ttl: 0 2023-02-17 02:01:41,695 DEBUG [Listener at localhost/42831] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:33493/user/jenkins/test-data/5842bbf8-60c5-814f-4a3e-f0f7b45dd79c/testWithMockedMapReduceMultiRegion/9a723ec3-5756-4f17-9ede-95b38c19a420/data/default/testWithMockedMapReduceMultiRegion 2023-02-17 02:01:41,695 INFO [Listener at localhost/42831] snapshot.RestoreSnapshotHelper(239): region to add: 14f2c512e529cbb9d6867ebbf198fe39 2023-02-17 02:01:41,695 INFO [Listener at localhost/42831] snapshot.RestoreSnapshotHelper(239): region to add: e59273498db883c4fe992b5078a4292b 2023-02-17 02:01:41,695 INFO [Listener at localhost/42831] snapshot.RestoreSnapshotHelper(239): region to add: 21311936f3c5e2464085c015fcb59dc0 2023-02-17 02:01:41,695 INFO [Listener at localhost/42831] snapshot.RestoreSnapshotHelper(239): region to add: c691d9a9a766414e01e1a5d1e977f7ef 2023-02-17 02:01:41,695 INFO [Listener at localhost/42831] snapshot.RestoreSnapshotHelper(239): region to add: d34d6d8b8aee836a577ebac64f77206e 2023-02-17 02:01:41,695 INFO [Listener at localhost/42831] snapshot.RestoreSnapshotHelper(239): region to add: 7080b20bafef3fcca7e77fb1564444dc 2023-02-17 02:01:41,695 INFO [Listener at localhost/42831] snapshot.RestoreSnapshotHelper(239): region to add: 76c704a666ea47c826747b29fb61b262 2023-02-17 02:01:41,695 INFO [Listener at localhost/42831] snapshot.RestoreSnapshotHelper(239): region to add: 033e5165635b9ba2e8fffe93154e637e 2023-02-17 02:01:41,696 INFO [Listener at localhost/42831] snapshot.RestoreSnapshotHelper(239): region to add: 27286d7877e172b7626d8faac32266d5 2023-02-17 02:01:41,696 INFO [Listener at localhost/42831] snapshot.RestoreSnapshotHelper(239): region to add: 6b374f0b5a440ed43ee4cdab132cd165 2023-02-17 02:01:41,696 INFO [Listener at localhost/42831] snapshot.RestoreSnapshotHelper(585): clone region=14f2c512e529cbb9d6867ebbf198fe39 as 14f2c512e529cbb9d6867ebbf198fe39 in snapshot testWithMockedMapReduceMultiRegion 2023-02-17 02:01:41,696 INFO [Listener at localhost/42831] snapshot.RestoreSnapshotHelper(585): clone region=e59273498db883c4fe992b5078a4292b as e59273498db883c4fe992b5078a4292b in snapshot testWithMockedMapReduceMultiRegion 2023-02-17 02:01:41,696 INFO [Listener at localhost/42831] snapshot.RestoreSnapshotHelper(585): clone region=21311936f3c5e2464085c015fcb59dc0 as 21311936f3c5e2464085c015fcb59dc0 in snapshot testWithMockedMapReduceMultiRegion 2023-02-17 02:01:41,696 INFO [Listener at localhost/42831] snapshot.RestoreSnapshotHelper(585): clone region=c691d9a9a766414e01e1a5d1e977f7ef as c691d9a9a766414e01e1a5d1e977f7ef in snapshot testWithMockedMapReduceMultiRegion 2023-02-17 02:01:41,696 INFO [Listener at localhost/42831] snapshot.RestoreSnapshotHelper(585): clone region=d34d6d8b8aee836a577ebac64f77206e as d34d6d8b8aee836a577ebac64f77206e in snapshot testWithMockedMapReduceMultiRegion 2023-02-17 02:01:41,696 INFO [Listener at localhost/42831] snapshot.RestoreSnapshotHelper(585): clone region=7080b20bafef3fcca7e77fb1564444dc as 7080b20bafef3fcca7e77fb1564444dc in snapshot testWithMockedMapReduceMultiRegion 2023-02-17 02:01:41,696 INFO [Listener at localhost/42831] snapshot.RestoreSnapshotHelper(585): clone region=76c704a666ea47c826747b29fb61b262 as 76c704a666ea47c826747b29fb61b262 in snapshot testWithMockedMapReduceMultiRegion 2023-02-17 02:01:41,696 INFO [Listener at localhost/42831] snapshot.RestoreSnapshotHelper(585): clone region=033e5165635b9ba2e8fffe93154e637e as 033e5165635b9ba2e8fffe93154e637e in snapshot testWithMockedMapReduceMultiRegion 2023-02-17 02:01:41,696 INFO [Listener at localhost/42831] snapshot.RestoreSnapshotHelper(585): clone region=27286d7877e172b7626d8faac32266d5 as 27286d7877e172b7626d8faac32266d5 in snapshot testWithMockedMapReduceMultiRegion 2023-02-17 02:01:41,696 INFO [Listener at localhost/42831] snapshot.RestoreSnapshotHelper(585): clone region=6b374f0b5a440ed43ee4cdab132cd165 as 6b374f0b5a440ed43ee4cdab132cd165 in snapshot testWithMockedMapReduceMultiRegion 2023-02-17 02:01:41,705 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 21311936f3c5e2464085c015fcb59dc0, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676599299314.21311936f3c5e2464085c015fcb59dc0.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33493/user/jenkins/test-data/5842bbf8-60c5-814f-4a3e-f0f7b45dd79c/testWithMockedMapReduceMultiRegion/9a723ec3-5756-4f17-9ede-95b38c19a420 2023-02-17 02:01:41,706 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => e59273498db883c4fe992b5078a4292b, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676599299314.e59273498db883c4fe992b5078a4292b.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33493/user/jenkins/test-data/5842bbf8-60c5-814f-4a3e-f0f7b45dd79c/testWithMockedMapReduceMultiRegion/9a723ec3-5756-4f17-9ede-95b38c19a420 2023-02-17 02:01:41,707 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 14f2c512e529cbb9d6867ebbf198fe39, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676599299314.14f2c512e529cbb9d6867ebbf198fe39.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33493/user/jenkins/test-data/5842bbf8-60c5-814f-4a3e-f0f7b45dd79c/testWithMockedMapReduceMultiRegion/9a723ec3-5756-4f17-9ede-95b38c19a420 2023-02-17 02:01:41,709 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 033e5165635b9ba2e8fffe93154e637e, NAME => 'testWithMockedMapReduceMultiRegion,,1676599299314.033e5165635b9ba2e8fffe93154e637e.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33493/user/jenkins/test-data/5842bbf8-60c5-814f-4a3e-f0f7b45dd79c/testWithMockedMapReduceMultiRegion/9a723ec3-5756-4f17-9ede-95b38c19a420 2023-02-17 02:01:41,709 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => c691d9a9a766414e01e1a5d1e977f7ef, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676599299314.c691d9a9a766414e01e1a5d1e977f7ef.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33493/user/jenkins/test-data/5842bbf8-60c5-814f-4a3e-f0f7b45dd79c/testWithMockedMapReduceMultiRegion/9a723ec3-5756-4f17-9ede-95b38c19a420 2023-02-17 02:01:41,709 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => d34d6d8b8aee836a577ebac64f77206e, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676599299314.d34d6d8b8aee836a577ebac64f77206e.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33493/user/jenkins/test-data/5842bbf8-60c5-814f-4a3e-f0f7b45dd79c/testWithMockedMapReduceMultiRegion/9a723ec3-5756-4f17-9ede-95b38c19a420 2023-02-17 02:01:41,710 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 7080b20bafef3fcca7e77fb1564444dc, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676599299314.7080b20bafef3fcca7e77fb1564444dc.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33493/user/jenkins/test-data/5842bbf8-60c5-814f-4a3e-f0f7b45dd79c/testWithMockedMapReduceMultiRegion/9a723ec3-5756-4f17-9ede-95b38c19a420 2023-02-17 02:01:41,712 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 76c704a666ea47c826747b29fb61b262, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676599299314.76c704a666ea47c826747b29fb61b262.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33493/user/jenkins/test-data/5842bbf8-60c5-814f-4a3e-f0f7b45dd79c/testWithMockedMapReduceMultiRegion/9a723ec3-5756-4f17-9ede-95b38c19a420 2023-02-17 02:01:41,766 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676599299314.e59273498db883c4fe992b5078a4292b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:41,766 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676599299314.033e5165635b9ba2e8fffe93154e637e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:41,766 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 7859f50f6bc7464ba81ed31b021042bc from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-17 02:01:41,766 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 033e5165635b9ba2e8fffe93154e637e, disabling compactions & flushes 2023-02-17 02:01:41,766 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676599299314.033e5165635b9ba2e8fffe93154e637e. 2023-02-17 02:01:41,766 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676599299314.033e5165635b9ba2e8fffe93154e637e. 2023-02-17 02:01:41,766 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676599299314.033e5165635b9ba2e8fffe93154e637e. after waiting 0 ms 2023-02-17 02:01:41,766 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676599299314.033e5165635b9ba2e8fffe93154e637e. 2023-02-17 02:01:41,766 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676599299314.033e5165635b9ba2e8fffe93154e637e. 2023-02-17 02:01:41,766 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 033e5165635b9ba2e8fffe93154e637e: 2023-02-17 02:01:41,767 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 27286d7877e172b7626d8faac32266d5, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676599299314.27286d7877e172b7626d8faac32266d5.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33493/user/jenkins/test-data/5842bbf8-60c5-814f-4a3e-f0f7b45dd79c/testWithMockedMapReduceMultiRegion/9a723ec3-5756-4f17-9ede-95b38c19a420 2023-02-17 02:01:41,766 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676599299314.14f2c512e529cbb9d6867ebbf198fe39.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:41,767 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 5fa203364e084b90b7dd58f7350af22a from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-17 02:01:41,772 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676599299314.d34d6d8b8aee836a577ebac64f77206e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:41,773 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676599299314.21311936f3c5e2464085c015fcb59dc0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:41,773 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink c998db2d8e68420ea00f02987c2a8019 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-17 02:01:41,773 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink eecf0269b9ae450f88e892cf69d0e0cf from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-17 02:01:41,773 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 1eca9fd903224bae93f53e7968116387 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-17 02:01:41,781 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d62d74424c98482f8468af99ea6c0a4f from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-17 02:01:41,783 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing e59273498db883c4fe992b5078a4292b, disabling compactions & flushes 2023-02-17 02:01:41,783 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676599299314.e59273498db883c4fe992b5078a4292b. 2023-02-17 02:01:41,783 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676599299314.e59273498db883c4fe992b5078a4292b. 2023-02-17 02:01:41,783 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676599299314.e59273498db883c4fe992b5078a4292b. after waiting 0 ms 2023-02-17 02:01:41,783 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676599299314.e59273498db883c4fe992b5078a4292b. 2023-02-17 02:01:41,784 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676599299314.e59273498db883c4fe992b5078a4292b. 2023-02-17 02:01:41,784 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for e59273498db883c4fe992b5078a4292b: 2023-02-17 02:01:41,784 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 6b374f0b5a440ed43ee4cdab132cd165, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676599299314.6b374f0b5a440ed43ee4cdab132cd165.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33493/user/jenkins/test-data/5842bbf8-60c5-814f-4a3e-f0f7b45dd79c/testWithMockedMapReduceMultiRegion/9a723ec3-5756-4f17-9ede-95b38c19a420 2023-02-17 02:01:41,785 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676599299314.7080b20bafef3fcca7e77fb1564444dc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:41,786 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink ab16a9abe6424f00872cdac7c4986916 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-17 02:01:41,791 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 1498be0e208e4dc5b9364280a44fff12 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-17 02:01:41,792 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink fc09d0ad57684cdfbef52e06095b34fa from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-17 02:01:41,793 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 14f2c512e529cbb9d6867ebbf198fe39, disabling compactions & flushes 2023-02-17 02:01:41,793 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676599299314.14f2c512e529cbb9d6867ebbf198fe39. 2023-02-17 02:01:41,793 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676599299314.14f2c512e529cbb9d6867ebbf198fe39. 2023-02-17 02:01:41,793 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676599299314.14f2c512e529cbb9d6867ebbf198fe39. after waiting 0 ms 2023-02-17 02:01:41,793 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676599299314.14f2c512e529cbb9d6867ebbf198fe39. 2023-02-17 02:01:41,793 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676599299314.14f2c512e529cbb9d6867ebbf198fe39. 2023-02-17 02:01:41,793 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 14f2c512e529cbb9d6867ebbf198fe39: 2023-02-17 02:01:41,800 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676599299314.c691d9a9a766414e01e1a5d1e977f7ef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:41,800 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 11a8cdc80a2d44f1bffce0cee2d27545 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-17 02:01:41,800 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676599299314.76c704a666ea47c826747b29fb61b262.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:41,801 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 76c704a666ea47c826747b29fb61b262, disabling compactions & flushes 2023-02-17 02:01:41,801 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676599299314.76c704a666ea47c826747b29fb61b262. 2023-02-17 02:01:41,801 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676599299314.76c704a666ea47c826747b29fb61b262. 2023-02-17 02:01:41,801 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676599299314.76c704a666ea47c826747b29fb61b262. after waiting 0 ms 2023-02-17 02:01:41,801 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676599299314.76c704a666ea47c826747b29fb61b262. 2023-02-17 02:01:41,801 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676599299314.76c704a666ea47c826747b29fb61b262. 2023-02-17 02:01:41,801 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 76c704a666ea47c826747b29fb61b262: 2023-02-17 02:01:41,808 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing d34d6d8b8aee836a577ebac64f77206e, disabling compactions & flushes 2023-02-17 02:01:41,808 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 4480550c813a461ba99f421240031d32 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-17 02:01:41,808 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676599299314.d34d6d8b8aee836a577ebac64f77206e. 2023-02-17 02:01:41,808 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 21311936f3c5e2464085c015fcb59dc0, disabling compactions & flushes 2023-02-17 02:01:41,808 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676599299314.21311936f3c5e2464085c015fcb59dc0. 2023-02-17 02:01:41,808 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676599299314.d34d6d8b8aee836a577ebac64f77206e. 2023-02-17 02:01:41,808 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676599299314.21311936f3c5e2464085c015fcb59dc0. 2023-02-17 02:01:41,808 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676599299314.d34d6d8b8aee836a577ebac64f77206e. after waiting 0 ms 2023-02-17 02:01:41,809 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676599299314.21311936f3c5e2464085c015fcb59dc0. after waiting 0 ms 2023-02-17 02:01:41,809 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676599299314.21311936f3c5e2464085c015fcb59dc0. 2023-02-17 02:01:41,809 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676599299314.d34d6d8b8aee836a577ebac64f77206e. 2023-02-17 02:01:41,809 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676599299314.d34d6d8b8aee836a577ebac64f77206e. 2023-02-17 02:01:41,809 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676599299314.21311936f3c5e2464085c015fcb59dc0. 2023-02-17 02:01:41,809 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 21311936f3c5e2464085c015fcb59dc0: 2023-02-17 02:01:41,809 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for d34d6d8b8aee836a577ebac64f77206e: 2023-02-17 02:01:41,811 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 5981aab5c8ae4fe59385233bb285c2e5 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-17 02:01:41,811 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676599299314.27286d7877e172b7626d8faac32266d5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:41,811 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 7080b20bafef3fcca7e77fb1564444dc, disabling compactions & flushes 2023-02-17 02:01:41,811 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a930e3556eac46578a1753b460ab39e8 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-17 02:01:41,811 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676599299314.7080b20bafef3fcca7e77fb1564444dc. 2023-02-17 02:01:41,811 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676599299314.7080b20bafef3fcca7e77fb1564444dc. 2023-02-17 02:01:41,811 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676599299314.7080b20bafef3fcca7e77fb1564444dc. after waiting 0 ms 2023-02-17 02:01:41,811 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676599299314.7080b20bafef3fcca7e77fb1564444dc. 2023-02-17 02:01:41,811 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676599299314.7080b20bafef3fcca7e77fb1564444dc. 2023-02-17 02:01:41,811 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 7080b20bafef3fcca7e77fb1564444dc: 2023-02-17 02:01:41,813 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing c691d9a9a766414e01e1a5d1e977f7ef, disabling compactions & flushes 2023-02-17 02:01:41,813 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676599299314.c691d9a9a766414e01e1a5d1e977f7ef. 2023-02-17 02:01:41,813 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676599299314.c691d9a9a766414e01e1a5d1e977f7ef. 2023-02-17 02:01:41,813 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676599299314.c691d9a9a766414e01e1a5d1e977f7ef. after waiting 0 ms 2023-02-17 02:01:41,813 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676599299314.c691d9a9a766414e01e1a5d1e977f7ef. 2023-02-17 02:01:41,813 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676599299314.c691d9a9a766414e01e1a5d1e977f7ef. 2023-02-17 02:01:41,813 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for c691d9a9a766414e01e1a5d1e977f7ef: 2023-02-17 02:01:41,814 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink dc9baabcc9ce45d8a21443cf9630582b from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-17 02:01:41,814 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676599299314.6b374f0b5a440ed43ee4cdab132cd165.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:41,815 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 788355db401b48529ec690ced656df37 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-17 02:01:41,816 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 27286d7877e172b7626d8faac32266d5, disabling compactions & flushes 2023-02-17 02:01:41,816 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676599299314.27286d7877e172b7626d8faac32266d5. 2023-02-17 02:01:41,816 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676599299314.27286d7877e172b7626d8faac32266d5. 2023-02-17 02:01:41,816 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676599299314.27286d7877e172b7626d8faac32266d5. after waiting 0 ms 2023-02-17 02:01:41,816 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676599299314.27286d7877e172b7626d8faac32266d5. 2023-02-17 02:01:41,816 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676599299314.27286d7877e172b7626d8faac32266d5. 2023-02-17 02:01:41,816 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 27286d7877e172b7626d8faac32266d5: 2023-02-17 02:01:41,817 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 8ac7e9d1168e4d818482016e67eaee9a from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-17 02:01:41,818 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 6b374f0b5a440ed43ee4cdab132cd165, disabling compactions & flushes 2023-02-17 02:01:41,818 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676599299314.6b374f0b5a440ed43ee4cdab132cd165. 2023-02-17 02:01:41,818 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676599299314.6b374f0b5a440ed43ee4cdab132cd165. 2023-02-17 02:01:41,818 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676599299314.6b374f0b5a440ed43ee4cdab132cd165. after waiting 0 ms 2023-02-17 02:01:41,818 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676599299314.6b374f0b5a440ed43ee4cdab132cd165. 2023-02-17 02:01:41,818 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676599299314.6b374f0b5a440ed43ee4cdab132cd165. 2023-02-17 02:01:41,818 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 6b374f0b5a440ed43ee4cdab132cd165: 2023-02-17 02:01:41,819 INFO [Listener at localhost/42831] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1676599300055 type: FLUSH version: 2 ttl: 0 2023-02-17 02:01:41,819 DEBUG [Listener at localhost/42831] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:33493/user/jenkins/test-data/5842bbf8-60c5-814f-4a3e-f0f7b45dd79c/testWithMockedMapReduceMultiRegion/9a723ec3-5756-4f17-9ede-95b38c19a420 2023-02-17 02:01:41,819 DEBUG [Listener at localhost/42831] util.CommonFSUtils(682): File system contents for path hdfs://localhost:33493/user/jenkins/test-data/5842bbf8-60c5-814f-4a3e-f0f7b45dd79c/testWithMockedMapReduceMultiRegion/9a723ec3-5756-4f17-9ede-95b38c19a420 2023-02-17 02:01:41,819 DEBUG [Listener at localhost/42831] util.CommonFSUtils(699): |-data/ 2023-02-17 02:01:41,820 DEBUG [Listener at localhost/42831] util.CommonFSUtils(699): |----default/ 2023-02-17 02:01:41,820 DEBUG [Listener at localhost/42831] util.CommonFSUtils(699): |-------testWithMockedMapReduceMultiRegion/ 2023-02-17 02:01:41,821 DEBUG [Listener at localhost/42831] util.CommonFSUtils(699): |----------033e5165635b9ba2e8fffe93154e637e/ 2023-02-17 02:01:41,821 DEBUG [Listener at localhost/42831] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 02:01:41,821 DEBUG [Listener at localhost/42831] util.CommonFSUtils(699): |----------14f2c512e529cbb9d6867ebbf198fe39/ 2023-02-17 02:01:41,821 DEBUG [Listener at localhost/42831] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 02:01:41,821 DEBUG [Listener at localhost/42831] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 02:01:41,822 DEBUG [Listener at localhost/42831] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=14f2c512e529cbb9d6867ebbf198fe39-5fa203364e084b90b7dd58f7350af22a 2023-02-17 02:01:41,822 DEBUG [Listener at localhost/42831] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 02:01:41,822 DEBUG [Listener at localhost/42831] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=14f2c512e529cbb9d6867ebbf198fe39-d62d74424c98482f8468af99ea6c0a4f 2023-02-17 02:01:41,822 DEBUG [Listener at localhost/42831] util.CommonFSUtils(699): |----------21311936f3c5e2464085c015fcb59dc0/ 2023-02-17 02:01:41,822 DEBUG [Listener at localhost/42831] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 02:01:41,822 DEBUG [Listener at localhost/42831] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 02:01:41,823 DEBUG [Listener at localhost/42831] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=21311936f3c5e2464085c015fcb59dc0-eecf0269b9ae450f88e892cf69d0e0cf 2023-02-17 02:01:41,823 DEBUG [Listener at localhost/42831] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 02:01:41,823 DEBUG [Listener at localhost/42831] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=21311936f3c5e2464085c015fcb59dc0-fc09d0ad57684cdfbef52e06095b34fa 2023-02-17 02:01:41,823 DEBUG [Listener at localhost/42831] util.CommonFSUtils(699): |----------27286d7877e172b7626d8faac32266d5/ 2023-02-17 02:01:41,823 DEBUG [Listener at localhost/42831] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 02:01:41,823 DEBUG [Listener at localhost/42831] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 02:01:41,824 DEBUG [Listener at localhost/42831] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=27286d7877e172b7626d8faac32266d5-a930e3556eac46578a1753b460ab39e8 2023-02-17 02:01:41,824 DEBUG [Listener at localhost/42831] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 02:01:41,824 DEBUG [Listener at localhost/42831] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=27286d7877e172b7626d8faac32266d5-dc9baabcc9ce45d8a21443cf9630582b 2023-02-17 02:01:41,824 DEBUG [Listener at localhost/42831] util.CommonFSUtils(699): |----------6b374f0b5a440ed43ee4cdab132cd165/ 2023-02-17 02:01:41,824 DEBUG [Listener at localhost/42831] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 02:01:41,824 DEBUG [Listener at localhost/42831] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 02:01:41,824 DEBUG [Listener at localhost/42831] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=6b374f0b5a440ed43ee4cdab132cd165-788355db401b48529ec690ced656df37 2023-02-17 02:01:41,825 DEBUG [Listener at localhost/42831] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 02:01:41,825 DEBUG [Listener at localhost/42831] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=6b374f0b5a440ed43ee4cdab132cd165-8ac7e9d1168e4d818482016e67eaee9a 2023-02-17 02:01:41,825 DEBUG [Listener at localhost/42831] util.CommonFSUtils(699): |----------7080b20bafef3fcca7e77fb1564444dc/ 2023-02-17 02:01:41,825 DEBUG [Listener at localhost/42831] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 02:01:41,825 DEBUG [Listener at localhost/42831] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 02:01:41,825 DEBUG [Listener at localhost/42831] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=7080b20bafef3fcca7e77fb1564444dc-ab16a9abe6424f00872cdac7c4986916 2023-02-17 02:01:41,826 DEBUG [Listener at localhost/42831] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 02:01:41,826 DEBUG [Listener at localhost/42831] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=7080b20bafef3fcca7e77fb1564444dc-4480550c813a461ba99f421240031d32 2023-02-17 02:01:41,826 DEBUG [Listener at localhost/42831] util.CommonFSUtils(699): |----------76c704a666ea47c826747b29fb61b262/ 2023-02-17 02:01:41,826 DEBUG [Listener at localhost/42831] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 02:01:41,826 DEBUG [Listener at localhost/42831] util.CommonFSUtils(699): |----------c691d9a9a766414e01e1a5d1e977f7ef/ 2023-02-17 02:01:41,826 DEBUG [Listener at localhost/42831] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 02:01:41,826 DEBUG [Listener at localhost/42831] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 02:01:41,827 DEBUG [Listener at localhost/42831] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=c691d9a9a766414e01e1a5d1e977f7ef-11a8cdc80a2d44f1bffce0cee2d27545 2023-02-17 02:01:41,827 DEBUG [Listener at localhost/42831] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 02:01:41,827 DEBUG [Listener at localhost/42831] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=c691d9a9a766414e01e1a5d1e977f7ef-5981aab5c8ae4fe59385233bb285c2e5 2023-02-17 02:01:41,827 DEBUG [Listener at localhost/42831] util.CommonFSUtils(699): |----------d34d6d8b8aee836a577ebac64f77206e/ 2023-02-17 02:01:41,827 DEBUG [Listener at localhost/42831] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 02:01:41,828 DEBUG [Listener at localhost/42831] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 02:01:41,828 DEBUG [Listener at localhost/42831] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=d34d6d8b8aee836a577ebac64f77206e-c998db2d8e68420ea00f02987c2a8019 2023-02-17 02:01:41,828 DEBUG [Listener at localhost/42831] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 02:01:41,828 DEBUG [Listener at localhost/42831] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=d34d6d8b8aee836a577ebac64f77206e-1498be0e208e4dc5b9364280a44fff12 2023-02-17 02:01:41,828 DEBUG [Listener at localhost/42831] util.CommonFSUtils(699): |----------e59273498db883c4fe992b5078a4292b/ 2023-02-17 02:01:41,828 DEBUG [Listener at localhost/42831] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 02:01:41,829 DEBUG [Listener at localhost/42831] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 02:01:41,829 DEBUG [Listener at localhost/42831] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=e59273498db883c4fe992b5078a4292b-7859f50f6bc7464ba81ed31b021042bc 2023-02-17 02:01:41,829 DEBUG [Listener at localhost/42831] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 02:01:41,829 DEBUG [Listener at localhost/42831] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=e59273498db883c4fe992b5078a4292b-1eca9fd903224bae93f53e7968116387 2023-02-17 02:01:41,833 INFO [Listener at localhost/42831] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-17 02:01:42,578 DEBUG [Listener at localhost/42831] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676599299314.21311936f3c5e2464085c015fcb59dc0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:42,578 INFO [Listener at localhost/42831] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 02:01:42,580 DEBUG [Listener at localhost/42831] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 02:01:42,582 INFO [StoreOpener-21311936f3c5e2464085c015fcb59dc0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 21311936f3c5e2464085c015fcb59dc0 2023-02-17 02:01:42,582 DEBUG [StoreOpener-21311936f3c5e2464085c015fcb59dc0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33493/user/jenkins/test-data/5842bbf8-60c5-814f-4a3e-f0f7b45dd79c/testWithMockedMapReduceMultiRegion/9a723ec3-5756-4f17-9ede-95b38c19a420/data/default/testWithMockedMapReduceMultiRegion/21311936f3c5e2464085c015fcb59dc0/f1 2023-02-17 02:01:42,583 INFO [StoreOpener-21311936f3c5e2464085c015fcb59dc0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 21311936f3c5e2464085c015fcb59dc0 columnFamilyName f1 2023-02-17 02:01:42,587 DEBUG [StoreOpener-21311936f3c5e2464085c015fcb59dc0-1] regionserver.HStore(539): loaded hdfs://localhost:33493/user/jenkins/test-data/5842bbf8-60c5-814f-4a3e-f0f7b45dd79c/testWithMockedMapReduceMultiRegion/9a723ec3-5756-4f17-9ede-95b38c19a420/data/default/testWithMockedMapReduceMultiRegion/21311936f3c5e2464085c015fcb59dc0/f1/testWithMockedMapReduceMultiRegion=21311936f3c5e2464085c015fcb59dc0-eecf0269b9ae450f88e892cf69d0e0cf 2023-02-17 02:01:42,587 INFO [StoreOpener-21311936f3c5e2464085c015fcb59dc0-1] regionserver.HStore(310): Store=21311936f3c5e2464085c015fcb59dc0/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:42,587 INFO [StoreOpener-21311936f3c5e2464085c015fcb59dc0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 21311936f3c5e2464085c015fcb59dc0 2023-02-17 02:01:42,588 DEBUG [StoreOpener-21311936f3c5e2464085c015fcb59dc0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33493/user/jenkins/test-data/5842bbf8-60c5-814f-4a3e-f0f7b45dd79c/testWithMockedMapReduceMultiRegion/9a723ec3-5756-4f17-9ede-95b38c19a420/data/default/testWithMockedMapReduceMultiRegion/21311936f3c5e2464085c015fcb59dc0/f2 2023-02-17 02:01:42,588 INFO [StoreOpener-21311936f3c5e2464085c015fcb59dc0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 21311936f3c5e2464085c015fcb59dc0 columnFamilyName f2 2023-02-17 02:01:42,591 DEBUG [StoreOpener-21311936f3c5e2464085c015fcb59dc0-1] regionserver.HStore(539): loaded hdfs://localhost:33493/user/jenkins/test-data/5842bbf8-60c5-814f-4a3e-f0f7b45dd79c/testWithMockedMapReduceMultiRegion/9a723ec3-5756-4f17-9ede-95b38c19a420/data/default/testWithMockedMapReduceMultiRegion/21311936f3c5e2464085c015fcb59dc0/f2/testWithMockedMapReduceMultiRegion=21311936f3c5e2464085c015fcb59dc0-fc09d0ad57684cdfbef52e06095b34fa 2023-02-17 02:01:42,591 INFO [StoreOpener-21311936f3c5e2464085c015fcb59dc0-1] regionserver.HStore(310): Store=21311936f3c5e2464085c015fcb59dc0/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:42,592 DEBUG [Listener at localhost/42831] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 02:01:42,592 INFO [Listener at localhost/42831] regionserver.HRegion(1071): Opened 21311936f3c5e2464085c015fcb59dc0; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61051222, jitterRate=-0.0902658998966217}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 02:01:42,592 DEBUG [Listener at localhost/42831] regionserver.HRegion(964): Region open journal for 21311936f3c5e2464085c015fcb59dc0: 2023-02-17 02:01:42,601 DEBUG [Listener at localhost/42831] regionserver.HRegion(1603): Closing 21311936f3c5e2464085c015fcb59dc0, disabling compactions & flushes 2023-02-17 02:01:42,602 INFO [Listener at localhost/42831] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676599299314.21311936f3c5e2464085c015fcb59dc0. 2023-02-17 02:01:42,602 DEBUG [Listener at localhost/42831] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676599299314.21311936f3c5e2464085c015fcb59dc0. 2023-02-17 02:01:42,602 DEBUG [Listener at localhost/42831] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676599299314.21311936f3c5e2464085c015fcb59dc0. after waiting 0 ms 2023-02-17 02:01:42,603 DEBUG [Listener at localhost/42831] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676599299314.21311936f3c5e2464085c015fcb59dc0. 2023-02-17 02:01:42,603 INFO [Listener at localhost/42831] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676599299314.21311936f3c5e2464085c015fcb59dc0. 2023-02-17 02:01:42,604 DEBUG [Listener at localhost/42831] regionserver.HRegion(1557): Region close journal for 21311936f3c5e2464085c015fcb59dc0: 2023-02-17 02:01:42,604 DEBUG [Listener at localhost/42831] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676599299314.27286d7877e172b7626d8faac32266d5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:42,604 INFO [Listener at localhost/42831] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 02:01:42,606 DEBUG [Listener at localhost/42831] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 02:01:42,608 INFO [StoreOpener-27286d7877e172b7626d8faac32266d5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 27286d7877e172b7626d8faac32266d5 2023-02-17 02:01:42,609 DEBUG [StoreOpener-27286d7877e172b7626d8faac32266d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33493/user/jenkins/test-data/5842bbf8-60c5-814f-4a3e-f0f7b45dd79c/testWithMockedMapReduceMultiRegion/9a723ec3-5756-4f17-9ede-95b38c19a420/data/default/testWithMockedMapReduceMultiRegion/27286d7877e172b7626d8faac32266d5/f1 2023-02-17 02:01:42,609 INFO [StoreOpener-27286d7877e172b7626d8faac32266d5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 27286d7877e172b7626d8faac32266d5 columnFamilyName f1 2023-02-17 02:01:42,614 DEBUG [StoreOpener-27286d7877e172b7626d8faac32266d5-1] regionserver.HStore(539): loaded hdfs://localhost:33493/user/jenkins/test-data/5842bbf8-60c5-814f-4a3e-f0f7b45dd79c/testWithMockedMapReduceMultiRegion/9a723ec3-5756-4f17-9ede-95b38c19a420/data/default/testWithMockedMapReduceMultiRegion/27286d7877e172b7626d8faac32266d5/f1/testWithMockedMapReduceMultiRegion=27286d7877e172b7626d8faac32266d5-a930e3556eac46578a1753b460ab39e8 2023-02-17 02:01:42,614 INFO [StoreOpener-27286d7877e172b7626d8faac32266d5-1] regionserver.HStore(310): Store=27286d7877e172b7626d8faac32266d5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:42,614 INFO [StoreOpener-27286d7877e172b7626d8faac32266d5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 27286d7877e172b7626d8faac32266d5 2023-02-17 02:01:42,615 DEBUG [StoreOpener-27286d7877e172b7626d8faac32266d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33493/user/jenkins/test-data/5842bbf8-60c5-814f-4a3e-f0f7b45dd79c/testWithMockedMapReduceMultiRegion/9a723ec3-5756-4f17-9ede-95b38c19a420/data/default/testWithMockedMapReduceMultiRegion/27286d7877e172b7626d8faac32266d5/f2 2023-02-17 02:01:42,616 INFO [StoreOpener-27286d7877e172b7626d8faac32266d5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 27286d7877e172b7626d8faac32266d5 columnFamilyName f2 2023-02-17 02:01:42,620 DEBUG [StoreOpener-27286d7877e172b7626d8faac32266d5-1] regionserver.HStore(539): loaded hdfs://localhost:33493/user/jenkins/test-data/5842bbf8-60c5-814f-4a3e-f0f7b45dd79c/testWithMockedMapReduceMultiRegion/9a723ec3-5756-4f17-9ede-95b38c19a420/data/default/testWithMockedMapReduceMultiRegion/27286d7877e172b7626d8faac32266d5/f2/testWithMockedMapReduceMultiRegion=27286d7877e172b7626d8faac32266d5-dc9baabcc9ce45d8a21443cf9630582b 2023-02-17 02:01:42,620 INFO [StoreOpener-27286d7877e172b7626d8faac32266d5-1] regionserver.HStore(310): Store=27286d7877e172b7626d8faac32266d5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:42,621 DEBUG [Listener at localhost/42831] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 02:01:42,621 INFO [Listener at localhost/42831] regionserver.HRegion(1071): Opened 27286d7877e172b7626d8faac32266d5; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72079891, jitterRate=0.07407407462596893}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 02:01:42,621 DEBUG [Listener at localhost/42831] regionserver.HRegion(964): Region open journal for 27286d7877e172b7626d8faac32266d5: 2023-02-17 02:01:42,631 DEBUG [Listener at localhost/42831] regionserver.HRegion(1603): Closing 27286d7877e172b7626d8faac32266d5, disabling compactions & flushes 2023-02-17 02:01:42,631 INFO [Listener at localhost/42831] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676599299314.27286d7877e172b7626d8faac32266d5. 2023-02-17 02:01:42,631 DEBUG [Listener at localhost/42831] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676599299314.27286d7877e172b7626d8faac32266d5. 2023-02-17 02:01:42,632 DEBUG [Listener at localhost/42831] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676599299314.27286d7877e172b7626d8faac32266d5. after waiting 0 ms 2023-02-17 02:01:42,632 DEBUG [Listener at localhost/42831] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676599299314.27286d7877e172b7626d8faac32266d5. 2023-02-17 02:01:42,633 INFO [Listener at localhost/42831] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676599299314.27286d7877e172b7626d8faac32266d5. 2023-02-17 02:01:42,633 DEBUG [Listener at localhost/42831] regionserver.HRegion(1557): Region close journal for 27286d7877e172b7626d8faac32266d5: 2023-02-17 02:01:42,633 DEBUG [Listener at localhost/42831] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676599299314.76c704a666ea47c826747b29fb61b262.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:42,634 INFO [Listener at localhost/42831] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 02:01:42,635 DEBUG [Listener at localhost/42831] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 02:01:42,637 INFO [StoreOpener-76c704a666ea47c826747b29fb61b262-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 76c704a666ea47c826747b29fb61b262 2023-02-17 02:01:42,638 DEBUG [StoreOpener-76c704a666ea47c826747b29fb61b262-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33493/user/jenkins/test-data/5842bbf8-60c5-814f-4a3e-f0f7b45dd79c/testWithMockedMapReduceMultiRegion/9a723ec3-5756-4f17-9ede-95b38c19a420/data/default/testWithMockedMapReduceMultiRegion/76c704a666ea47c826747b29fb61b262/f1 2023-02-17 02:01:42,639 INFO [StoreOpener-76c704a666ea47c826747b29fb61b262-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 76c704a666ea47c826747b29fb61b262 columnFamilyName f1 2023-02-17 02:01:42,639 INFO [StoreOpener-76c704a666ea47c826747b29fb61b262-1] regionserver.HStore(310): Store=76c704a666ea47c826747b29fb61b262/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:42,639 INFO [StoreOpener-76c704a666ea47c826747b29fb61b262-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 76c704a666ea47c826747b29fb61b262 2023-02-17 02:01:42,640 DEBUG [StoreOpener-76c704a666ea47c826747b29fb61b262-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33493/user/jenkins/test-data/5842bbf8-60c5-814f-4a3e-f0f7b45dd79c/testWithMockedMapReduceMultiRegion/9a723ec3-5756-4f17-9ede-95b38c19a420/data/default/testWithMockedMapReduceMultiRegion/76c704a666ea47c826747b29fb61b262/f2 2023-02-17 02:01:42,641 INFO [StoreOpener-76c704a666ea47c826747b29fb61b262-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 76c704a666ea47c826747b29fb61b262 columnFamilyName f2 2023-02-17 02:01:42,641 INFO [StoreOpener-76c704a666ea47c826747b29fb61b262-1] regionserver.HStore(310): Store=76c704a666ea47c826747b29fb61b262/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:42,641 DEBUG [Listener at localhost/42831] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 02:01:42,641 INFO [Listener at localhost/42831] regionserver.HRegion(1071): Opened 76c704a666ea47c826747b29fb61b262; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73754009, jitterRate=0.09902037680149078}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 02:01:42,641 DEBUG [Listener at localhost/42831] regionserver.HRegion(964): Region open journal for 76c704a666ea47c826747b29fb61b262: 2023-02-17 02:01:42,641 DEBUG [Listener at localhost/42831] regionserver.HRegion(1603): Closing 76c704a666ea47c826747b29fb61b262, disabling compactions & flushes 2023-02-17 02:01:42,641 INFO [Listener at localhost/42831] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676599299314.76c704a666ea47c826747b29fb61b262. 2023-02-17 02:01:42,642 DEBUG [Listener at localhost/42831] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676599299314.76c704a666ea47c826747b29fb61b262. 2023-02-17 02:01:42,642 DEBUG [Listener at localhost/42831] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676599299314.76c704a666ea47c826747b29fb61b262. after waiting 0 ms 2023-02-17 02:01:42,642 DEBUG [Listener at localhost/42831] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676599299314.76c704a666ea47c826747b29fb61b262. 2023-02-17 02:01:42,642 INFO [Listener at localhost/42831] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676599299314.76c704a666ea47c826747b29fb61b262. 2023-02-17 02:01:42,642 DEBUG [Listener at localhost/42831] regionserver.HRegion(1557): Region close journal for 76c704a666ea47c826747b29fb61b262: 2023-02-17 02:01:42,642 DEBUG [Listener at localhost/42831] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676599299314.14f2c512e529cbb9d6867ebbf198fe39.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:42,643 INFO [Listener at localhost/42831] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 02:01:42,644 DEBUG [Listener at localhost/42831] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 02:01:42,645 INFO [StoreOpener-14f2c512e529cbb9d6867ebbf198fe39-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 14f2c512e529cbb9d6867ebbf198fe39 2023-02-17 02:01:42,646 DEBUG [StoreOpener-14f2c512e529cbb9d6867ebbf198fe39-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33493/user/jenkins/test-data/5842bbf8-60c5-814f-4a3e-f0f7b45dd79c/testWithMockedMapReduceMultiRegion/9a723ec3-5756-4f17-9ede-95b38c19a420/data/default/testWithMockedMapReduceMultiRegion/14f2c512e529cbb9d6867ebbf198fe39/f1 2023-02-17 02:01:42,646 INFO [StoreOpener-14f2c512e529cbb9d6867ebbf198fe39-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 14f2c512e529cbb9d6867ebbf198fe39 columnFamilyName f1 2023-02-17 02:01:42,650 DEBUG [StoreOpener-14f2c512e529cbb9d6867ebbf198fe39-1] regionserver.HStore(539): loaded hdfs://localhost:33493/user/jenkins/test-data/5842bbf8-60c5-814f-4a3e-f0f7b45dd79c/testWithMockedMapReduceMultiRegion/9a723ec3-5756-4f17-9ede-95b38c19a420/data/default/testWithMockedMapReduceMultiRegion/14f2c512e529cbb9d6867ebbf198fe39/f1/testWithMockedMapReduceMultiRegion=14f2c512e529cbb9d6867ebbf198fe39-5fa203364e084b90b7dd58f7350af22a 2023-02-17 02:01:42,650 INFO [StoreOpener-14f2c512e529cbb9d6867ebbf198fe39-1] regionserver.HStore(310): Store=14f2c512e529cbb9d6867ebbf198fe39/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:42,650 INFO [StoreOpener-14f2c512e529cbb9d6867ebbf198fe39-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 14f2c512e529cbb9d6867ebbf198fe39 2023-02-17 02:01:42,651 DEBUG [StoreOpener-14f2c512e529cbb9d6867ebbf198fe39-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33493/user/jenkins/test-data/5842bbf8-60c5-814f-4a3e-f0f7b45dd79c/testWithMockedMapReduceMultiRegion/9a723ec3-5756-4f17-9ede-95b38c19a420/data/default/testWithMockedMapReduceMultiRegion/14f2c512e529cbb9d6867ebbf198fe39/f2 2023-02-17 02:01:42,651 INFO [StoreOpener-14f2c512e529cbb9d6867ebbf198fe39-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 14f2c512e529cbb9d6867ebbf198fe39 columnFamilyName f2 2023-02-17 02:01:42,654 DEBUG [StoreOpener-14f2c512e529cbb9d6867ebbf198fe39-1] regionserver.HStore(539): loaded hdfs://localhost:33493/user/jenkins/test-data/5842bbf8-60c5-814f-4a3e-f0f7b45dd79c/testWithMockedMapReduceMultiRegion/9a723ec3-5756-4f17-9ede-95b38c19a420/data/default/testWithMockedMapReduceMultiRegion/14f2c512e529cbb9d6867ebbf198fe39/f2/testWithMockedMapReduceMultiRegion=14f2c512e529cbb9d6867ebbf198fe39-d62d74424c98482f8468af99ea6c0a4f 2023-02-17 02:01:42,654 INFO [StoreOpener-14f2c512e529cbb9d6867ebbf198fe39-1] regionserver.HStore(310): Store=14f2c512e529cbb9d6867ebbf198fe39/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:42,655 DEBUG [Listener at localhost/42831] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 02:01:42,655 INFO [Listener at localhost/42831] regionserver.HRegion(1071): Opened 14f2c512e529cbb9d6867ebbf198fe39; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62134741, jitterRate=-0.07412020862102509}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 02:01:42,655 DEBUG [Listener at localhost/42831] regionserver.HRegion(964): Region open journal for 14f2c512e529cbb9d6867ebbf198fe39: 2023-02-17 02:01:42,667 DEBUG [Listener at localhost/42831] regionserver.HRegion(1603): Closing 14f2c512e529cbb9d6867ebbf198fe39, disabling compactions & flushes 2023-02-17 02:01:42,667 INFO [Listener at localhost/42831] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676599299314.14f2c512e529cbb9d6867ebbf198fe39. 2023-02-17 02:01:42,667 DEBUG [Listener at localhost/42831] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676599299314.14f2c512e529cbb9d6867ebbf198fe39. 2023-02-17 02:01:42,667 DEBUG [Listener at localhost/42831] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676599299314.14f2c512e529cbb9d6867ebbf198fe39. after waiting 0 ms 2023-02-17 02:01:42,667 DEBUG [Listener at localhost/42831] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676599299314.14f2c512e529cbb9d6867ebbf198fe39. 2023-02-17 02:01:42,668 INFO [Listener at localhost/42831] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676599299314.14f2c512e529cbb9d6867ebbf198fe39. 2023-02-17 02:01:42,668 DEBUG [Listener at localhost/42831] regionserver.HRegion(1557): Region close journal for 14f2c512e529cbb9d6867ebbf198fe39: 2023-02-17 02:01:42,668 DEBUG [Listener at localhost/42831] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676599299314.c691d9a9a766414e01e1a5d1e977f7ef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:42,669 INFO [Listener at localhost/42831] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 02:01:42,670 DEBUG [Listener at localhost/42831] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 02:01:42,672 INFO [StoreOpener-c691d9a9a766414e01e1a5d1e977f7ef-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c691d9a9a766414e01e1a5d1e977f7ef 2023-02-17 02:01:42,673 DEBUG [StoreOpener-c691d9a9a766414e01e1a5d1e977f7ef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33493/user/jenkins/test-data/5842bbf8-60c5-814f-4a3e-f0f7b45dd79c/testWithMockedMapReduceMultiRegion/9a723ec3-5756-4f17-9ede-95b38c19a420/data/default/testWithMockedMapReduceMultiRegion/c691d9a9a766414e01e1a5d1e977f7ef/f1 2023-02-17 02:01:42,673 INFO [StoreOpener-c691d9a9a766414e01e1a5d1e977f7ef-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c691d9a9a766414e01e1a5d1e977f7ef columnFamilyName f1 2023-02-17 02:01:42,677 DEBUG [StoreOpener-c691d9a9a766414e01e1a5d1e977f7ef-1] regionserver.HStore(539): loaded hdfs://localhost:33493/user/jenkins/test-data/5842bbf8-60c5-814f-4a3e-f0f7b45dd79c/testWithMockedMapReduceMultiRegion/9a723ec3-5756-4f17-9ede-95b38c19a420/data/default/testWithMockedMapReduceMultiRegion/c691d9a9a766414e01e1a5d1e977f7ef/f1/testWithMockedMapReduceMultiRegion=c691d9a9a766414e01e1a5d1e977f7ef-11a8cdc80a2d44f1bffce0cee2d27545 2023-02-17 02:01:42,677 INFO [StoreOpener-c691d9a9a766414e01e1a5d1e977f7ef-1] regionserver.HStore(310): Store=c691d9a9a766414e01e1a5d1e977f7ef/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:42,677 INFO [StoreOpener-c691d9a9a766414e01e1a5d1e977f7ef-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c691d9a9a766414e01e1a5d1e977f7ef 2023-02-17 02:01:42,677 DEBUG [StoreOpener-c691d9a9a766414e01e1a5d1e977f7ef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33493/user/jenkins/test-data/5842bbf8-60c5-814f-4a3e-f0f7b45dd79c/testWithMockedMapReduceMultiRegion/9a723ec3-5756-4f17-9ede-95b38c19a420/data/default/testWithMockedMapReduceMultiRegion/c691d9a9a766414e01e1a5d1e977f7ef/f2 2023-02-17 02:01:42,678 INFO [StoreOpener-c691d9a9a766414e01e1a5d1e977f7ef-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c691d9a9a766414e01e1a5d1e977f7ef columnFamilyName f2 2023-02-17 02:01:42,683 DEBUG [StoreOpener-c691d9a9a766414e01e1a5d1e977f7ef-1] regionserver.HStore(539): loaded hdfs://localhost:33493/user/jenkins/test-data/5842bbf8-60c5-814f-4a3e-f0f7b45dd79c/testWithMockedMapReduceMultiRegion/9a723ec3-5756-4f17-9ede-95b38c19a420/data/default/testWithMockedMapReduceMultiRegion/c691d9a9a766414e01e1a5d1e977f7ef/f2/testWithMockedMapReduceMultiRegion=c691d9a9a766414e01e1a5d1e977f7ef-5981aab5c8ae4fe59385233bb285c2e5 2023-02-17 02:01:42,683 INFO [StoreOpener-c691d9a9a766414e01e1a5d1e977f7ef-1] regionserver.HStore(310): Store=c691d9a9a766414e01e1a5d1e977f7ef/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:42,683 DEBUG [Listener at localhost/42831] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 02:01:42,683 INFO [Listener at localhost/42831] regionserver.HRegion(1071): Opened c691d9a9a766414e01e1a5d1e977f7ef; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68449677, jitterRate=0.019979670643806458}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 02:01:42,683 DEBUG [Listener at localhost/42831] regionserver.HRegion(964): Region open journal for c691d9a9a766414e01e1a5d1e977f7ef: 2023-02-17 02:01:42,691 DEBUG [Listener at localhost/42831] regionserver.HRegion(1603): Closing c691d9a9a766414e01e1a5d1e977f7ef, disabling compactions & flushes 2023-02-17 02:01:42,691 INFO [Listener at localhost/42831] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676599299314.c691d9a9a766414e01e1a5d1e977f7ef. 2023-02-17 02:01:42,691 DEBUG [Listener at localhost/42831] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676599299314.c691d9a9a766414e01e1a5d1e977f7ef. 2023-02-17 02:01:42,691 DEBUG [Listener at localhost/42831] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676599299314.c691d9a9a766414e01e1a5d1e977f7ef. after waiting 0 ms 2023-02-17 02:01:42,691 DEBUG [Listener at localhost/42831] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676599299314.c691d9a9a766414e01e1a5d1e977f7ef. 2023-02-17 02:01:42,692 INFO [Listener at localhost/42831] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676599299314.c691d9a9a766414e01e1a5d1e977f7ef. 2023-02-17 02:01:42,692 DEBUG [Listener at localhost/42831] regionserver.HRegion(1557): Region close journal for c691d9a9a766414e01e1a5d1e977f7ef: 2023-02-17 02:01:42,693 DEBUG [Listener at localhost/42831] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676599299314.7080b20bafef3fcca7e77fb1564444dc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:42,693 INFO [Listener at localhost/42831] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 02:01:42,694 DEBUG [Listener at localhost/42831] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 02:01:42,696 INFO [StoreOpener-7080b20bafef3fcca7e77fb1564444dc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7080b20bafef3fcca7e77fb1564444dc 2023-02-17 02:01:42,696 DEBUG [StoreOpener-7080b20bafef3fcca7e77fb1564444dc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33493/user/jenkins/test-data/5842bbf8-60c5-814f-4a3e-f0f7b45dd79c/testWithMockedMapReduceMultiRegion/9a723ec3-5756-4f17-9ede-95b38c19a420/data/default/testWithMockedMapReduceMultiRegion/7080b20bafef3fcca7e77fb1564444dc/f1 2023-02-17 02:01:42,697 INFO [StoreOpener-7080b20bafef3fcca7e77fb1564444dc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7080b20bafef3fcca7e77fb1564444dc columnFamilyName f1 2023-02-17 02:01:42,700 DEBUG [StoreOpener-7080b20bafef3fcca7e77fb1564444dc-1] regionserver.HStore(539): loaded hdfs://localhost:33493/user/jenkins/test-data/5842bbf8-60c5-814f-4a3e-f0f7b45dd79c/testWithMockedMapReduceMultiRegion/9a723ec3-5756-4f17-9ede-95b38c19a420/data/default/testWithMockedMapReduceMultiRegion/7080b20bafef3fcca7e77fb1564444dc/f1/testWithMockedMapReduceMultiRegion=7080b20bafef3fcca7e77fb1564444dc-ab16a9abe6424f00872cdac7c4986916 2023-02-17 02:01:42,700 INFO [StoreOpener-7080b20bafef3fcca7e77fb1564444dc-1] regionserver.HStore(310): Store=7080b20bafef3fcca7e77fb1564444dc/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:42,700 INFO [StoreOpener-7080b20bafef3fcca7e77fb1564444dc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7080b20bafef3fcca7e77fb1564444dc 2023-02-17 02:01:42,701 DEBUG [StoreOpener-7080b20bafef3fcca7e77fb1564444dc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33493/user/jenkins/test-data/5842bbf8-60c5-814f-4a3e-f0f7b45dd79c/testWithMockedMapReduceMultiRegion/9a723ec3-5756-4f17-9ede-95b38c19a420/data/default/testWithMockedMapReduceMultiRegion/7080b20bafef3fcca7e77fb1564444dc/f2 2023-02-17 02:01:42,702 INFO [StoreOpener-7080b20bafef3fcca7e77fb1564444dc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7080b20bafef3fcca7e77fb1564444dc columnFamilyName f2 2023-02-17 02:01:42,706 DEBUG [StoreOpener-7080b20bafef3fcca7e77fb1564444dc-1] regionserver.HStore(539): loaded hdfs://localhost:33493/user/jenkins/test-data/5842bbf8-60c5-814f-4a3e-f0f7b45dd79c/testWithMockedMapReduceMultiRegion/9a723ec3-5756-4f17-9ede-95b38c19a420/data/default/testWithMockedMapReduceMultiRegion/7080b20bafef3fcca7e77fb1564444dc/f2/testWithMockedMapReduceMultiRegion=7080b20bafef3fcca7e77fb1564444dc-4480550c813a461ba99f421240031d32 2023-02-17 02:01:42,706 INFO [StoreOpener-7080b20bafef3fcca7e77fb1564444dc-1] regionserver.HStore(310): Store=7080b20bafef3fcca7e77fb1564444dc/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:42,706 DEBUG [Listener at localhost/42831] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 02:01:42,707 INFO [Listener at localhost/42831] regionserver.HRegion(1071): Opened 7080b20bafef3fcca7e77fb1564444dc; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64705770, jitterRate=-0.03580889105796814}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 02:01:42,707 DEBUG [Listener at localhost/42831] regionserver.HRegion(964): Region open journal for 7080b20bafef3fcca7e77fb1564444dc: 2023-02-17 02:01:42,714 DEBUG [Listener at localhost/42831] regionserver.HRegion(1603): Closing 7080b20bafef3fcca7e77fb1564444dc, disabling compactions & flushes 2023-02-17 02:01:42,715 INFO [Listener at localhost/42831] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676599299314.7080b20bafef3fcca7e77fb1564444dc. 2023-02-17 02:01:42,715 DEBUG [Listener at localhost/42831] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676599299314.7080b20bafef3fcca7e77fb1564444dc. 2023-02-17 02:01:42,715 DEBUG [Listener at localhost/42831] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676599299314.7080b20bafef3fcca7e77fb1564444dc. after waiting 0 ms 2023-02-17 02:01:42,715 DEBUG [Listener at localhost/42831] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676599299314.7080b20bafef3fcca7e77fb1564444dc. 2023-02-17 02:01:42,715 INFO [Listener at localhost/42831] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676599299314.7080b20bafef3fcca7e77fb1564444dc. 2023-02-17 02:01:42,716 DEBUG [Listener at localhost/42831] regionserver.HRegion(1557): Region close journal for 7080b20bafef3fcca7e77fb1564444dc: 2023-02-17 02:01:42,716 DEBUG [Listener at localhost/42831] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676599299314.6b374f0b5a440ed43ee4cdab132cd165.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:42,716 INFO [Listener at localhost/42831] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 02:01:42,718 DEBUG [Listener at localhost/42831] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 02:01:42,719 INFO [StoreOpener-6b374f0b5a440ed43ee4cdab132cd165-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 6b374f0b5a440ed43ee4cdab132cd165 2023-02-17 02:01:42,720 DEBUG [StoreOpener-6b374f0b5a440ed43ee4cdab132cd165-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33493/user/jenkins/test-data/5842bbf8-60c5-814f-4a3e-f0f7b45dd79c/testWithMockedMapReduceMultiRegion/9a723ec3-5756-4f17-9ede-95b38c19a420/data/default/testWithMockedMapReduceMultiRegion/6b374f0b5a440ed43ee4cdab132cd165/f1 2023-02-17 02:01:42,721 INFO [StoreOpener-6b374f0b5a440ed43ee4cdab132cd165-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6b374f0b5a440ed43ee4cdab132cd165 columnFamilyName f1 2023-02-17 02:01:42,729 DEBUG [StoreOpener-6b374f0b5a440ed43ee4cdab132cd165-1] regionserver.HStore(539): loaded hdfs://localhost:33493/user/jenkins/test-data/5842bbf8-60c5-814f-4a3e-f0f7b45dd79c/testWithMockedMapReduceMultiRegion/9a723ec3-5756-4f17-9ede-95b38c19a420/data/default/testWithMockedMapReduceMultiRegion/6b374f0b5a440ed43ee4cdab132cd165/f1/testWithMockedMapReduceMultiRegion=6b374f0b5a440ed43ee4cdab132cd165-788355db401b48529ec690ced656df37 2023-02-17 02:01:42,729 INFO [StoreOpener-6b374f0b5a440ed43ee4cdab132cd165-1] regionserver.HStore(310): Store=6b374f0b5a440ed43ee4cdab132cd165/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:42,730 INFO [StoreOpener-6b374f0b5a440ed43ee4cdab132cd165-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 6b374f0b5a440ed43ee4cdab132cd165 2023-02-17 02:01:42,730 DEBUG [StoreOpener-6b374f0b5a440ed43ee4cdab132cd165-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33493/user/jenkins/test-data/5842bbf8-60c5-814f-4a3e-f0f7b45dd79c/testWithMockedMapReduceMultiRegion/9a723ec3-5756-4f17-9ede-95b38c19a420/data/default/testWithMockedMapReduceMultiRegion/6b374f0b5a440ed43ee4cdab132cd165/f2 2023-02-17 02:01:42,731 INFO [StoreOpener-6b374f0b5a440ed43ee4cdab132cd165-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6b374f0b5a440ed43ee4cdab132cd165 columnFamilyName f2 2023-02-17 02:01:42,735 DEBUG [StoreOpener-6b374f0b5a440ed43ee4cdab132cd165-1] regionserver.HStore(539): loaded hdfs://localhost:33493/user/jenkins/test-data/5842bbf8-60c5-814f-4a3e-f0f7b45dd79c/testWithMockedMapReduceMultiRegion/9a723ec3-5756-4f17-9ede-95b38c19a420/data/default/testWithMockedMapReduceMultiRegion/6b374f0b5a440ed43ee4cdab132cd165/f2/testWithMockedMapReduceMultiRegion=6b374f0b5a440ed43ee4cdab132cd165-8ac7e9d1168e4d818482016e67eaee9a 2023-02-17 02:01:42,735 INFO [StoreOpener-6b374f0b5a440ed43ee4cdab132cd165-1] regionserver.HStore(310): Store=6b374f0b5a440ed43ee4cdab132cd165/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:42,735 DEBUG [Listener at localhost/42831] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 02:01:42,736 INFO [Listener at localhost/42831] regionserver.HRegion(1071): Opened 6b374f0b5a440ed43ee4cdab132cd165; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59900519, jitterRate=-0.10741271078586578}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 02:01:42,736 DEBUG [Listener at localhost/42831] regionserver.HRegion(964): Region open journal for 6b374f0b5a440ed43ee4cdab132cd165: 2023-02-17 02:01:42,744 DEBUG [Listener at localhost/42831] regionserver.HRegion(1603): Closing 6b374f0b5a440ed43ee4cdab132cd165, disabling compactions & flushes 2023-02-17 02:01:42,744 INFO [Listener at localhost/42831] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676599299314.6b374f0b5a440ed43ee4cdab132cd165. 2023-02-17 02:01:42,744 DEBUG [Listener at localhost/42831] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676599299314.6b374f0b5a440ed43ee4cdab132cd165. 2023-02-17 02:01:42,744 DEBUG [Listener at localhost/42831] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676599299314.6b374f0b5a440ed43ee4cdab132cd165. after waiting 0 ms 2023-02-17 02:01:42,744 DEBUG [Listener at localhost/42831] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676599299314.6b374f0b5a440ed43ee4cdab132cd165. 2023-02-17 02:01:42,745 INFO [Listener at localhost/42831] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676599299314.6b374f0b5a440ed43ee4cdab132cd165. 2023-02-17 02:01:42,745 DEBUG [Listener at localhost/42831] regionserver.HRegion(1557): Region close journal for 6b374f0b5a440ed43ee4cdab132cd165: 2023-02-17 02:01:42,746 DEBUG [Listener at localhost/42831] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676599299314.d34d6d8b8aee836a577ebac64f77206e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:42,746 INFO [Listener at localhost/42831] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 02:01:42,747 DEBUG [Listener at localhost/42831] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 02:01:42,749 INFO [StoreOpener-d34d6d8b8aee836a577ebac64f77206e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d34d6d8b8aee836a577ebac64f77206e 2023-02-17 02:01:42,750 DEBUG [StoreOpener-d34d6d8b8aee836a577ebac64f77206e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33493/user/jenkins/test-data/5842bbf8-60c5-814f-4a3e-f0f7b45dd79c/testWithMockedMapReduceMultiRegion/9a723ec3-5756-4f17-9ede-95b38c19a420/data/default/testWithMockedMapReduceMultiRegion/d34d6d8b8aee836a577ebac64f77206e/f1 2023-02-17 02:01:42,750 INFO [StoreOpener-d34d6d8b8aee836a577ebac64f77206e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d34d6d8b8aee836a577ebac64f77206e columnFamilyName f1 2023-02-17 02:01:42,754 DEBUG [StoreOpener-d34d6d8b8aee836a577ebac64f77206e-1] regionserver.HStore(539): loaded hdfs://localhost:33493/user/jenkins/test-data/5842bbf8-60c5-814f-4a3e-f0f7b45dd79c/testWithMockedMapReduceMultiRegion/9a723ec3-5756-4f17-9ede-95b38c19a420/data/default/testWithMockedMapReduceMultiRegion/d34d6d8b8aee836a577ebac64f77206e/f1/testWithMockedMapReduceMultiRegion=d34d6d8b8aee836a577ebac64f77206e-c998db2d8e68420ea00f02987c2a8019 2023-02-17 02:01:42,754 INFO [StoreOpener-d34d6d8b8aee836a577ebac64f77206e-1] regionserver.HStore(310): Store=d34d6d8b8aee836a577ebac64f77206e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:42,754 INFO [StoreOpener-d34d6d8b8aee836a577ebac64f77206e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d34d6d8b8aee836a577ebac64f77206e 2023-02-17 02:01:42,755 DEBUG [StoreOpener-d34d6d8b8aee836a577ebac64f77206e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33493/user/jenkins/test-data/5842bbf8-60c5-814f-4a3e-f0f7b45dd79c/testWithMockedMapReduceMultiRegion/9a723ec3-5756-4f17-9ede-95b38c19a420/data/default/testWithMockedMapReduceMultiRegion/d34d6d8b8aee836a577ebac64f77206e/f2 2023-02-17 02:01:42,755 INFO [StoreOpener-d34d6d8b8aee836a577ebac64f77206e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d34d6d8b8aee836a577ebac64f77206e columnFamilyName f2 2023-02-17 02:01:42,759 DEBUG [StoreOpener-d34d6d8b8aee836a577ebac64f77206e-1] regionserver.HStore(539): loaded hdfs://localhost:33493/user/jenkins/test-data/5842bbf8-60c5-814f-4a3e-f0f7b45dd79c/testWithMockedMapReduceMultiRegion/9a723ec3-5756-4f17-9ede-95b38c19a420/data/default/testWithMockedMapReduceMultiRegion/d34d6d8b8aee836a577ebac64f77206e/f2/testWithMockedMapReduceMultiRegion=d34d6d8b8aee836a577ebac64f77206e-1498be0e208e4dc5b9364280a44fff12 2023-02-17 02:01:42,759 INFO [StoreOpener-d34d6d8b8aee836a577ebac64f77206e-1] regionserver.HStore(310): Store=d34d6d8b8aee836a577ebac64f77206e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:42,759 DEBUG [Listener at localhost/42831] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 02:01:42,759 INFO [Listener at localhost/42831] regionserver.HRegion(1071): Opened d34d6d8b8aee836a577ebac64f77206e; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58875407, jitterRate=-0.12268806993961334}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 02:01:42,759 DEBUG [Listener at localhost/42831] regionserver.HRegion(964): Region open journal for d34d6d8b8aee836a577ebac64f77206e: 2023-02-17 02:01:42,767 DEBUG [Listener at localhost/42831] regionserver.HRegion(1603): Closing d34d6d8b8aee836a577ebac64f77206e, disabling compactions & flushes 2023-02-17 02:01:42,767 INFO [Listener at localhost/42831] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676599299314.d34d6d8b8aee836a577ebac64f77206e. 2023-02-17 02:01:42,767 DEBUG [Listener at localhost/42831] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676599299314.d34d6d8b8aee836a577ebac64f77206e. 2023-02-17 02:01:42,767 DEBUG [Listener at localhost/42831] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676599299314.d34d6d8b8aee836a577ebac64f77206e. after waiting 0 ms 2023-02-17 02:01:42,768 DEBUG [Listener at localhost/42831] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676599299314.d34d6d8b8aee836a577ebac64f77206e. 2023-02-17 02:01:42,768 INFO [Listener at localhost/42831] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676599299314.d34d6d8b8aee836a577ebac64f77206e. 2023-02-17 02:01:42,768 DEBUG [Listener at localhost/42831] regionserver.HRegion(1557): Region close journal for d34d6d8b8aee836a577ebac64f77206e: 2023-02-17 02:01:42,769 DEBUG [Listener at localhost/42831] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676599299314.e59273498db883c4fe992b5078a4292b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:42,769 INFO [Listener at localhost/42831] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 02:01:42,770 DEBUG [Listener at localhost/42831] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 02:01:42,772 INFO [StoreOpener-e59273498db883c4fe992b5078a4292b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e59273498db883c4fe992b5078a4292b 2023-02-17 02:01:42,773 DEBUG [StoreOpener-e59273498db883c4fe992b5078a4292b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33493/user/jenkins/test-data/5842bbf8-60c5-814f-4a3e-f0f7b45dd79c/testWithMockedMapReduceMultiRegion/9a723ec3-5756-4f17-9ede-95b38c19a420/data/default/testWithMockedMapReduceMultiRegion/e59273498db883c4fe992b5078a4292b/f1 2023-02-17 02:01:42,773 INFO [StoreOpener-e59273498db883c4fe992b5078a4292b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e59273498db883c4fe992b5078a4292b columnFamilyName f1 2023-02-17 02:01:42,777 DEBUG [StoreOpener-e59273498db883c4fe992b5078a4292b-1] regionserver.HStore(539): loaded hdfs://localhost:33493/user/jenkins/test-data/5842bbf8-60c5-814f-4a3e-f0f7b45dd79c/testWithMockedMapReduceMultiRegion/9a723ec3-5756-4f17-9ede-95b38c19a420/data/default/testWithMockedMapReduceMultiRegion/e59273498db883c4fe992b5078a4292b/f1/testWithMockedMapReduceMultiRegion=e59273498db883c4fe992b5078a4292b-7859f50f6bc7464ba81ed31b021042bc 2023-02-17 02:01:42,777 INFO [StoreOpener-e59273498db883c4fe992b5078a4292b-1] regionserver.HStore(310): Store=e59273498db883c4fe992b5078a4292b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:42,777 INFO [StoreOpener-e59273498db883c4fe992b5078a4292b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e59273498db883c4fe992b5078a4292b 2023-02-17 02:01:42,778 DEBUG [StoreOpener-e59273498db883c4fe992b5078a4292b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33493/user/jenkins/test-data/5842bbf8-60c5-814f-4a3e-f0f7b45dd79c/testWithMockedMapReduceMultiRegion/9a723ec3-5756-4f17-9ede-95b38c19a420/data/default/testWithMockedMapReduceMultiRegion/e59273498db883c4fe992b5078a4292b/f2 2023-02-17 02:01:42,778 INFO [StoreOpener-e59273498db883c4fe992b5078a4292b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e59273498db883c4fe992b5078a4292b columnFamilyName f2 2023-02-17 02:01:42,781 DEBUG [StoreOpener-e59273498db883c4fe992b5078a4292b-1] regionserver.HStore(539): loaded hdfs://localhost:33493/user/jenkins/test-data/5842bbf8-60c5-814f-4a3e-f0f7b45dd79c/testWithMockedMapReduceMultiRegion/9a723ec3-5756-4f17-9ede-95b38c19a420/data/default/testWithMockedMapReduceMultiRegion/e59273498db883c4fe992b5078a4292b/f2/testWithMockedMapReduceMultiRegion=e59273498db883c4fe992b5078a4292b-1eca9fd903224bae93f53e7968116387 2023-02-17 02:01:42,781 INFO [StoreOpener-e59273498db883c4fe992b5078a4292b-1] regionserver.HStore(310): Store=e59273498db883c4fe992b5078a4292b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:42,781 DEBUG [Listener at localhost/42831] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 02:01:42,782 INFO [Listener at localhost/42831] regionserver.HRegion(1071): Opened e59273498db883c4fe992b5078a4292b; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67808261, jitterRate=0.01042182743549347}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 02:01:42,782 DEBUG [Listener at localhost/42831] regionserver.HRegion(964): Region open journal for e59273498db883c4fe992b5078a4292b: 2023-02-17 02:01:42,792 DEBUG [Listener at localhost/42831] regionserver.HRegion(1603): Closing e59273498db883c4fe992b5078a4292b, disabling compactions & flushes 2023-02-17 02:01:42,792 INFO [Listener at localhost/42831] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676599299314.e59273498db883c4fe992b5078a4292b. 2023-02-17 02:01:42,792 DEBUG [Listener at localhost/42831] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676599299314.e59273498db883c4fe992b5078a4292b. 2023-02-17 02:01:42,792 DEBUG [Listener at localhost/42831] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676599299314.e59273498db883c4fe992b5078a4292b. after waiting 0 ms 2023-02-17 02:01:42,792 DEBUG [Listener at localhost/42831] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676599299314.e59273498db883c4fe992b5078a4292b. 2023-02-17 02:01:42,793 INFO [Listener at localhost/42831] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676599299314.e59273498db883c4fe992b5078a4292b. 2023-02-17 02:01:42,793 DEBUG [Listener at localhost/42831] regionserver.HRegion(1557): Region close journal for e59273498db883c4fe992b5078a4292b: 2023-02-17 02:01:42,794 DEBUG [Listener at localhost/42831] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676599299314.033e5165635b9ba2e8fffe93154e637e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:42,794 INFO [Listener at localhost/42831] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 02:01:42,808 DEBUG [Listener at localhost/42831] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 02:01:42,811 INFO [StoreOpener-033e5165635b9ba2e8fffe93154e637e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 033e5165635b9ba2e8fffe93154e637e 2023-02-17 02:01:42,812 DEBUG [StoreOpener-033e5165635b9ba2e8fffe93154e637e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33493/user/jenkins/test-data/5842bbf8-60c5-814f-4a3e-f0f7b45dd79c/testWithMockedMapReduceMultiRegion/9a723ec3-5756-4f17-9ede-95b38c19a420/data/default/testWithMockedMapReduceMultiRegion/033e5165635b9ba2e8fffe93154e637e/f1 2023-02-17 02:01:42,812 INFO [StoreOpener-033e5165635b9ba2e8fffe93154e637e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 033e5165635b9ba2e8fffe93154e637e columnFamilyName f1 2023-02-17 02:01:42,813 INFO [StoreOpener-033e5165635b9ba2e8fffe93154e637e-1] regionserver.HStore(310): Store=033e5165635b9ba2e8fffe93154e637e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:42,813 INFO [StoreOpener-033e5165635b9ba2e8fffe93154e637e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 033e5165635b9ba2e8fffe93154e637e 2023-02-17 02:01:42,814 DEBUG [StoreOpener-033e5165635b9ba2e8fffe93154e637e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33493/user/jenkins/test-data/5842bbf8-60c5-814f-4a3e-f0f7b45dd79c/testWithMockedMapReduceMultiRegion/9a723ec3-5756-4f17-9ede-95b38c19a420/data/default/testWithMockedMapReduceMultiRegion/033e5165635b9ba2e8fffe93154e637e/f2 2023-02-17 02:01:42,815 INFO [StoreOpener-033e5165635b9ba2e8fffe93154e637e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 033e5165635b9ba2e8fffe93154e637e columnFamilyName f2 2023-02-17 02:01:42,815 INFO [StoreOpener-033e5165635b9ba2e8fffe93154e637e-1] regionserver.HStore(310): Store=033e5165635b9ba2e8fffe93154e637e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:42,815 DEBUG [Listener at localhost/42831] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 02:01:42,816 INFO [Listener at localhost/42831] regionserver.HRegion(1071): Opened 033e5165635b9ba2e8fffe93154e637e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62863022, jitterRate=-0.06326797604560852}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 02:01:42,816 DEBUG [Listener at localhost/42831] regionserver.HRegion(964): Region open journal for 033e5165635b9ba2e8fffe93154e637e: 2023-02-17 02:01:42,816 DEBUG [Listener at localhost/42831] regionserver.HRegion(1603): Closing 033e5165635b9ba2e8fffe93154e637e, disabling compactions & flushes 2023-02-17 02:01:42,816 INFO [Listener at localhost/42831] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676599299314.033e5165635b9ba2e8fffe93154e637e. 2023-02-17 02:01:42,816 DEBUG [Listener at localhost/42831] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676599299314.033e5165635b9ba2e8fffe93154e637e. 2023-02-17 02:01:42,816 DEBUG [Listener at localhost/42831] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676599299314.033e5165635b9ba2e8fffe93154e637e. after waiting 0 ms 2023-02-17 02:01:42,816 DEBUG [Listener at localhost/42831] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676599299314.033e5165635b9ba2e8fffe93154e637e. 2023-02-17 02:01:42,817 INFO [Listener at localhost/42831] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676599299314.033e5165635b9ba2e8fffe93154e637e. 2023-02-17 02:01:42,817 DEBUG [Listener at localhost/42831] regionserver.HRegion(1557): Region close journal for 033e5165635b9ba2e8fffe93154e637e: 2023-02-17 02:01:42,823 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMockedMapReduceMultiRegion" 2023-02-17 02:01:42,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceMultiRegion 2023-02-17 02:01:42,828 INFO [Listener at localhost/42831] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-17 02:01:42,828 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceMultiRegion 2023-02-17 02:01:42,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-17 02:01:42,833 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676599302833"}]},"ts":"1676599302833"} 2023-02-17 02:01:42,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-17 02:01:42,834 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLING in hbase:meta 2023-02-17 02:01:42,837 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceMultiRegion to state=DISABLING 2023-02-17 02:01:42,838 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=033e5165635b9ba2e8fffe93154e637e, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e59273498db883c4fe992b5078a4292b, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d34d6d8b8aee836a577ebac64f77206e, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c691d9a9a766414e01e1a5d1e977f7ef, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7080b20bafef3fcca7e77fb1564444dc, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6b374f0b5a440ed43ee4cdab132cd165, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=21311936f3c5e2464085c015fcb59dc0, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=27286d7877e172b7626d8faac32266d5, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=14f2c512e529cbb9d6867ebbf198fe39, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=76c704a666ea47c826747b29fb61b262, UNASSIGN}] 2023-02-17 02:01:42,840 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e59273498db883c4fe992b5078a4292b, UNASSIGN 2023-02-17 02:01:42,840 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7080b20bafef3fcca7e77fb1564444dc, UNASSIGN 2023-02-17 02:01:42,840 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c691d9a9a766414e01e1a5d1e977f7ef, UNASSIGN 2023-02-17 02:01:42,840 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d34d6d8b8aee836a577ebac64f77206e, UNASSIGN 2023-02-17 02:01:42,840 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=76c704a666ea47c826747b29fb61b262, UNASSIGN 2023-02-17 02:01:42,841 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=e59273498db883c4fe992b5078a4292b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33169,1676599297588 2023-02-17 02:01:42,841 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1676599299314.e59273498db883c4fe992b5078a4292b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676599302841"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676599302841"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676599302841"}]},"ts":"1676599302841"} 2023-02-17 02:01:42,841 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=7080b20bafef3fcca7e77fb1564444dc, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40913,1676599297651 2023-02-17 02:01:42,841 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=c691d9a9a766414e01e1a5d1e977f7ef, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33169,1676599297588 2023-02-17 02:01:42,841 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676599299314.7080b20bafef3fcca7e77fb1564444dc.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676599302841"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676599302841"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676599302841"}]},"ts":"1676599302841"} 2023-02-17 02:01:42,841 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=76c704a666ea47c826747b29fb61b262, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40913,1676599297651 2023-02-17 02:01:42,841 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=d34d6d8b8aee836a577ebac64f77206e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33169,1676599297588 2023-02-17 02:01:42,842 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676599299314.d34d6d8b8aee836a577ebac64f77206e.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676599302841"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676599302841"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676599302841"}]},"ts":"1676599302841"} 2023-02-17 02:01:42,842 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1676599299314.76c704a666ea47c826747b29fb61b262.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676599302841"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676599302841"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676599302841"}]},"ts":"1676599302841"} 2023-02-17 02:01:42,841 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676599299314.c691d9a9a766414e01e1a5d1e977f7ef.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676599302841"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676599302841"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676599302841"}]},"ts":"1676599302841"} 2023-02-17 02:01:42,845 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=35, state=RUNNABLE; CloseRegionProcedure e59273498db883c4fe992b5078a4292b, server=jenkins-hbase4.apache.org,33169,1676599297588}] 2023-02-17 02:01:42,847 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=38, state=RUNNABLE; CloseRegionProcedure 7080b20bafef3fcca7e77fb1564444dc, server=jenkins-hbase4.apache.org,40913,1676599297651}] 2023-02-17 02:01:42,848 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=36, state=RUNNABLE; CloseRegionProcedure d34d6d8b8aee836a577ebac64f77206e, server=jenkins-hbase4.apache.org,33169,1676599297588}] 2023-02-17 02:01:42,849 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=37, state=RUNNABLE; CloseRegionProcedure c691d9a9a766414e01e1a5d1e977f7ef, server=jenkins-hbase4.apache.org,33169,1676599297588}] 2023-02-17 02:01:42,851 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=43, state=RUNNABLE; CloseRegionProcedure 76c704a666ea47c826747b29fb61b262, server=jenkins-hbase4.apache.org,40913,1676599297651}] 2023-02-17 02:01:42,851 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=14f2c512e529cbb9d6867ebbf198fe39, UNASSIGN 2023-02-17 02:01:42,852 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=14f2c512e529cbb9d6867ebbf198fe39, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33169,1676599297588 2023-02-17 02:01:42,852 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=27286d7877e172b7626d8faac32266d5, UNASSIGN 2023-02-17 02:01:42,852 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1676599299314.14f2c512e529cbb9d6867ebbf198fe39.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676599302852"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676599302852"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676599302852"}]},"ts":"1676599302852"} 2023-02-17 02:01:42,853 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=21311936f3c5e2464085c015fcb59dc0, UNASSIGN 2023-02-17 02:01:42,853 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=27286d7877e172b7626d8faac32266d5, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33169,1676599297588 2023-02-17 02:01:42,853 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1676599299314.27286d7877e172b7626d8faac32266d5.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676599302853"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676599302853"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676599302853"}]},"ts":"1676599302853"} 2023-02-17 02:01:42,853 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=42, state=RUNNABLE; CloseRegionProcedure 14f2c512e529cbb9d6867ebbf198fe39, server=jenkins-hbase4.apache.org,33169,1676599297588}] 2023-02-17 02:01:42,854 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6b374f0b5a440ed43ee4cdab132cd165, UNASSIGN 2023-02-17 02:01:42,854 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=21311936f3c5e2464085c015fcb59dc0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40913,1676599297651 2023-02-17 02:01:42,854 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=033e5165635b9ba2e8fffe93154e637e, UNASSIGN 2023-02-17 02:01:42,854 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676599299314.21311936f3c5e2464085c015fcb59dc0.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676599302854"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676599302854"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676599302854"}]},"ts":"1676599302854"} 2023-02-17 02:01:42,855 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=6b374f0b5a440ed43ee4cdab132cd165, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40913,1676599297651 2023-02-17 02:01:42,855 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=41, state=RUNNABLE; CloseRegionProcedure 27286d7877e172b7626d8faac32266d5, server=jenkins-hbase4.apache.org,33169,1676599297588}] 2023-02-17 02:01:42,855 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676599299314.6b374f0b5a440ed43ee4cdab132cd165.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676599302855"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676599302855"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676599302855"}]},"ts":"1676599302855"} 2023-02-17 02:01:42,855 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=033e5165635b9ba2e8fffe93154e637e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40913,1676599297651 2023-02-17 02:01:42,855 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1676599299314.033e5165635b9ba2e8fffe93154e637e.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676599302855"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676599302855"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676599302855"}]},"ts":"1676599302855"} 2023-02-17 02:01:42,855 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=40, state=RUNNABLE; CloseRegionProcedure 21311936f3c5e2464085c015fcb59dc0, server=jenkins-hbase4.apache.org,40913,1676599297651}] 2023-02-17 02:01:42,859 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=39, state=RUNNABLE; CloseRegionProcedure 6b374f0b5a440ed43ee4cdab132cd165, server=jenkins-hbase4.apache.org,40913,1676599297651}] 2023-02-17 02:01:42,860 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=34, state=RUNNABLE; CloseRegionProcedure 033e5165635b9ba2e8fffe93154e637e, server=jenkins-hbase4.apache.org,40913,1676599297651}] 2023-02-17 02:01:42,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-17 02:01:42,999 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close e59273498db883c4fe992b5078a4292b 2023-02-17 02:01:42,999 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing e59273498db883c4fe992b5078a4292b, disabling compactions & flushes 2023-02-17 02:01:42,999 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676599299314.e59273498db883c4fe992b5078a4292b. 2023-02-17 02:01:42,999 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676599299314.e59273498db883c4fe992b5078a4292b. 2023-02-17 02:01:42,999 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676599299314.e59273498db883c4fe992b5078a4292b. after waiting 0 ms 2023-02-17 02:01:42,999 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676599299314.e59273498db883c4fe992b5078a4292b. 2023-02-17 02:01:43,001 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 7080b20bafef3fcca7e77fb1564444dc 2023-02-17 02:01:43,001 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 7080b20bafef3fcca7e77fb1564444dc, disabling compactions & flushes 2023-02-17 02:01:43,001 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676599299314.7080b20bafef3fcca7e77fb1564444dc. 2023-02-17 02:01:43,001 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676599299314.7080b20bafef3fcca7e77fb1564444dc. 2023-02-17 02:01:43,001 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676599299314.7080b20bafef3fcca7e77fb1564444dc. after waiting 0 ms 2023-02-17 02:01:43,001 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676599299314.7080b20bafef3fcca7e77fb1564444dc. 2023-02-17 02:01:43,003 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/e59273498db883c4fe992b5078a4292b/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 02:01:43,004 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676599299314.e59273498db883c4fe992b5078a4292b. 2023-02-17 02:01:43,004 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for e59273498db883c4fe992b5078a4292b: 2023-02-17 02:01:43,005 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/7080b20bafef3fcca7e77fb1564444dc/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 02:01:43,005 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676599299314.7080b20bafef3fcca7e77fb1564444dc. 2023-02-17 02:01:43,005 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 7080b20bafef3fcca7e77fb1564444dc: 2023-02-17 02:01:43,006 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed e59273498db883c4fe992b5078a4292b 2023-02-17 02:01:43,006 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 27286d7877e172b7626d8faac32266d5 2023-02-17 02:01:43,006 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 27286d7877e172b7626d8faac32266d5, disabling compactions & flushes 2023-02-17 02:01:43,006 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676599299314.27286d7877e172b7626d8faac32266d5. 2023-02-17 02:01:43,006 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676599299314.27286d7877e172b7626d8faac32266d5. 2023-02-17 02:01:43,006 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676599299314.27286d7877e172b7626d8faac32266d5. after waiting 0 ms 2023-02-17 02:01:43,006 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676599299314.27286d7877e172b7626d8faac32266d5. 2023-02-17 02:01:43,006 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=e59273498db883c4fe992b5078a4292b, regionState=CLOSED 2023-02-17 02:01:43,006 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1676599299314.e59273498db883c4fe992b5078a4292b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676599303006"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676599303006"}]},"ts":"1676599303006"} 2023-02-17 02:01:43,006 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 7080b20bafef3fcca7e77fb1564444dc 2023-02-17 02:01:43,006 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 6b374f0b5a440ed43ee4cdab132cd165 2023-02-17 02:01:43,007 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 6b374f0b5a440ed43ee4cdab132cd165, disabling compactions & flushes 2023-02-17 02:01:43,007 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676599299314.6b374f0b5a440ed43ee4cdab132cd165. 2023-02-17 02:01:43,007 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676599299314.6b374f0b5a440ed43ee4cdab132cd165. 2023-02-17 02:01:43,007 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676599299314.6b374f0b5a440ed43ee4cdab132cd165. after waiting 0 ms 2023-02-17 02:01:43,007 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676599299314.6b374f0b5a440ed43ee4cdab132cd165. 2023-02-17 02:01:43,007 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=7080b20bafef3fcca7e77fb1564444dc, regionState=CLOSED 2023-02-17 02:01:43,007 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676599299314.7080b20bafef3fcca7e77fb1564444dc.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676599303007"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676599303007"}]},"ts":"1676599303007"} 2023-02-17 02:01:43,010 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=38 2023-02-17 02:01:43,010 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=35 2023-02-17 02:01:43,010 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=38, state=SUCCESS; CloseRegionProcedure 7080b20bafef3fcca7e77fb1564444dc, server=jenkins-hbase4.apache.org,40913,1676599297651 in 162 msec 2023-02-17 02:01:43,010 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=35, state=SUCCESS; CloseRegionProcedure e59273498db883c4fe992b5078a4292b, server=jenkins-hbase4.apache.org,33169,1676599297588 in 163 msec 2023-02-17 02:01:43,011 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/27286d7877e172b7626d8faac32266d5/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 02:01:43,011 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/6b374f0b5a440ed43ee4cdab132cd165/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 02:01:43,012 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676599299314.27286d7877e172b7626d8faac32266d5. 2023-02-17 02:01:43,012 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e59273498db883c4fe992b5078a4292b, UNASSIGN in 173 msec 2023-02-17 02:01:43,012 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7080b20bafef3fcca7e77fb1564444dc, UNASSIGN in 174 msec 2023-02-17 02:01:43,012 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 27286d7877e172b7626d8faac32266d5: 2023-02-17 02:01:43,012 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676599299314.6b374f0b5a440ed43ee4cdab132cd165. 2023-02-17 02:01:43,012 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 6b374f0b5a440ed43ee4cdab132cd165: 2023-02-17 02:01:43,013 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 27286d7877e172b7626d8faac32266d5 2023-02-17 02:01:43,013 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close d34d6d8b8aee836a577ebac64f77206e 2023-02-17 02:01:43,013 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing d34d6d8b8aee836a577ebac64f77206e, disabling compactions & flushes 2023-02-17 02:01:43,013 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676599299314.d34d6d8b8aee836a577ebac64f77206e. 2023-02-17 02:01:43,013 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676599299314.d34d6d8b8aee836a577ebac64f77206e. 2023-02-17 02:01:43,013 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676599299314.d34d6d8b8aee836a577ebac64f77206e. after waiting 0 ms 2023-02-17 02:01:43,013 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676599299314.d34d6d8b8aee836a577ebac64f77206e. 2023-02-17 02:01:43,013 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=27286d7877e172b7626d8faac32266d5, regionState=CLOSED 2023-02-17 02:01:43,013 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1676599299314.27286d7877e172b7626d8faac32266d5.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676599303013"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676599303013"}]},"ts":"1676599303013"} 2023-02-17 02:01:43,013 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 6b374f0b5a440ed43ee4cdab132cd165 2023-02-17 02:01:43,013 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 76c704a666ea47c826747b29fb61b262 2023-02-17 02:01:43,013 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 76c704a666ea47c826747b29fb61b262, disabling compactions & flushes 2023-02-17 02:01:43,014 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676599299314.76c704a666ea47c826747b29fb61b262. 2023-02-17 02:01:43,014 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676599299314.76c704a666ea47c826747b29fb61b262. 2023-02-17 02:01:43,014 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676599299314.76c704a666ea47c826747b29fb61b262. after waiting 0 ms 2023-02-17 02:01:43,014 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676599299314.76c704a666ea47c826747b29fb61b262. 2023-02-17 02:01:43,014 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=6b374f0b5a440ed43ee4cdab132cd165, regionState=CLOSED 2023-02-17 02:01:43,014 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676599299314.6b374f0b5a440ed43ee4cdab132cd165.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676599303014"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676599303014"}]},"ts":"1676599303014"} 2023-02-17 02:01:43,016 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=41 2023-02-17 02:01:43,016 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=41, state=SUCCESS; CloseRegionProcedure 27286d7877e172b7626d8faac32266d5, server=jenkins-hbase4.apache.org,33169,1676599297588 in 160 msec 2023-02-17 02:01:43,017 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=39 2023-02-17 02:01:43,017 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=39, state=SUCCESS; CloseRegionProcedure 6b374f0b5a440ed43ee4cdab132cd165, server=jenkins-hbase4.apache.org,40913,1676599297651 in 159 msec 2023-02-17 02:01:43,017 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=27286d7877e172b7626d8faac32266d5, UNASSIGN in 179 msec 2023-02-17 02:01:43,018 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6b374f0b5a440ed43ee4cdab132cd165, UNASSIGN in 180 msec 2023-02-17 02:01:43,019 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/d34d6d8b8aee836a577ebac64f77206e/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 02:01:43,019 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676599299314.d34d6d8b8aee836a577ebac64f77206e. 2023-02-17 02:01:43,019 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for d34d6d8b8aee836a577ebac64f77206e: 2023-02-17 02:01:43,019 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/76c704a666ea47c826747b29fb61b262/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-17 02:01:43,020 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676599299314.76c704a666ea47c826747b29fb61b262. 2023-02-17 02:01:43,020 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 76c704a666ea47c826747b29fb61b262: 2023-02-17 02:01:43,021 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed d34d6d8b8aee836a577ebac64f77206e 2023-02-17 02:01:43,021 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 14f2c512e529cbb9d6867ebbf198fe39 2023-02-17 02:01:43,021 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 14f2c512e529cbb9d6867ebbf198fe39, disabling compactions & flushes 2023-02-17 02:01:43,021 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676599299314.14f2c512e529cbb9d6867ebbf198fe39. 2023-02-17 02:01:43,021 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676599299314.14f2c512e529cbb9d6867ebbf198fe39. 2023-02-17 02:01:43,021 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676599299314.14f2c512e529cbb9d6867ebbf198fe39. after waiting 0 ms 2023-02-17 02:01:43,021 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676599299314.14f2c512e529cbb9d6867ebbf198fe39. 2023-02-17 02:01:43,021 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=d34d6d8b8aee836a577ebac64f77206e, regionState=CLOSED 2023-02-17 02:01:43,021 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676599299314.d34d6d8b8aee836a577ebac64f77206e.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676599303021"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676599303021"}]},"ts":"1676599303021"} 2023-02-17 02:01:43,022 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 76c704a666ea47c826747b29fb61b262 2023-02-17 02:01:43,022 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 21311936f3c5e2464085c015fcb59dc0 2023-02-17 02:01:43,022 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 21311936f3c5e2464085c015fcb59dc0, disabling compactions & flushes 2023-02-17 02:01:43,022 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676599299314.21311936f3c5e2464085c015fcb59dc0. 2023-02-17 02:01:43,022 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676599299314.21311936f3c5e2464085c015fcb59dc0. 2023-02-17 02:01:43,022 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676599299314.21311936f3c5e2464085c015fcb59dc0. after waiting 0 ms 2023-02-17 02:01:43,022 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676599299314.21311936f3c5e2464085c015fcb59dc0. 2023-02-17 02:01:43,022 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=76c704a666ea47c826747b29fb61b262, regionState=CLOSED 2023-02-17 02:01:43,023 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1676599299314.76c704a666ea47c826747b29fb61b262.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676599303022"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676599303022"}]},"ts":"1676599303022"} 2023-02-17 02:01:43,024 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=36 2023-02-17 02:01:43,024 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=36, state=SUCCESS; CloseRegionProcedure d34d6d8b8aee836a577ebac64f77206e, server=jenkins-hbase4.apache.org,33169,1676599297588 in 174 msec 2023-02-17 02:01:43,025 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d34d6d8b8aee836a577ebac64f77206e, UNASSIGN in 187 msec 2023-02-17 02:01:43,025 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=43 2023-02-17 02:01:43,025 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=43, state=SUCCESS; CloseRegionProcedure 76c704a666ea47c826747b29fb61b262, server=jenkins-hbase4.apache.org,40913,1676599297651 in 174 msec 2023-02-17 02:01:43,026 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=76c704a666ea47c826747b29fb61b262, UNASSIGN in 188 msec 2023-02-17 02:01:43,028 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/14f2c512e529cbb9d6867ebbf198fe39/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 02:01:43,029 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676599299314.14f2c512e529cbb9d6867ebbf198fe39. 2023-02-17 02:01:43,029 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 14f2c512e529cbb9d6867ebbf198fe39: 2023-02-17 02:01:43,029 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/21311936f3c5e2464085c015fcb59dc0/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 02:01:43,030 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676599299314.21311936f3c5e2464085c015fcb59dc0. 2023-02-17 02:01:43,030 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 21311936f3c5e2464085c015fcb59dc0: 2023-02-17 02:01:43,030 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 14f2c512e529cbb9d6867ebbf198fe39 2023-02-17 02:01:43,030 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close c691d9a9a766414e01e1a5d1e977f7ef 2023-02-17 02:01:43,030 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing c691d9a9a766414e01e1a5d1e977f7ef, disabling compactions & flushes 2023-02-17 02:01:43,030 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676599299314.c691d9a9a766414e01e1a5d1e977f7ef. 2023-02-17 02:01:43,030 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676599299314.c691d9a9a766414e01e1a5d1e977f7ef. 2023-02-17 02:01:43,030 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676599299314.c691d9a9a766414e01e1a5d1e977f7ef. after waiting 0 ms 2023-02-17 02:01:43,030 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676599299314.c691d9a9a766414e01e1a5d1e977f7ef. 2023-02-17 02:01:43,031 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=14f2c512e529cbb9d6867ebbf198fe39, regionState=CLOSED 2023-02-17 02:01:43,031 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1676599299314.14f2c512e529cbb9d6867ebbf198fe39.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676599303030"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676599303030"}]},"ts":"1676599303030"} 2023-02-17 02:01:43,031 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 21311936f3c5e2464085c015fcb59dc0 2023-02-17 02:01:43,031 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 033e5165635b9ba2e8fffe93154e637e 2023-02-17 02:01:43,031 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 033e5165635b9ba2e8fffe93154e637e, disabling compactions & flushes 2023-02-17 02:01:43,031 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676599299314.033e5165635b9ba2e8fffe93154e637e. 2023-02-17 02:01:43,031 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676599299314.033e5165635b9ba2e8fffe93154e637e. 2023-02-17 02:01:43,031 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676599299314.033e5165635b9ba2e8fffe93154e637e. after waiting 0 ms 2023-02-17 02:01:43,031 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676599299314.033e5165635b9ba2e8fffe93154e637e. 2023-02-17 02:01:43,031 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=21311936f3c5e2464085c015fcb59dc0, regionState=CLOSED 2023-02-17 02:01:43,032 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676599299314.21311936f3c5e2464085c015fcb59dc0.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676599303031"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676599303031"}]},"ts":"1676599303031"} 2023-02-17 02:01:43,034 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=42 2023-02-17 02:01:43,034 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=42, state=SUCCESS; CloseRegionProcedure 14f2c512e529cbb9d6867ebbf198fe39, server=jenkins-hbase4.apache.org,33169,1676599297588 in 179 msec 2023-02-17 02:01:43,035 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=40 2023-02-17 02:01:43,035 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=40, state=SUCCESS; CloseRegionProcedure 21311936f3c5e2464085c015fcb59dc0, server=jenkins-hbase4.apache.org,40913,1676599297651 in 178 msec 2023-02-17 02:01:43,035 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=14f2c512e529cbb9d6867ebbf198fe39, UNASSIGN in 197 msec 2023-02-17 02:01:43,036 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=21311936f3c5e2464085c015fcb59dc0, UNASSIGN in 198 msec 2023-02-17 02:01:43,041 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/033e5165635b9ba2e8fffe93154e637e/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-17 02:01:43,042 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676599299314.033e5165635b9ba2e8fffe93154e637e. 2023-02-17 02:01:43,042 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 033e5165635b9ba2e8fffe93154e637e: 2023-02-17 02:01:43,044 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=033e5165635b9ba2e8fffe93154e637e, regionState=CLOSED 2023-02-17 02:01:43,045 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1676599299314.033e5165635b9ba2e8fffe93154e637e.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676599303044"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676599303044"}]},"ts":"1676599303044"} 2023-02-17 02:01:43,045 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 033e5165635b9ba2e8fffe93154e637e 2023-02-17 02:01:43,046 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/default/testWithMockedMapReduceMultiRegion/c691d9a9a766414e01e1a5d1e977f7ef/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 02:01:43,047 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676599299314.c691d9a9a766414e01e1a5d1e977f7ef. 2023-02-17 02:01:43,047 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for c691d9a9a766414e01e1a5d1e977f7ef: 2023-02-17 02:01:43,048 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=34 2023-02-17 02:01:43,048 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=34, state=SUCCESS; CloseRegionProcedure 033e5165635b9ba2e8fffe93154e637e, server=jenkins-hbase4.apache.org,40913,1676599297651 in 186 msec 2023-02-17 02:01:43,048 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed c691d9a9a766414e01e1a5d1e977f7ef 2023-02-17 02:01:43,049 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=c691d9a9a766414e01e1a5d1e977f7ef, regionState=CLOSED 2023-02-17 02:01:43,049 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676599299314.c691d9a9a766414e01e1a5d1e977f7ef.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676599303049"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676599303049"}]},"ts":"1676599303049"} 2023-02-17 02:01:43,049 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=033e5165635b9ba2e8fffe93154e637e, UNASSIGN in 211 msec 2023-02-17 02:01:43,052 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=37 2023-02-17 02:01:43,052 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=37, state=SUCCESS; CloseRegionProcedure c691d9a9a766414e01e1a5d1e977f7ef, server=jenkins-hbase4.apache.org,33169,1676599297588 in 201 msec 2023-02-17 02:01:43,055 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=33 2023-02-17 02:01:43,055 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c691d9a9a766414e01e1a5d1e977f7ef, UNASSIGN in 215 msec 2023-02-17 02:01:43,056 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676599303056"}]},"ts":"1676599303056"} 2023-02-17 02:01:43,057 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLED in hbase:meta 2023-02-17 02:01:43,059 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceMultiRegion to state=DISABLED 2023-02-17 02:01:43,061 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceMultiRegion in 232 msec 2023-02-17 02:01:43,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-17 02:01:43,137 INFO [Listener at localhost/42831] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 33 completed 2023-02-17 02:01:43,137 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testWithMockedMapReduceMultiRegion 2023-02-17 02:01:43,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-17 02:01:43,140 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-17 02:01:43,141 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-17 02:01:43,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-17 02:01:43,151 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/033e5165635b9ba2e8fffe93154e637e 2023-02-17 02:01:43,151 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/c691d9a9a766414e01e1a5d1e977f7ef 2023-02-17 02:01:43,151 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/27286d7877e172b7626d8faac32266d5 2023-02-17 02:01:43,151 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/21311936f3c5e2464085c015fcb59dc0 2023-02-17 02:01:43,151 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/6b374f0b5a440ed43ee4cdab132cd165 2023-02-17 02:01:43,151 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/7080b20bafef3fcca7e77fb1564444dc 2023-02-17 02:01:43,151 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/d34d6d8b8aee836a577ebac64f77206e 2023-02-17 02:01:43,151 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/e59273498db883c4fe992b5078a4292b 2023-02-17 02:01:43,153 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/21311936f3c5e2464085c015fcb59dc0/f1, FileablePath, hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/21311936f3c5e2464085c015fcb59dc0/f2, FileablePath, hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/21311936f3c5e2464085c015fcb59dc0/recovered.edits] 2023-02-17 02:01:43,155 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/27286d7877e172b7626d8faac32266d5/f1, FileablePath, hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/27286d7877e172b7626d8faac32266d5/f2, FileablePath, hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/27286d7877e172b7626d8faac32266d5/recovered.edits] 2023-02-17 02:01:43,155 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/c691d9a9a766414e01e1a5d1e977f7ef/f1, FileablePath, hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/c691d9a9a766414e01e1a5d1e977f7ef/f2, FileablePath, hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/c691d9a9a766414e01e1a5d1e977f7ef/recovered.edits] 2023-02-17 02:01:43,155 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/d34d6d8b8aee836a577ebac64f77206e/f1, FileablePath, hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/d34d6d8b8aee836a577ebac64f77206e/f2, FileablePath, hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/d34d6d8b8aee836a577ebac64f77206e/recovered.edits] 2023-02-17 02:01:43,156 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/6b374f0b5a440ed43ee4cdab132cd165/f1, FileablePath, hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/6b374f0b5a440ed43ee4cdab132cd165/f2, FileablePath, hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/6b374f0b5a440ed43ee4cdab132cd165/recovered.edits] 2023-02-17 02:01:43,156 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/033e5165635b9ba2e8fffe93154e637e/f1, FileablePath, hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/033e5165635b9ba2e8fffe93154e637e/f2, FileablePath, hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/033e5165635b9ba2e8fffe93154e637e/recovered.edits] 2023-02-17 02:01:43,156 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/e59273498db883c4fe992b5078a4292b/f1, FileablePath, hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/e59273498db883c4fe992b5078a4292b/f2, FileablePath, hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/e59273498db883c4fe992b5078a4292b/recovered.edits] 2023-02-17 02:01:43,157 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/7080b20bafef3fcca7e77fb1564444dc/f1, FileablePath, hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/7080b20bafef3fcca7e77fb1564444dc/f2, FileablePath, hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/7080b20bafef3fcca7e77fb1564444dc/recovered.edits] 2023-02-17 02:01:43,161 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/27286d7877e172b7626d8faac32266d5/f1/77ee731d4d9546dcb8e7dae87c05d7af to hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/archive/data/default/testWithMockedMapReduceMultiRegion/27286d7877e172b7626d8faac32266d5/f1/77ee731d4d9546dcb8e7dae87c05d7af 2023-02-17 02:01:43,162 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/21311936f3c5e2464085c015fcb59dc0/f1/eeb694a439a04f429d6a5867600bcb21 to hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/archive/data/default/testWithMockedMapReduceMultiRegion/21311936f3c5e2464085c015fcb59dc0/f1/eeb694a439a04f429d6a5867600bcb21 2023-02-17 02:01:43,163 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/6b374f0b5a440ed43ee4cdab132cd165/f1/2f8e5709d7fb49bfab4dace6f4d8084a to hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/archive/data/default/testWithMockedMapReduceMultiRegion/6b374f0b5a440ed43ee4cdab132cd165/f1/2f8e5709d7fb49bfab4dace6f4d8084a 2023-02-17 02:01:43,164 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/d34d6d8b8aee836a577ebac64f77206e/f1/0ed6be2bf0694169b8e7133ed14a29a0 to hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/archive/data/default/testWithMockedMapReduceMultiRegion/d34d6d8b8aee836a577ebac64f77206e/f1/0ed6be2bf0694169b8e7133ed14a29a0 2023-02-17 02:01:43,164 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/27286d7877e172b7626d8faac32266d5/f1/a930e3556eac46578a1753b460ab39e8 to hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/archive/data/default/testWithMockedMapReduceMultiRegion/27286d7877e172b7626d8faac32266d5/f1/a930e3556eac46578a1753b460ab39e8 2023-02-17 02:01:43,164 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/e59273498db883c4fe992b5078a4292b/f1/3f2b693199834e449a362a11772a952d to hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/archive/data/default/testWithMockedMapReduceMultiRegion/e59273498db883c4fe992b5078a4292b/f1/3f2b693199834e449a362a11772a952d 2023-02-17 02:01:43,165 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/6b374f0b5a440ed43ee4cdab132cd165/f1/788355db401b48529ec690ced656df37 to hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/archive/data/default/testWithMockedMapReduceMultiRegion/6b374f0b5a440ed43ee4cdab132cd165/f1/788355db401b48529ec690ced656df37 2023-02-17 02:01:43,165 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/c691d9a9a766414e01e1a5d1e977f7ef/f1/11a8cdc80a2d44f1bffce0cee2d27545 to hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/archive/data/default/testWithMockedMapReduceMultiRegion/c691d9a9a766414e01e1a5d1e977f7ef/f1/11a8cdc80a2d44f1bffce0cee2d27545 2023-02-17 02:01:43,165 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/21311936f3c5e2464085c015fcb59dc0/f1/eecf0269b9ae450f88e892cf69d0e0cf to hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/archive/data/default/testWithMockedMapReduceMultiRegion/21311936f3c5e2464085c015fcb59dc0/f1/eecf0269b9ae450f88e892cf69d0e0cf 2023-02-17 02:01:43,166 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/7080b20bafef3fcca7e77fb1564444dc/f1/a93bfbe028cd4051b7c93e254c5e0879 to hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/archive/data/default/testWithMockedMapReduceMultiRegion/7080b20bafef3fcca7e77fb1564444dc/f1/a93bfbe028cd4051b7c93e254c5e0879 2023-02-17 02:01:43,166 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/d34d6d8b8aee836a577ebac64f77206e/f1/c998db2d8e68420ea00f02987c2a8019 to hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/archive/data/default/testWithMockedMapReduceMultiRegion/d34d6d8b8aee836a577ebac64f77206e/f1/c998db2d8e68420ea00f02987c2a8019 2023-02-17 02:01:43,167 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/e59273498db883c4fe992b5078a4292b/f1/7859f50f6bc7464ba81ed31b021042bc to hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/archive/data/default/testWithMockedMapReduceMultiRegion/e59273498db883c4fe992b5078a4292b/f1/7859f50f6bc7464ba81ed31b021042bc 2023-02-17 02:01:43,167 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/c691d9a9a766414e01e1a5d1e977f7ef/f1/7bb204714ca64fb0bdda5213d751b397 to hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/archive/data/default/testWithMockedMapReduceMultiRegion/c691d9a9a766414e01e1a5d1e977f7ef/f1/7bb204714ca64fb0bdda5213d751b397 2023-02-17 02:01:43,167 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/033e5165635b9ba2e8fffe93154e637e/recovered.edits/6.seqid to hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/archive/data/default/testWithMockedMapReduceMultiRegion/033e5165635b9ba2e8fffe93154e637e/recovered.edits/6.seqid 2023-02-17 02:01:43,168 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/7080b20bafef3fcca7e77fb1564444dc/f1/ab16a9abe6424f00872cdac7c4986916 to hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/archive/data/default/testWithMockedMapReduceMultiRegion/7080b20bafef3fcca7e77fb1564444dc/f1/ab16a9abe6424f00872cdac7c4986916 2023-02-17 02:01:43,168 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/033e5165635b9ba2e8fffe93154e637e 2023-02-17 02:01:43,168 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/14f2c512e529cbb9d6867ebbf198fe39 2023-02-17 02:01:43,170 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/27286d7877e172b7626d8faac32266d5/f2/40a73e218a09463187b4f7383b5448b5 to hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/archive/data/default/testWithMockedMapReduceMultiRegion/27286d7877e172b7626d8faac32266d5/f2/40a73e218a09463187b4f7383b5448b5 2023-02-17 02:01:43,172 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/6b374f0b5a440ed43ee4cdab132cd165/f2/8ac7e9d1168e4d818482016e67eaee9a to hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/archive/data/default/testWithMockedMapReduceMultiRegion/6b374f0b5a440ed43ee4cdab132cd165/f2/8ac7e9d1168e4d818482016e67eaee9a 2023-02-17 02:01:43,172 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/14f2c512e529cbb9d6867ebbf198fe39/f1, FileablePath, hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/14f2c512e529cbb9d6867ebbf198fe39/f2, FileablePath, hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/14f2c512e529cbb9d6867ebbf198fe39/recovered.edits] 2023-02-17 02:01:43,173 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/27286d7877e172b7626d8faac32266d5/f2/dc9baabcc9ce45d8a21443cf9630582b to hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/archive/data/default/testWithMockedMapReduceMultiRegion/27286d7877e172b7626d8faac32266d5/f2/dc9baabcc9ce45d8a21443cf9630582b 2023-02-17 02:01:43,173 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/c691d9a9a766414e01e1a5d1e977f7ef/f2/1fa85784b2ca41fb9490f4b68ce4c94e to hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/archive/data/default/testWithMockedMapReduceMultiRegion/c691d9a9a766414e01e1a5d1e977f7ef/f2/1fa85784b2ca41fb9490f4b68ce4c94e 2023-02-17 02:01:43,173 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/21311936f3c5e2464085c015fcb59dc0/f2/2cbb9bd16d80444d8a670bff63832515 to hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/archive/data/default/testWithMockedMapReduceMultiRegion/21311936f3c5e2464085c015fcb59dc0/f2/2cbb9bd16d80444d8a670bff63832515 2023-02-17 02:01:43,173 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/d34d6d8b8aee836a577ebac64f77206e/f2/1498be0e208e4dc5b9364280a44fff12 to hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/archive/data/default/testWithMockedMapReduceMultiRegion/d34d6d8b8aee836a577ebac64f77206e/f2/1498be0e208e4dc5b9364280a44fff12 2023-02-17 02:01:43,173 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/e59273498db883c4fe992b5078a4292b/f2/1eca9fd903224bae93f53e7968116387 to hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/archive/data/default/testWithMockedMapReduceMultiRegion/e59273498db883c4fe992b5078a4292b/f2/1eca9fd903224bae93f53e7968116387 2023-02-17 02:01:43,174 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/7080b20bafef3fcca7e77fb1564444dc/f2/4480550c813a461ba99f421240031d32 to hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/archive/data/default/testWithMockedMapReduceMultiRegion/7080b20bafef3fcca7e77fb1564444dc/f2/4480550c813a461ba99f421240031d32 2023-02-17 02:01:43,175 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/6b374f0b5a440ed43ee4cdab132cd165/f2/c1db5d251c37406d862662f17457cc20 to hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/archive/data/default/testWithMockedMapReduceMultiRegion/6b374f0b5a440ed43ee4cdab132cd165/f2/c1db5d251c37406d862662f17457cc20 2023-02-17 02:01:43,175 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/d34d6d8b8aee836a577ebac64f77206e/f2/e75efa8fd7214151953e4467e101fb5d to hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/archive/data/default/testWithMockedMapReduceMultiRegion/d34d6d8b8aee836a577ebac64f77206e/f2/e75efa8fd7214151953e4467e101fb5d 2023-02-17 02:01:43,176 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/c691d9a9a766414e01e1a5d1e977f7ef/f2/5981aab5c8ae4fe59385233bb285c2e5 to hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/archive/data/default/testWithMockedMapReduceMultiRegion/c691d9a9a766414e01e1a5d1e977f7ef/f2/5981aab5c8ae4fe59385233bb285c2e5 2023-02-17 02:01:43,177 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/e59273498db883c4fe992b5078a4292b/f2/ec0ef30c275c4975b46cc4fcafc317d1 to hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/archive/data/default/testWithMockedMapReduceMultiRegion/e59273498db883c4fe992b5078a4292b/f2/ec0ef30c275c4975b46cc4fcafc317d1 2023-02-17 02:01:43,178 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/21311936f3c5e2464085c015fcb59dc0/f2/fc09d0ad57684cdfbef52e06095b34fa to hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/archive/data/default/testWithMockedMapReduceMultiRegion/21311936f3c5e2464085c015fcb59dc0/f2/fc09d0ad57684cdfbef52e06095b34fa 2023-02-17 02:01:43,185 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/7080b20bafef3fcca7e77fb1564444dc/f2/a41a42f58aa6425c8295c530473f7116 to hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/archive/data/default/testWithMockedMapReduceMultiRegion/7080b20bafef3fcca7e77fb1564444dc/f2/a41a42f58aa6425c8295c530473f7116 2023-02-17 02:01:43,190 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/27286d7877e172b7626d8faac32266d5/recovered.edits/12.seqid to hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/archive/data/default/testWithMockedMapReduceMultiRegion/27286d7877e172b7626d8faac32266d5/recovered.edits/12.seqid 2023-02-17 02:01:43,200 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/27286d7877e172b7626d8faac32266d5 2023-02-17 02:01:43,200 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/76c704a666ea47c826747b29fb61b262 2023-02-17 02:01:43,202 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/c691d9a9a766414e01e1a5d1e977f7ef/recovered.edits/12.seqid to hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/archive/data/default/testWithMockedMapReduceMultiRegion/c691d9a9a766414e01e1a5d1e977f7ef/recovered.edits/12.seqid 2023-02-17 02:01:43,202 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/6b374f0b5a440ed43ee4cdab132cd165/recovered.edits/12.seqid to hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/archive/data/default/testWithMockedMapReduceMultiRegion/6b374f0b5a440ed43ee4cdab132cd165/recovered.edits/12.seqid 2023-02-17 02:01:43,203 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/c691d9a9a766414e01e1a5d1e977f7ef 2023-02-17 02:01:43,204 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/d34d6d8b8aee836a577ebac64f77206e/recovered.edits/12.seqid to hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/archive/data/default/testWithMockedMapReduceMultiRegion/d34d6d8b8aee836a577ebac64f77206e/recovered.edits/12.seqid 2023-02-17 02:01:43,204 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/14f2c512e529cbb9d6867ebbf198fe39/f1/5fa203364e084b90b7dd58f7350af22a to hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/archive/data/default/testWithMockedMapReduceMultiRegion/14f2c512e529cbb9d6867ebbf198fe39/f1/5fa203364e084b90b7dd58f7350af22a 2023-02-17 02:01:43,204 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/6b374f0b5a440ed43ee4cdab132cd165 2023-02-17 02:01:43,205 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/21311936f3c5e2464085c015fcb59dc0/recovered.edits/12.seqid to hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/archive/data/default/testWithMockedMapReduceMultiRegion/21311936f3c5e2464085c015fcb59dc0/recovered.edits/12.seqid 2023-02-17 02:01:43,205 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/d34d6d8b8aee836a577ebac64f77206e 2023-02-17 02:01:43,206 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/21311936f3c5e2464085c015fcb59dc0 2023-02-17 02:01:43,206 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/7080b20bafef3fcca7e77fb1564444dc/recovered.edits/12.seqid to hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/archive/data/default/testWithMockedMapReduceMultiRegion/7080b20bafef3fcca7e77fb1564444dc/recovered.edits/12.seqid 2023-02-17 02:01:43,207 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/76c704a666ea47c826747b29fb61b262/f1, FileablePath, hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/76c704a666ea47c826747b29fb61b262/f2, FileablePath, hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/76c704a666ea47c826747b29fb61b262/recovered.edits] 2023-02-17 02:01:43,207 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/7080b20bafef3fcca7e77fb1564444dc 2023-02-17 02:01:43,207 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/14f2c512e529cbb9d6867ebbf198fe39/f1/a3f7d54f085f4e45a89049a95f9b9636 to hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/archive/data/default/testWithMockedMapReduceMultiRegion/14f2c512e529cbb9d6867ebbf198fe39/f1/a3f7d54f085f4e45a89049a95f9b9636 2023-02-17 02:01:43,207 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/e59273498db883c4fe992b5078a4292b/recovered.edits/12.seqid to hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/archive/data/default/testWithMockedMapReduceMultiRegion/e59273498db883c4fe992b5078a4292b/recovered.edits/12.seqid 2023-02-17 02:01:43,209 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/e59273498db883c4fe992b5078a4292b 2023-02-17 02:01:43,212 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/14f2c512e529cbb9d6867ebbf198fe39/f2/2621c32192244d74b076facaa42807a4 to hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/archive/data/default/testWithMockedMapReduceMultiRegion/14f2c512e529cbb9d6867ebbf198fe39/f2/2621c32192244d74b076facaa42807a4 2023-02-17 02:01:43,213 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/14f2c512e529cbb9d6867ebbf198fe39/f2/d62d74424c98482f8468af99ea6c0a4f to hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/archive/data/default/testWithMockedMapReduceMultiRegion/14f2c512e529cbb9d6867ebbf198fe39/f2/d62d74424c98482f8468af99ea6c0a4f 2023-02-17 02:01:43,214 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/76c704a666ea47c826747b29fb61b262/recovered.edits/6.seqid to hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/archive/data/default/testWithMockedMapReduceMultiRegion/76c704a666ea47c826747b29fb61b262/recovered.edits/6.seqid 2023-02-17 02:01:43,214 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/76c704a666ea47c826747b29fb61b262 2023-02-17 02:01:43,216 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/14f2c512e529cbb9d6867ebbf198fe39/recovered.edits/12.seqid to hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/archive/data/default/testWithMockedMapReduceMultiRegion/14f2c512e529cbb9d6867ebbf198fe39/recovered.edits/12.seqid 2023-02-17 02:01:43,217 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/.tmp/data/default/testWithMockedMapReduceMultiRegion/14f2c512e529cbb9d6867ebbf198fe39 2023-02-17 02:01:43,217 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-17 02:01:43,220 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-17 02:01:43,223 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMockedMapReduceMultiRegion from hbase:meta 2023-02-17 02:01:43,226 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceMultiRegion' descriptor. 2023-02-17 02:01:43,227 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-17 02:01:43,227 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceMultiRegion' from region states. 2023-02-17 02:01:43,227 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,,1676599299314.033e5165635b9ba2e8fffe93154e637e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676599303227"}]},"ts":"9223372036854775807"} 2023-02-17 02:01:43,227 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,aaa,1676599299314.e59273498db883c4fe992b5078a4292b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676599303227"}]},"ts":"9223372036854775807"} 2023-02-17 02:01:43,227 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676599299314.d34d6d8b8aee836a577ebac64f77206e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676599303227"}]},"ts":"9223372036854775807"} 2023-02-17 02:01:43,227 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676599299314.c691d9a9a766414e01e1a5d1e977f7ef.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676599303227"}]},"ts":"9223372036854775807"} 2023-02-17 02:01:43,227 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676599299314.7080b20bafef3fcca7e77fb1564444dc.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676599303227"}]},"ts":"9223372036854775807"} 2023-02-17 02:01:43,227 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676599299314.6b374f0b5a440ed43ee4cdab132cd165.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676599303227"}]},"ts":"9223372036854775807"} 2023-02-17 02:01:43,227 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676599299314.21311936f3c5e2464085c015fcb59dc0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676599303227"}]},"ts":"9223372036854775807"} 2023-02-17 02:01:43,227 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,t43,1676599299314.27286d7877e172b7626d8faac32266d5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676599303227"}]},"ts":"9223372036854775807"} 2023-02-17 02:01:43,227 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,wWV,1676599299314.14f2c512e529cbb9d6867ebbf198fe39.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676599303227"}]},"ts":"9223372036854775807"} 2023-02-17 02:01:43,227 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,zz{,1676599299314.76c704a666ea47c826747b29fb61b262.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676599303227"}]},"ts":"9223372036854775807"} 2023-02-17 02:01:43,229 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-17 02:01:43,229 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 033e5165635b9ba2e8fffe93154e637e, NAME => 'testWithMockedMapReduceMultiRegion,,1676599299314.033e5165635b9ba2e8fffe93154e637e.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => e59273498db883c4fe992b5078a4292b, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676599299314.e59273498db883c4fe992b5078a4292b.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => d34d6d8b8aee836a577ebac64f77206e, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676599299314.d34d6d8b8aee836a577ebac64f77206e.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => c691d9a9a766414e01e1a5d1e977f7ef, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676599299314.c691d9a9a766414e01e1a5d1e977f7ef.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => 7080b20bafef3fcca7e77fb1564444dc, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676599299314.7080b20bafef3fcca7e77fb1564444dc.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => 6b374f0b5a440ed43ee4cdab132cd165, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676599299314.6b374f0b5a440ed43ee4cdab132cd165.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => 21311936f3c5e2464085c015fcb59dc0, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676599299314.21311936f3c5e2464085c015fcb59dc0.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => 27286d7877e172b7626d8faac32266d5, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676599299314.27286d7877e172b7626d8faac32266d5.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => 14f2c512e529cbb9d6867ebbf198fe39, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676599299314.14f2c512e529cbb9d6867ebbf198fe39.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => 76c704a666ea47c826747b29fb61b262, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676599299314.76c704a666ea47c826747b29fb61b262.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-17 02:01:43,229 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceMultiRegion' as deleted. 2023-02-17 02:01:43,230 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676599303229"}]},"ts":"9223372036854775807"} 2023-02-17 02:01:43,237 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceMultiRegion state from META 2023-02-17 02:01:43,239 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-17 02:01:43,240 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion in 101 msec 2023-02-17 02:01:43,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-17 02:01:43,243 INFO [Listener at localhost/42831] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 54 completed 2023-02-17 02:01:43,243 INFO [Listener at localhost/42831] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-17 02:01:43,243 INFO [Listener at localhost/42831] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-17 02:01:43,243 DEBUG [Listener at localhost/42831] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x40811ad4 to 127.0.0.1:49216 2023-02-17 02:01:43,243 DEBUG [Listener at localhost/42831] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 02:01:43,243 DEBUG [Listener at localhost/42831] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-17 02:01:43,243 DEBUG [Listener at localhost/42831] util.JVMClusterUtil(257): Found active master hash=1187051577, stopped=false 2023-02-17 02:01:43,243 INFO [Listener at localhost/42831] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,44147,1676599297546 2023-02-17 02:01:43,247 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): regionserver:40913-0x1006002efba0002, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-17 02:01:43,247 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): regionserver:33169-0x1006002efba0001, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-17 02:01:43,247 INFO [Listener at localhost/42831] procedure2.ProcedureExecutor(629): Stopping 2023-02-17 02:01:43,247 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-17 02:01:43,247 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 02:01:43,248 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40913-0x1006002efba0002, quorum=127.0.0.1:49216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 02:01:43,248 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33169-0x1006002efba0001, quorum=127.0.0.1:49216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 02:01:43,248 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 02:01:43,248 DEBUG [Listener at localhost/42831] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3875192b to 127.0.0.1:49216 2023-02-17 02:01:43,249 DEBUG [Listener at localhost/42831] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 02:01:43,249 INFO [Listener at localhost/42831] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,33169,1676599297588' ***** 2023-02-17 02:01:43,249 INFO [Listener at localhost/42831] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-17 02:01:43,249 INFO [Listener at localhost/42831] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,40913,1676599297651' ***** 2023-02-17 02:01:43,249 INFO [Listener at localhost/42831] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-17 02:01:43,249 INFO [RS:0;jenkins-hbase4:33169] regionserver.HeapMemoryManager(220): Stopping 2023-02-17 02:01:43,249 INFO [RS:1;jenkins-hbase4:40913] regionserver.HeapMemoryManager(220): Stopping 2023-02-17 02:01:43,249 INFO [RS:0;jenkins-hbase4:33169] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-17 02:01:43,249 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-17 02:01:43,249 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-17 02:01:43,249 INFO [RS:0;jenkins-hbase4:33169] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-17 02:01:43,249 INFO [RS:1;jenkins-hbase4:40913] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-17 02:01:43,251 INFO [RS:0;jenkins-hbase4:33169] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,33169,1676599297588 2023-02-17 02:01:43,251 INFO [RS:1;jenkins-hbase4:40913] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-17 02:01:43,251 DEBUG [RS:0;jenkins-hbase4:33169] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2145d207 to 127.0.0.1:49216 2023-02-17 02:01:43,251 INFO [RS:1;jenkins-hbase4:40913] regionserver.HRegionServer(3304): Received CLOSE for 3b68d31ac448617f8eedd3050b1aaae5 2023-02-17 02:01:43,251 DEBUG [RS:0;jenkins-hbase4:33169] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 02:01:43,252 INFO [RS:1;jenkins-hbase4:40913] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,40913,1676599297651 2023-02-17 02:01:43,252 INFO [RS:0;jenkins-hbase4:33169] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,33169,1676599297588; all regions closed. 2023-02-17 02:01:43,252 DEBUG [RS:1;jenkins-hbase4:40913] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x25107751 to 127.0.0.1:49216 2023-02-17 02:01:43,252 DEBUG [RS:1;jenkins-hbase4:40913] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 02:01:43,252 INFO [RS:1;jenkins-hbase4:40913] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-17 02:01:43,252 INFO [RS:1;jenkins-hbase4:40913] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-17 02:01:43,252 INFO [RS:1;jenkins-hbase4:40913] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-17 02:01:43,252 INFO [RS:1;jenkins-hbase4:40913] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-17 02:01:43,252 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 3b68d31ac448617f8eedd3050b1aaae5, disabling compactions & flushes 2023-02-17 02:01:43,253 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676599298763.3b68d31ac448617f8eedd3050b1aaae5. 2023-02-17 02:01:43,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676599298763.3b68d31ac448617f8eedd3050b1aaae5. 2023-02-17 02:01:43,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676599298763.3b68d31ac448617f8eedd3050b1aaae5. after waiting 0 ms 2023-02-17 02:01:43,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676599298763.3b68d31ac448617f8eedd3050b1aaae5. 2023-02-17 02:01:43,253 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 3b68d31ac448617f8eedd3050b1aaae5 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-17 02:01:43,253 INFO [RS:1;jenkins-hbase4:40913] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-17 02:01:43,253 DEBUG [RS:1;jenkins-hbase4:40913] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740, 3b68d31ac448617f8eedd3050b1aaae5=hbase:namespace,,1676599298763.3b68d31ac448617f8eedd3050b1aaae5.} 2023-02-17 02:01:43,253 DEBUG [RS:1;jenkins-hbase4:40913] regionserver.HRegionServer(1505): Waiting on 1588230740, 3b68d31ac448617f8eedd3050b1aaae5 2023-02-17 02:01:43,255 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-17 02:01:43,255 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-17 02:01:43,255 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-17 02:01:43,255 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-17 02:01:43,255 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-17 02:01:43,256 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=28.36 KB heapSize=44.48 KB 2023-02-17 02:01:43,259 DEBUG [RS:0;jenkins-hbase4:33169] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/oldWALs 2023-02-17 02:01:43,259 INFO [RS:0;jenkins-hbase4:33169] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C33169%2C1676599297588:(num 1676599299053) 2023-02-17 02:01:43,259 DEBUG [RS:0;jenkins-hbase4:33169] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 02:01:43,259 INFO [RS:0;jenkins-hbase4:33169] regionserver.LeaseManager(133): Closed leases 2023-02-17 02:01:43,259 INFO [RS:0;jenkins-hbase4:33169] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-17 02:01:43,259 INFO [RS:0;jenkins-hbase4:33169] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-17 02:01:43,259 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-17 02:01:43,259 INFO [RS:0;jenkins-hbase4:33169] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-17 02:01:43,259 INFO [RS:0;jenkins-hbase4:33169] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-17 02:01:43,261 INFO [RS:0;jenkins-hbase4:33169] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33169 2023-02-17 02:01:43,263 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): regionserver:33169-0x1006002efba0001, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33169,1676599297588 2023-02-17 02:01:43,263 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 02:01:43,263 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): regionserver:33169-0x1006002efba0001, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 02:01:43,263 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): regionserver:40913-0x1006002efba0002, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33169,1676599297588 2023-02-17 02:01:43,263 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): regionserver:40913-0x1006002efba0002, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 02:01:43,264 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,33169,1676599297588] 2023-02-17 02:01:43,264 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,33169,1676599297588; numProcessing=1 2023-02-17 02:01:43,265 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,33169,1676599297588 already deleted, retry=false 2023-02-17 02:01:43,265 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,33169,1676599297588 expired; onlineServers=1 2023-02-17 02:01:43,267 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/hbase/namespace/3b68d31ac448617f8eedd3050b1aaae5/.tmp/info/b0932e58c5644d5dbd729aec0a27ac5d 2023-02-17 02:01:43,268 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=25.73 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/hbase/meta/1588230740/.tmp/info/9090ba286f164eb187d87f2084ab3953 2023-02-17 02:01:43,272 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/hbase/namespace/3b68d31ac448617f8eedd3050b1aaae5/.tmp/info/b0932e58c5644d5dbd729aec0a27ac5d as hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/hbase/namespace/3b68d31ac448617f8eedd3050b1aaae5/info/b0932e58c5644d5dbd729aec0a27ac5d 2023-02-17 02:01:43,272 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9090ba286f164eb187d87f2084ab3953 2023-02-17 02:01:43,276 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/hbase/namespace/3b68d31ac448617f8eedd3050b1aaae5/info/b0932e58c5644d5dbd729aec0a27ac5d, entries=2, sequenceid=6, filesize=4.8 K 2023-02-17 02:01:43,277 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 3b68d31ac448617f8eedd3050b1aaae5 in 24ms, sequenceid=6, compaction requested=false 2023-02-17 02:01:43,288 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/hbase/namespace/3b68d31ac448617f8eedd3050b1aaae5/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-17 02:01:43,289 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676599298763.3b68d31ac448617f8eedd3050b1aaae5. 2023-02-17 02:01:43,289 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 3b68d31ac448617f8eedd3050b1aaae5: 2023-02-17 02:01:43,289 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676599298763.3b68d31ac448617f8eedd3050b1aaae5. 2023-02-17 02:01:43,290 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.14 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/hbase/meta/1588230740/.tmp/rep_barrier/4305937a479a46f1a5b2a205e095eeb0 2023-02-17 02:01:43,294 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4305937a479a46f1a5b2a205e095eeb0 2023-02-17 02:01:43,319 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.49 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/hbase/meta/1588230740/.tmp/table/971294e3b36f42cd891bf2ddd4f6fc13 2023-02-17 02:01:43,323 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 971294e3b36f42cd891bf2ddd4f6fc13 2023-02-17 02:01:43,324 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/hbase/meta/1588230740/.tmp/info/9090ba286f164eb187d87f2084ab3953 as hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/hbase/meta/1588230740/info/9090ba286f164eb187d87f2084ab3953 2023-02-17 02:01:43,326 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-17 02:01:43,329 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9090ba286f164eb187d87f2084ab3953 2023-02-17 02:01:43,329 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/hbase/meta/1588230740/info/9090ba286f164eb187d87f2084ab3953, entries=30, sequenceid=57, filesize=8.3 K 2023-02-17 02:01:43,330 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/hbase/meta/1588230740/.tmp/rep_barrier/4305937a479a46f1a5b2a205e095eeb0 as hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/hbase/meta/1588230740/rep_barrier/4305937a479a46f1a5b2a205e095eeb0 2023-02-17 02:01:43,334 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4305937a479a46f1a5b2a205e095eeb0 2023-02-17 02:01:43,335 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/hbase/meta/1588230740/rep_barrier/4305937a479a46f1a5b2a205e095eeb0, entries=10, sequenceid=57, filesize=6.1 K 2023-02-17 02:01:43,335 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/hbase/meta/1588230740/.tmp/table/971294e3b36f42cd891bf2ddd4f6fc13 as hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/hbase/meta/1588230740/table/971294e3b36f42cd891bf2ddd4f6fc13 2023-02-17 02:01:43,336 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-17 02:01:43,340 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 971294e3b36f42cd891bf2ddd4f6fc13 2023-02-17 02:01:43,340 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/hbase/meta/1588230740/table/971294e3b36f42cd891bf2ddd4f6fc13, entries=13, sequenceid=57, filesize=6.1 K 2023-02-17 02:01:43,341 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~28.36 KB/29041, heapSize ~44.44 KB/45504, currentSize=0 B/0 for 1588230740 in 86ms, sequenceid=57, compaction requested=false 2023-02-17 02:01:43,345 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-17 02:01:43,346 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-17 02:01:43,347 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-17 02:01:43,347 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-17 02:01:43,347 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-17 02:01:43,446 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): regionserver:33169-0x1006002efba0001, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 02:01:43,446 INFO [RS:0;jenkins-hbase4:33169] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,33169,1676599297588; zookeeper connection closed. 2023-02-17 02:01:43,446 ERROR [Listener at localhost/42831-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1c2c66ea rejected from java.util.concurrent.ThreadPoolExecutor@1813e1b7[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 02:01:43,447 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): regionserver:33169-0x1006002efba0001, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 02:01:43,447 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@634784e8] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@634784e8 2023-02-17 02:01:43,447 ERROR [Listener at localhost/42831-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@13626806 rejected from java.util.concurrent.ThreadPoolExecutor@1813e1b7[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 02:01:43,453 INFO [RS:1;jenkins-hbase4:40913] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,40913,1676599297651; all regions closed. 2023-02-17 02:01:43,459 DEBUG [RS:1;jenkins-hbase4:40913] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/oldWALs 2023-02-17 02:01:43,459 INFO [RS:1;jenkins-hbase4:40913] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40913%2C1676599297651.meta:.meta(num 1676599298693) 2023-02-17 02:01:43,463 DEBUG [RS:1;jenkins-hbase4:40913] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/oldWALs 2023-02-17 02:01:43,463 INFO [RS:1;jenkins-hbase4:40913] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40913%2C1676599297651:(num 1676599299051) 2023-02-17 02:01:43,463 DEBUG [RS:1;jenkins-hbase4:40913] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 02:01:43,463 INFO [RS:1;jenkins-hbase4:40913] regionserver.LeaseManager(133): Closed leases 2023-02-17 02:01:43,463 INFO [RS:1;jenkins-hbase4:40913] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-17 02:01:43,463 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-17 02:01:43,464 INFO [RS:1;jenkins-hbase4:40913] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40913 2023-02-17 02:01:43,466 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 02:01:43,466 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): regionserver:40913-0x1006002efba0002, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40913,1676599297651 2023-02-17 02:01:43,466 ERROR [Listener at localhost/42831-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2f7cc2d4 rejected from java.util.concurrent.ThreadPoolExecutor@2b4343e3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 02:01:43,467 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40913,1676599297651] 2023-02-17 02:01:43,467 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40913,1676599297651; numProcessing=2 2023-02-17 02:01:43,468 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40913,1676599297651 already deleted, retry=false 2023-02-17 02:01:43,468 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,40913,1676599297651 expired; onlineServers=0 2023-02-17 02:01:43,468 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,44147,1676599297546' ***** 2023-02-17 02:01:43,468 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-17 02:01:43,471 DEBUG [M:0;jenkins-hbase4:44147] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@42ff7439, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-17 02:01:43,471 INFO [M:0;jenkins-hbase4:44147] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,44147,1676599297546 2023-02-17 02:01:43,471 INFO [M:0;jenkins-hbase4:44147] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,44147,1676599297546; all regions closed. 2023-02-17 02:01:43,471 DEBUG [M:0;jenkins-hbase4:44147] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 02:01:43,471 DEBUG [M:0;jenkins-hbase4:44147] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-17 02:01:43,471 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-17 02:01:43,471 DEBUG [M:0;jenkins-hbase4:44147] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-17 02:01:43,471 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676599297912] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676599297912,5,FailOnTimeoutGroup] 2023-02-17 02:01:43,471 INFO [M:0;jenkins-hbase4:44147] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-17 02:01:43,471 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676599297921] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676599297921,5,FailOnTimeoutGroup] 2023-02-17 02:01:43,472 INFO [M:0;jenkins-hbase4:44147] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-17 02:01:43,473 INFO [M:0;jenkins-hbase4:44147] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-17 02:01:43,473 DEBUG [M:0;jenkins-hbase4:44147] master.HMaster(1512): Stopping service threads 2023-02-17 02:01:43,473 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-17 02:01:43,473 INFO [M:0;jenkins-hbase4:44147] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-17 02:01:43,473 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 02:01:43,474 ERROR [M:0;jenkins-hbase4:44147] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-17 02:01:43,474 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 02:01:43,474 INFO [M:0;jenkins-hbase4:44147] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-17 02:01:43,474 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-17 02:01:43,474 DEBUG [M:0;jenkins-hbase4:44147] zookeeper.ZKUtil(398): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-17 02:01:43,474 WARN [M:0;jenkins-hbase4:44147] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-17 02:01:43,474 INFO [M:0;jenkins-hbase4:44147] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-17 02:01:43,475 INFO [M:0;jenkins-hbase4:44147] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-17 02:01:43,475 DEBUG [M:0;jenkins-hbase4:44147] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-17 02:01:43,475 INFO [M:0;jenkins-hbase4:44147] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 02:01:43,475 DEBUG [M:0;jenkins-hbase4:44147] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 02:01:43,475 DEBUG [M:0;jenkins-hbase4:44147] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-17 02:01:43,475 DEBUG [M:0;jenkins-hbase4:44147] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 02:01:43,475 INFO [M:0;jenkins-hbase4:44147] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=167.14 KB heapSize=200.04 KB 2023-02-17 02:01:43,485 INFO [M:0;jenkins-hbase4:44147] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=167.14 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/ae8e3929568c4133bb6e7bbc1d1ffd36 2023-02-17 02:01:43,490 DEBUG [M:0;jenkins-hbase4:44147] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/ae8e3929568c4133bb6e7bbc1d1ffd36 as hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/ae8e3929568c4133bb6e7bbc1d1ffd36 2023-02-17 02:01:43,494 INFO [M:0;jenkins-hbase4:44147] regionserver.HStore(1080): Added hdfs://localhost:33493/user/jenkins/test-data/21b812e9-a0c2-2bbd-1a57-19aba9fce902/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/ae8e3929568c4133bb6e7bbc1d1ffd36, entries=53, sequenceid=357, filesize=10.7 K 2023-02-17 02:01:43,495 INFO [M:0;jenkins-hbase4:44147] regionserver.HRegion(2947): Finished flush of dataSize ~167.14 KB/171150, heapSize ~200.02 KB/204824, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 20ms, sequenceid=357, compaction requested=false 2023-02-17 02:01:43,496 INFO [M:0;jenkins-hbase4:44147] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 02:01:43,496 DEBUG [M:0;jenkins-hbase4:44147] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-17 02:01:43,499 INFO [M:0;jenkins-hbase4:44147] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-17 02:01:43,499 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-17 02:01:43,501 INFO [M:0;jenkins-hbase4:44147] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44147 2023-02-17 02:01:43,506 DEBUG [M:0;jenkins-hbase4:44147] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,44147,1676599297546 already deleted, retry=false 2023-02-17 02:01:43,848 INFO [M:0;jenkins-hbase4:44147] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,44147,1676599297546; zookeeper connection closed. 2023-02-17 02:01:43,848 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 02:01:43,849 ERROR [Listener at localhost/42831-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3c94ce2f rejected from java.util.concurrent.ThreadPoolExecutor@38ab5d65[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 56] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 02:01:43,849 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): master:44147-0x1006002efba0000, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 02:01:43,849 ERROR [Listener at localhost/42831-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@56e1a62a rejected from java.util.concurrent.ThreadPoolExecutor@38ab5d65[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 56] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 02:01:43,948 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): regionserver:40913-0x1006002efba0002, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 02:01:43,948 INFO [RS:1;jenkins-hbase4:40913] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,40913,1676599297651; zookeeper connection closed. 2023-02-17 02:01:43,948 ERROR [Listener at localhost/42831-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@16c68a04 rejected from java.util.concurrent.ThreadPoolExecutor@2b4343e3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 02:01:43,949 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1e3ea550] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1e3ea550 2023-02-17 02:01:43,949 DEBUG [Listener at localhost/42831-EventThread] zookeeper.ZKWatcher(600): regionserver:40913-0x1006002efba0002, quorum=127.0.0.1:49216, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 02:01:43,949 ERROR [Listener at localhost/42831-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6e089c3e rejected from java.util.concurrent.ThreadPoolExecutor@2b4343e3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 02:01:43,949 INFO [Listener at localhost/42831] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-17 02:01:43,950 WARN [Listener at localhost/42831] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-17 02:01:43,953 INFO [Listener at localhost/42831] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-17 02:01:44,062 WARN [BP-322106576-172.31.14.131-1676599296888 heartbeating to localhost/127.0.0.1:33493] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-17 02:01:44,062 WARN [BP-322106576-172.31.14.131-1676599296888 heartbeating to localhost/127.0.0.1:33493] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-322106576-172.31.14.131-1676599296888 (Datanode Uuid 80e187cc-cf92-4205-91f7-3764636eafdb) service to localhost/127.0.0.1:33493 2023-02-17 02:01:44,063 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fa0ee6e0-39b1-6286-e115-44936a7d8bb6/cluster_418c5021-b134-37cb-f05f-c6267f0b5fbc/dfs/data/data3/current/BP-322106576-172.31.14.131-1676599296888] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 02:01:44,063 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fa0ee6e0-39b1-6286-e115-44936a7d8bb6/cluster_418c5021-b134-37cb-f05f-c6267f0b5fbc/dfs/data/data4/current/BP-322106576-172.31.14.131-1676599296888] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 02:01:44,064 WARN [Listener at localhost/42831] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-17 02:01:44,067 INFO [Listener at localhost/42831] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-17 02:01:44,171 WARN [BP-322106576-172.31.14.131-1676599296888 heartbeating to localhost/127.0.0.1:33493] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-17 02:01:44,172 WARN [BP-322106576-172.31.14.131-1676599296888 heartbeating to localhost/127.0.0.1:33493] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-322106576-172.31.14.131-1676599296888 (Datanode Uuid 37b9f587-2da6-4c90-b8cf-80a19bca9ac5) service to localhost/127.0.0.1:33493 2023-02-17 02:01:44,172 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fa0ee6e0-39b1-6286-e115-44936a7d8bb6/cluster_418c5021-b134-37cb-f05f-c6267f0b5fbc/dfs/data/data1/current/BP-322106576-172.31.14.131-1676599296888] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 02:01:44,172 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fa0ee6e0-39b1-6286-e115-44936a7d8bb6/cluster_418c5021-b134-37cb-f05f-c6267f0b5fbc/dfs/data/data2/current/BP-322106576-172.31.14.131-1676599296888] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 02:01:44,181 INFO [Listener at localhost/42831] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-17 02:01:44,217 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-17 02:01:44,305 INFO [Listener at localhost/42831] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-17 02:01:44,352 INFO [Listener at localhost/42831] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-17 02:01:44,371 INFO [Listener at localhost/42831] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=230 (was 180) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-12 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/42831.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/42831.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/42831.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/42831.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-13-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/42831.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Client (1508527786) connection to localhost/127.0.0.1:33493 from jenkins.hfs.6 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Listener at localhost/42831 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1508527786) connection to localhost/127.0.0.1:33493 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-12-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.7@localhost:33493 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/42831.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-13-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,44147,1676599297546)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.6@localhost:33493 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/42831.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-14-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-16-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/42831.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LeaseRenewer:jenkins@localhost:33493 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-10 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1508527786) connection to localhost/127.0.0.1:33493 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-11 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-16-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/42831.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Client (1508527786) connection to localhost/127.0.0.1:33493 from jenkins.hfs.7 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-15-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-16-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/42831.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) - Thread LEAK? -, OpenFileDescriptor=623 (was 571) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=356 (was 335) - SystemLoadAverage LEAK? -, ProcessCount=170 (was 170), AvailableMemoryMB=7403 (was 7550) 2023-02-17 02:01:44,383 INFO [Listener at localhost/42831] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=230, OpenFileDescriptor=623, MaxFileDescriptor=60000, SystemLoadAverage=356, ProcessCount=170, AvailableMemoryMB=7403 2023-02-17 02:01:44,395 INFO [Listener at localhost/42831] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fa0ee6e0-39b1-6286-e115-44936a7d8bb6/hadoop.log.dir so I do NOT create it in target/test-data/c9440df8-f718-d21e-3493-16dc72ea0e0d 2023-02-17 02:01:44,395 WARN [Listener at localhost/42831] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fa0ee6e0-39b1-6286-e115-44936a7d8bb6/hadoop.log.dir Erasing configuration value by system value. 2023-02-17 02:01:44,395 INFO [Listener at localhost/42831] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fa0ee6e0-39b1-6286-e115-44936a7d8bb6/hadoop.tmp.dir so I do NOT create it in target/test-data/c9440df8-f718-d21e-3493-16dc72ea0e0d 2023-02-17 02:01:44,395 WARN [Listener at localhost/42831] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fa0ee6e0-39b1-6286-e115-44936a7d8bb6/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-17 02:01:44,395 DEBUG [Listener at localhost/42831] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9440df8-f718-d21e-3493-16dc72ea0e0d 2023-02-17 02:01:44,395 INFO [Listener at localhost/42831] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-17 02:01:44,395 INFO [Listener at localhost/42831] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9440df8-f718-d21e-3493-16dc72ea0e0d/cluster_a7500156-fa50-d925-020d-c6d11b249bd3, deleteOnExit=true 2023-02-17 02:01:44,395 INFO [Listener at localhost/42831] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-17 02:01:44,395 INFO [Listener at localhost/42831] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9440df8-f718-d21e-3493-16dc72ea0e0d/test.cache.data in system properties and HBase conf 2023-02-17 02:01:44,396 INFO [Listener at localhost/42831] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9440df8-f718-d21e-3493-16dc72ea0e0d/hadoop.tmp.dir in system properties and HBase conf 2023-02-17 02:01:44,396 INFO [Listener at localhost/42831] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9440df8-f718-d21e-3493-16dc72ea0e0d/hadoop.log.dir in system properties and HBase conf 2023-02-17 02:01:44,396 INFO [Listener at localhost/42831] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9440df8-f718-d21e-3493-16dc72ea0e0d/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-17 02:01:44,396 INFO [Listener at localhost/42831] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9440df8-f718-d21e-3493-16dc72ea0e0d/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-17 02:01:44,396 INFO [Listener at localhost/42831] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-17 02:01:44,396 DEBUG [Listener at localhost/42831] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-17 02:01:44,396 INFO [Listener at localhost/42831] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9440df8-f718-d21e-3493-16dc72ea0e0d/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-17 02:01:44,397 INFO [Listener at localhost/42831] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9440df8-f718-d21e-3493-16dc72ea0e0d/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-17 02:01:44,397 INFO [Listener at localhost/42831] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9440df8-f718-d21e-3493-16dc72ea0e0d/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-17 02:01:44,397 INFO [Listener at localhost/42831] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9440df8-f718-d21e-3493-16dc72ea0e0d/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-17 02:01:44,397 INFO [Listener at localhost/42831] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9440df8-f718-d21e-3493-16dc72ea0e0d/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-17 02:01:44,397 INFO [Listener at localhost/42831] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9440df8-f718-d21e-3493-16dc72ea0e0d/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-17 02:01:44,397 INFO [Listener at localhost/42831] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9440df8-f718-d21e-3493-16dc72ea0e0d/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-17 02:01:44,397 INFO [Listener at localhost/42831] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9440df8-f718-d21e-3493-16dc72ea0e0d/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-17 02:01:44,397 INFO [Listener at localhost/42831] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9440df8-f718-d21e-3493-16dc72ea0e0d/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-17 02:01:44,397 INFO [Listener at localhost/42831] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9440df8-f718-d21e-3493-16dc72ea0e0d/nfs.dump.dir in system properties and HBase conf 2023-02-17 02:01:44,397 INFO [Listener at localhost/42831] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9440df8-f718-d21e-3493-16dc72ea0e0d/java.io.tmpdir in system properties and HBase conf 2023-02-17 02:01:44,397 INFO [Listener at localhost/42831] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9440df8-f718-d21e-3493-16dc72ea0e0d/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-17 02:01:44,398 INFO [Listener at localhost/42831] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9440df8-f718-d21e-3493-16dc72ea0e0d/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-17 02:01:44,398 INFO [Listener at localhost/42831] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9440df8-f718-d21e-3493-16dc72ea0e0d/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-17 02:01:44,402 WARN [Listener at localhost/42831] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-17 02:01:44,402 WARN [Listener at localhost/42831] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-17 02:01:44,445 WARN [Listener at localhost/42831] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-17 02:01:44,447 INFO [Listener at localhost/42831] log.Slf4jLog(67): jetty-6.1.26 2023-02-17 02:01:44,453 INFO [Listener at localhost/42831] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9440df8-f718-d21e-3493-16dc72ea0e0d/java.io.tmpdir/Jetty_localhost_36023_hdfs____.xykroo/webapp 2023-02-17 02:01:44,546 INFO [Listener at localhost/42831] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36023 2023-02-17 02:01:44,550 WARN [Listener at localhost/42831] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-17 02:01:44,550 WARN [Listener at localhost/42831] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-17 02:01:44,616 WARN [Listener at localhost/35683] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-17 02:01:44,646 WARN [Listener at localhost/35683] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-17 02:01:44,648 WARN [Listener at localhost/35683] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-17 02:01:44,650 INFO [Listener at localhost/35683] log.Slf4jLog(67): jetty-6.1.26 2023-02-17 02:01:44,656 INFO [Listener at localhost/35683] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9440df8-f718-d21e-3493-16dc72ea0e0d/java.io.tmpdir/Jetty_localhost_39583_datanode____t0jlwx/webapp 2023-02-17 02:01:44,749 INFO [Listener at localhost/35683] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39583 2023-02-17 02:01:44,756 WARN [Listener at localhost/43931] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-17 02:01:44,771 WARN [Listener at localhost/43931] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-17 02:01:44,773 WARN [Listener at localhost/43931] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-17 02:01:44,774 INFO [Listener at localhost/43931] log.Slf4jLog(67): jetty-6.1.26 2023-02-17 02:01:44,777 INFO [Listener at localhost/43931] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9440df8-f718-d21e-3493-16dc72ea0e0d/java.io.tmpdir/Jetty_localhost_41361_datanode____oh2qk8/webapp 2023-02-17 02:01:44,862 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc67c6fbd232a5c41: Processing first storage report for DS-00edc618-dc7f-44f2-ab41-34fc6decc957 from datanode 46a5c068-c24c-435a-81f4-234897490832 2023-02-17 02:01:44,862 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc67c6fbd232a5c41: from storage DS-00edc618-dc7f-44f2-ab41-34fc6decc957 node DatanodeRegistration(127.0.0.1:45015, datanodeUuid=46a5c068-c24c-435a-81f4-234897490832, infoPort=40985, infoSecurePort=0, ipcPort=43931, storageInfo=lv=-57;cid=testClusterID;nsid=1300181398;c=1676599304405), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-17 02:01:44,862 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc67c6fbd232a5c41: Processing first storage report for DS-09696b38-5351-4d83-b4b9-7f2724598e52 from datanode 46a5c068-c24c-435a-81f4-234897490832 2023-02-17 02:01:44,862 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc67c6fbd232a5c41: from storage DS-09696b38-5351-4d83-b4b9-7f2724598e52 node DatanodeRegistration(127.0.0.1:45015, datanodeUuid=46a5c068-c24c-435a-81f4-234897490832, infoPort=40985, infoSecurePort=0, ipcPort=43931, storageInfo=lv=-57;cid=testClusterID;nsid=1300181398;c=1676599304405), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-17 02:01:44,879 INFO [Listener at localhost/43931] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41361 2023-02-17 02:01:44,888 WARN [Listener at localhost/41671] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-17 02:01:44,985 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc09241c12541c595: Processing first storage report for DS-0ec111ad-c221-43a0-beb6-5686d6e6cb24 from datanode b6904d76-5f44-4106-8f28-b228a31bb3f8 2023-02-17 02:01:44,985 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc09241c12541c595: from storage DS-0ec111ad-c221-43a0-beb6-5686d6e6cb24 node DatanodeRegistration(127.0.0.1:34289, datanodeUuid=b6904d76-5f44-4106-8f28-b228a31bb3f8, infoPort=45029, infoSecurePort=0, ipcPort=41671, storageInfo=lv=-57;cid=testClusterID;nsid=1300181398;c=1676599304405), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-17 02:01:44,985 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc09241c12541c595: Processing first storage report for DS-17a443f9-063f-4081-a175-a5ac23b2ca43 from datanode b6904d76-5f44-4106-8f28-b228a31bb3f8 2023-02-17 02:01:44,985 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc09241c12541c595: from storage DS-17a443f9-063f-4081-a175-a5ac23b2ca43 node DatanodeRegistration(127.0.0.1:34289, datanodeUuid=b6904d76-5f44-4106-8f28-b228a31bb3f8, infoPort=45029, infoSecurePort=0, ipcPort=41671, storageInfo=lv=-57;cid=testClusterID;nsid=1300181398;c=1676599304405), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-17 02:01:44,994 DEBUG [Listener at localhost/41671] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9440df8-f718-d21e-3493-16dc72ea0e0d 2023-02-17 02:01:44,996 INFO [Listener at localhost/41671] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9440df8-f718-d21e-3493-16dc72ea0e0d/cluster_a7500156-fa50-d925-020d-c6d11b249bd3/zookeeper_0, clientPort=64305, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9440df8-f718-d21e-3493-16dc72ea0e0d/cluster_a7500156-fa50-d925-020d-c6d11b249bd3/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9440df8-f718-d21e-3493-16dc72ea0e0d/cluster_a7500156-fa50-d925-020d-c6d11b249bd3/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-17 02:01:44,997 INFO [Listener at localhost/41671] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=64305 2023-02-17 02:01:44,997 INFO [Listener at localhost/41671] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 02:01:44,998 INFO [Listener at localhost/41671] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 02:01:45,009 INFO [Listener at localhost/41671] util.FSUtils(479): Created version file at hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f with version=8 2023-02-17 02:01:45,009 INFO [Listener at localhost/41671] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 02:01:45,010 INFO [Listener at localhost/41671] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 02:01:45,011 INFO [Listener at localhost/41671] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:35683/user/jenkins/test-data/7782fbc0-81a6-fdea-a814-5539fbeaabe2/hbase-staging 2023-02-17 02:01:45,013 INFO [Listener at localhost/41671] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-17 02:01:45,013 INFO [Listener at localhost/41671] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 02:01:45,013 INFO [Listener at localhost/41671] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-17 02:01:45,013 INFO [Listener at localhost/41671] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-17 02:01:45,013 INFO [Listener at localhost/41671] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 02:01:45,014 INFO [Listener at localhost/41671] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-17 02:01:45,014 INFO [Listener at localhost/41671] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-17 02:01:45,014 INFO [Listener at localhost/41671] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39221 2023-02-17 02:01:45,015 INFO [Listener at localhost/41671] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 02:01:45,015 INFO [Listener at localhost/41671] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 02:01:45,016 INFO [Listener at localhost/41671] zookeeper.RecoverableZooKeeper(93): Process identifier=master:39221 connecting to ZooKeeper ensemble=127.0.0.1:64305 2023-02-17 02:01:45,024 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): master:392210x0, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-17 02:01:45,025 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:39221-0x10060030ce80000 connected 2023-02-17 02:01:45,038 DEBUG [Listener at localhost/41671] zookeeper.ZKUtil(164): master:39221-0x10060030ce80000, quorum=127.0.0.1:64305, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 02:01:45,039 DEBUG [Listener at localhost/41671] zookeeper.ZKUtil(164): master:39221-0x10060030ce80000, quorum=127.0.0.1:64305, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 02:01:45,039 DEBUG [Listener at localhost/41671] zookeeper.ZKUtil(164): master:39221-0x10060030ce80000, quorum=127.0.0.1:64305, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-17 02:01:45,039 DEBUG [Listener at localhost/41671] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39221 2023-02-17 02:01:45,039 DEBUG [Listener at localhost/41671] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39221 2023-02-17 02:01:45,040 DEBUG [Listener at localhost/41671] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39221 2023-02-17 02:01:45,040 DEBUG [Listener at localhost/41671] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39221 2023-02-17 02:01:45,040 DEBUG [Listener at localhost/41671] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39221 2023-02-17 02:01:45,040 INFO [Listener at localhost/41671] master.HMaster(444): hbase.rootdir=hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f, hbase.cluster.distributed=false 2023-02-17 02:01:45,055 INFO [Listener at localhost/41671] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-17 02:01:45,055 INFO [Listener at localhost/41671] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 02:01:45,056 INFO [Listener at localhost/41671] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-17 02:01:45,056 INFO [Listener at localhost/41671] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-17 02:01:45,056 INFO [Listener at localhost/41671] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 02:01:45,056 INFO [Listener at localhost/41671] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-17 02:01:45,056 INFO [Listener at localhost/41671] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-17 02:01:45,057 INFO [Listener at localhost/41671] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40955 2023-02-17 02:01:45,057 INFO [Listener at localhost/41671] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-17 02:01:45,060 DEBUG [Listener at localhost/41671] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 02:01:45,060 INFO [Listener at localhost/41671] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 02:01:45,061 INFO [Listener at localhost/41671] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 02:01:45,062 INFO [Listener at localhost/41671] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40955 connecting to ZooKeeper ensemble=127.0.0.1:64305 2023-02-17 02:01:45,065 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): regionserver:409550x0, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-17 02:01:45,067 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:40955-0x10060030ce80001 connected 2023-02-17 02:01:45,067 DEBUG [Listener at localhost/41671] zookeeper.ZKUtil(164): regionserver:40955-0x10060030ce80001, quorum=127.0.0.1:64305, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 02:01:45,068 DEBUG [Listener at localhost/41671] zookeeper.ZKUtil(164): regionserver:40955-0x10060030ce80001, quorum=127.0.0.1:64305, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 02:01:45,068 DEBUG [Listener at localhost/41671] zookeeper.ZKUtil(164): regionserver:40955-0x10060030ce80001, quorum=127.0.0.1:64305, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-17 02:01:45,069 DEBUG [Listener at localhost/41671] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40955 2023-02-17 02:01:45,069 DEBUG [Listener at localhost/41671] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40955 2023-02-17 02:01:45,069 DEBUG [Listener at localhost/41671] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40955 2023-02-17 02:01:45,069 DEBUG [Listener at localhost/41671] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40955 2023-02-17 02:01:45,069 DEBUG [Listener at localhost/41671] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40955 2023-02-17 02:01:45,081 INFO [Listener at localhost/41671] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-17 02:01:45,081 INFO [Listener at localhost/41671] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 02:01:45,081 INFO [Listener at localhost/41671] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-17 02:01:45,081 INFO [Listener at localhost/41671] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-17 02:01:45,081 INFO [Listener at localhost/41671] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 02:01:45,081 INFO [Listener at localhost/41671] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-17 02:01:45,081 INFO [Listener at localhost/41671] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-17 02:01:45,083 INFO [Listener at localhost/41671] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38323 2023-02-17 02:01:45,083 INFO [Listener at localhost/41671] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-17 02:01:45,084 DEBUG [Listener at localhost/41671] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 02:01:45,084 INFO [Listener at localhost/41671] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 02:01:45,085 INFO [Listener at localhost/41671] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 02:01:45,086 INFO [Listener at localhost/41671] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38323 connecting to ZooKeeper ensemble=127.0.0.1:64305 2023-02-17 02:01:45,089 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): regionserver:383230x0, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-17 02:01:45,090 DEBUG [Listener at localhost/41671] zookeeper.ZKUtil(164): regionserver:383230x0, quorum=127.0.0.1:64305, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 02:01:45,091 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:38323-0x10060030ce80002 connected 2023-02-17 02:01:45,091 DEBUG [Listener at localhost/41671] zookeeper.ZKUtil(164): regionserver:38323-0x10060030ce80002, quorum=127.0.0.1:64305, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 02:01:45,092 DEBUG [Listener at localhost/41671] zookeeper.ZKUtil(164): regionserver:38323-0x10060030ce80002, quorum=127.0.0.1:64305, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-17 02:01:45,092 DEBUG [Listener at localhost/41671] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38323 2023-02-17 02:01:45,092 DEBUG [Listener at localhost/41671] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38323 2023-02-17 02:01:45,092 DEBUG [Listener at localhost/41671] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38323 2023-02-17 02:01:45,093 DEBUG [Listener at localhost/41671] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38323 2023-02-17 02:01:45,093 DEBUG [Listener at localhost/41671] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38323 2023-02-17 02:01:45,094 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,39221,1676599305013 2023-02-17 02:01:45,096 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): master:39221-0x10060030ce80000, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-17 02:01:45,096 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39221-0x10060030ce80000, quorum=127.0.0.1:64305, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,39221,1676599305013 2023-02-17 02:01:45,098 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): master:39221-0x10060030ce80000, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-17 02:01:45,098 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): regionserver:40955-0x10060030ce80001, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-17 02:01:45,098 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): master:39221-0x10060030ce80000, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 02:01:45,098 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): regionserver:38323-0x10060030ce80002, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-17 02:01:45,099 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39221-0x10060030ce80000, quorum=127.0.0.1:64305, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-17 02:01:45,100 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,39221,1676599305013 from backup master directory 2023-02-17 02:01:45,101 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:39221-0x10060030ce80000, quorum=127.0.0.1:64305, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-17 02:01:45,101 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): master:39221-0x10060030ce80000, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,39221,1676599305013 2023-02-17 02:01:45,101 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): master:39221-0x10060030ce80000, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-17 02:01:45,101 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-17 02:01:45,102 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,39221,1676599305013 2023-02-17 02:01:45,113 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/hbase.id with ID: 98dddbec-c2b7-4e32-957c-254633b226b6 2023-02-17 02:01:45,123 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 02:01:45,125 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): master:39221-0x10060030ce80000, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 02:01:45,147 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x2f2c353e to 127.0.0.1:64305 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 02:01:45,168 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@332b3418, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 02:01:45,168 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-17 02:01:45,169 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-17 02:01:45,176 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 02:01:45,178 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/MasterData/data/master/store-tmp 2023-02-17 02:01:45,186 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:45,187 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-17 02:01:45,187 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 02:01:45,187 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 02:01:45,187 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-17 02:01:45,187 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 02:01:45,187 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 02:01:45,187 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-17 02:01:45,187 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/MasterData/WALs/jenkins-hbase4.apache.org,39221,1676599305013 2023-02-17 02:01:45,190 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39221%2C1676599305013, suffix=, logDir=hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/MasterData/WALs/jenkins-hbase4.apache.org,39221,1676599305013, archiveDir=hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/MasterData/oldWALs, maxLogs=10 2023-02-17 02:01:45,209 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45015,DS-00edc618-dc7f-44f2-ab41-34fc6decc957,DISK] 2023-02-17 02:01:45,209 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34289,DS-0ec111ad-c221-43a0-beb6-5686d6e6cb24,DISK] 2023-02-17 02:01:45,211 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/MasterData/WALs/jenkins-hbase4.apache.org,39221,1676599305013/jenkins-hbase4.apache.org%2C39221%2C1676599305013.1676599305190 2023-02-17 02:01:45,211 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45015,DS-00edc618-dc7f-44f2-ab41-34fc6decc957,DISK], DatanodeInfoWithStorage[127.0.0.1:34289,DS-0ec111ad-c221-43a0-beb6-5686d6e6cb24,DISK]] 2023-02-17 02:01:45,211 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-17 02:01:45,211 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:45,211 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-17 02:01:45,211 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-17 02:01:45,213 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-17 02:01:45,214 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-17 02:01:45,214 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-17 02:01:45,215 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:45,215 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-17 02:01:45,216 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-17 02:01:45,218 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-17 02:01:45,220 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 02:01:45,221 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73305537, jitterRate=0.09233762323856354}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-17 02:01:45,221 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-17 02:01:45,228 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-17 02:01:45,229 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-17 02:01:45,230 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-17 02:01:45,230 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-17 02:01:45,230 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-17 02:01:45,230 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-17 02:01:45,230 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-17 02:01:45,231 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-17 02:01:45,232 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-17 02:01:45,247 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-17 02:01:45,247 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-17 02:01:45,248 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39221-0x10060030ce80000, quorum=127.0.0.1:64305, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-17 02:01:45,248 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-17 02:01:45,248 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39221-0x10060030ce80000, quorum=127.0.0.1:64305, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-17 02:01:45,251 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): master:39221-0x10060030ce80000, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 02:01:45,251 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39221-0x10060030ce80000, quorum=127.0.0.1:64305, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-17 02:01:45,251 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39221-0x10060030ce80000, quorum=127.0.0.1:64305, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-17 02:01:45,252 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39221-0x10060030ce80000, quorum=127.0.0.1:64305, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-17 02:01:45,254 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): regionserver:40955-0x10060030ce80001, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-17 02:01:45,254 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): regionserver:38323-0x10060030ce80002, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-17 02:01:45,254 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): master:39221-0x10060030ce80000, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-17 02:01:45,254 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): master:39221-0x10060030ce80000, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 02:01:45,255 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,39221,1676599305013, sessionid=0x10060030ce80000, setting cluster-up flag (Was=false) 2023-02-17 02:01:45,264 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): master:39221-0x10060030ce80000, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 02:01:45,272 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-17 02:01:45,273 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,39221,1676599305013 2023-02-17 02:01:45,277 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): master:39221-0x10060030ce80000, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 02:01:45,290 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-17 02:01:45,291 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,39221,1676599305013 2023-02-17 02:01:45,291 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/.hbase-snapshot/.tmp 2023-02-17 02:01:45,293 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-17 02:01:45,293 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-17 02:01:45,293 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-17 02:01:45,293 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-17 02:01:45,293 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-17 02:01:45,293 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-17 02:01:45,294 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:45,294 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-17 02:01:45,295 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:45,295 INFO [RS:0;jenkins-hbase4:40955] regionserver.HRegionServer(952): ClusterId : 98dddbec-c2b7-4e32-957c-254633b226b6 2023-02-17 02:01:45,295 INFO [RS:1;jenkins-hbase4:38323] regionserver.HRegionServer(952): ClusterId : 98dddbec-c2b7-4e32-957c-254633b226b6 2023-02-17 02:01:45,295 DEBUG [RS:0;jenkins-hbase4:40955] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-17 02:01:45,295 DEBUG [RS:1;jenkins-hbase4:38323] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-17 02:01:45,300 DEBUG [RS:0;jenkins-hbase4:40955] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-17 02:01:45,300 DEBUG [RS:0;jenkins-hbase4:40955] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-17 02:01:45,301 DEBUG [RS:1;jenkins-hbase4:38323] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-17 02:01:45,302 DEBUG [RS:1;jenkins-hbase4:38323] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-17 02:01:45,310 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676599335310 2023-02-17 02:01:45,310 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-17 02:01:45,310 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-17 02:01:45,310 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-17 02:01:45,310 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-17 02:01:45,310 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-17 02:01:45,310 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-17 02:01:45,311 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:45,311 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-17 02:01:45,311 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-17 02:01:45,312 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-17 02:01:45,312 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-17 02:01:45,312 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-17 02:01:45,312 DEBUG [RS:0;jenkins-hbase4:40955] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-17 02:01:45,313 DEBUG [RS:1;jenkins-hbase4:38323] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-17 02:01:45,313 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-17 02:01:45,315 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-17 02:01:45,315 DEBUG [RS:0;jenkins-hbase4:40955] zookeeper.ReadOnlyZKClient(139): Connect 0x3d8d3869 to 127.0.0.1:64305 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 02:01:45,315 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-17 02:01:45,315 DEBUG [RS:1;jenkins-hbase4:38323] zookeeper.ReadOnlyZKClient(139): Connect 0x30ced96b to 127.0.0.1:64305 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 02:01:45,315 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676599305315,5,FailOnTimeoutGroup] 2023-02-17 02:01:45,316 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676599305316,5,FailOnTimeoutGroup] 2023-02-17 02:01:45,316 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:45,317 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-17 02:01:45,317 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:45,317 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:45,330 DEBUG [RS:1;jenkins-hbase4:38323] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3e093102, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 02:01:45,330 DEBUG [RS:1;jenkins-hbase4:38323] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3a36b21b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-17 02:01:45,332 DEBUG [RS:0;jenkins-hbase4:40955] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@334ac1a8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 02:01:45,332 DEBUG [RS:0;jenkins-hbase4:40955] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@37755319, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-17 02:01:45,336 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-17 02:01:45,336 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-17 02:01:45,337 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f 2023-02-17 02:01:45,341 DEBUG [RS:0;jenkins-hbase4:40955] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:40955 2023-02-17 02:01:45,342 INFO [RS:0;jenkins-hbase4:40955] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-17 02:01:45,342 INFO [RS:0;jenkins-hbase4:40955] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-17 02:01:45,342 DEBUG [RS:0;jenkins-hbase4:40955] regionserver.HRegionServer(1023): About to register with Master. 2023-02-17 02:01:45,342 DEBUG [RS:1;jenkins-hbase4:38323] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:38323 2023-02-17 02:01:45,342 INFO [RS:1;jenkins-hbase4:38323] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-17 02:01:45,342 INFO [RS:1;jenkins-hbase4:38323] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-17 02:01:45,342 DEBUG [RS:1;jenkins-hbase4:38323] regionserver.HRegionServer(1023): About to register with Master. 2023-02-17 02:01:45,342 INFO [RS:0;jenkins-hbase4:40955] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,39221,1676599305013 with isa=jenkins-hbase4.apache.org/172.31.14.131:40955, startcode=1676599305055 2023-02-17 02:01:45,342 DEBUG [RS:0;jenkins-hbase4:40955] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-17 02:01:45,342 INFO [RS:1;jenkins-hbase4:38323] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,39221,1676599305013 with isa=jenkins-hbase4.apache.org/172.31.14.131:38323, startcode=1676599305080 2023-02-17 02:01:45,343 DEBUG [RS:1;jenkins-hbase4:38323] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-17 02:01:45,343 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:45,344 INFO [RS-EventLoopGroup-15-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60075, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.8 (auth:SIMPLE), service=RegionServerStatusService 2023-02-17 02:01:45,344 INFO [RS-EventLoopGroup-15-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37505, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.9 (auth:SIMPLE), service=RegionServerStatusService 2023-02-17 02:01:45,344 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-17 02:01:45,346 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39221] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,40955,1676599305055 2023-02-17 02:01:45,346 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39221] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,38323,1676599305080 2023-02-17 02:01:45,347 DEBUG [RS:0;jenkins-hbase4:40955] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f 2023-02-17 02:01:45,347 DEBUG [RS:1;jenkins-hbase4:38323] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f 2023-02-17 02:01:45,347 DEBUG [RS:0;jenkins-hbase4:40955] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:35683 2023-02-17 02:01:45,347 DEBUG [RS:1;jenkins-hbase4:38323] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:35683 2023-02-17 02:01:45,347 DEBUG [RS:0;jenkins-hbase4:40955] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-17 02:01:45,347 DEBUG [RS:1;jenkins-hbase4:38323] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-17 02:01:45,348 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/data/hbase/meta/1588230740/info 2023-02-17 02:01:45,348 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-17 02:01:45,348 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:45,349 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-17 02:01:45,349 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/data/hbase/meta/1588230740/rep_barrier 2023-02-17 02:01:45,350 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-17 02:01:45,350 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:45,350 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-17 02:01:45,351 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/data/hbase/meta/1588230740/table 2023-02-17 02:01:45,351 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-17 02:01:45,351 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:45,352 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/data/hbase/meta/1588230740 2023-02-17 02:01:45,352 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/data/hbase/meta/1588230740 2023-02-17 02:01:45,353 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): master:39221-0x10060030ce80000, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 02:01:45,354 DEBUG [RS:0;jenkins-hbase4:40955] zookeeper.ZKUtil(162): regionserver:40955-0x10060030ce80001, quorum=127.0.0.1:64305, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40955,1676599305055 2023-02-17 02:01:45,354 DEBUG [RS:1;jenkins-hbase4:38323] zookeeper.ZKUtil(162): regionserver:38323-0x10060030ce80002, quorum=127.0.0.1:64305, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38323,1676599305080 2023-02-17 02:01:45,354 WARN [RS:0;jenkins-hbase4:40955] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-17 02:01:45,354 WARN [RS:1;jenkins-hbase4:38323] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-17 02:01:45,354 INFO [RS:0;jenkins-hbase4:40955] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 02:01:45,354 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,38323,1676599305080] 2023-02-17 02:01:45,354 DEBUG [RS:0;jenkins-hbase4:40955] regionserver.HRegionServer(1947): logDir=hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/WALs/jenkins-hbase4.apache.org,40955,1676599305055 2023-02-17 02:01:45,354 INFO [RS:1;jenkins-hbase4:38323] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 02:01:45,354 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40955,1676599305055] 2023-02-17 02:01:45,355 DEBUG [RS:1;jenkins-hbase4:38323] regionserver.HRegionServer(1947): logDir=hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/WALs/jenkins-hbase4.apache.org,38323,1676599305080 2023-02-17 02:01:45,357 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-17 02:01:45,362 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-17 02:01:45,363 DEBUG [RS:1;jenkins-hbase4:38323] zookeeper.ZKUtil(162): regionserver:38323-0x10060030ce80002, quorum=127.0.0.1:64305, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38323,1676599305080 2023-02-17 02:01:45,363 DEBUG [RS:0;jenkins-hbase4:40955] zookeeper.ZKUtil(162): regionserver:40955-0x10060030ce80001, quorum=127.0.0.1:64305, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38323,1676599305080 2023-02-17 02:01:45,364 DEBUG [RS:1;jenkins-hbase4:38323] zookeeper.ZKUtil(162): regionserver:38323-0x10060030ce80002, quorum=127.0.0.1:64305, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40955,1676599305055 2023-02-17 02:01:45,364 DEBUG [RS:0;jenkins-hbase4:40955] zookeeper.ZKUtil(162): regionserver:40955-0x10060030ce80001, quorum=127.0.0.1:64305, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40955,1676599305055 2023-02-17 02:01:45,364 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 02:01:45,365 DEBUG [RS:1;jenkins-hbase4:38323] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-17 02:01:45,365 DEBUG [RS:0;jenkins-hbase4:40955] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-17 02:01:45,365 INFO [RS:1;jenkins-hbase4:38323] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-17 02:01:45,365 INFO [RS:0;jenkins-hbase4:40955] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-17 02:01:45,365 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74663844, jitterRate=0.11257797479629517}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-17 02:01:45,365 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-17 02:01:45,365 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-17 02:01:45,365 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-17 02:01:45,365 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-17 02:01:45,365 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-17 02:01:45,365 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-17 02:01:45,365 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-17 02:01:45,365 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-17 02:01:45,366 INFO [RS:1;jenkins-hbase4:38323] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-17 02:01:45,366 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-17 02:01:45,366 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-17 02:01:45,366 INFO [RS:1;jenkins-hbase4:38323] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-17 02:01:45,366 INFO [RS:1;jenkins-hbase4:38323] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:45,366 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-17 02:01:45,367 INFO [RS:1;jenkins-hbase4:38323] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-17 02:01:45,367 INFO [RS:0;jenkins-hbase4:40955] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-17 02:01:45,368 INFO [RS:0;jenkins-hbase4:40955] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-17 02:01:45,368 INFO [RS:0;jenkins-hbase4:40955] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:45,368 INFO [RS:1;jenkins-hbase4:38323] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:45,372 INFO [RS:0;jenkins-hbase4:40955] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-17 02:01:45,372 DEBUG [RS:1;jenkins-hbase4:38323] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:45,373 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-17 02:01:45,373 DEBUG [RS:1;jenkins-hbase4:38323] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:45,373 DEBUG [RS:1;jenkins-hbase4:38323] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:45,374 DEBUG [RS:1;jenkins-hbase4:38323] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:45,374 DEBUG [RS:1;jenkins-hbase4:38323] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:45,374 DEBUG [RS:1;jenkins-hbase4:38323] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-17 02:01:45,374 DEBUG [RS:1;jenkins-hbase4:38323] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:45,374 DEBUG [RS:1;jenkins-hbase4:38323] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:45,374 INFO [RS:0;jenkins-hbase4:40955] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:45,374 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-17 02:01:45,374 DEBUG [RS:1;jenkins-hbase4:38323] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:45,375 DEBUG [RS:0;jenkins-hbase4:40955] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:45,375 DEBUG [RS:1;jenkins-hbase4:38323] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:45,375 DEBUG [RS:0;jenkins-hbase4:40955] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:45,375 DEBUG [RS:0;jenkins-hbase4:40955] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:45,375 DEBUG [RS:0;jenkins-hbase4:40955] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:45,375 DEBUG [RS:0;jenkins-hbase4:40955] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:45,375 DEBUG [RS:0;jenkins-hbase4:40955] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-17 02:01:45,375 DEBUG [RS:0;jenkins-hbase4:40955] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:45,376 DEBUG [RS:0;jenkins-hbase4:40955] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:45,376 DEBUG [RS:0;jenkins-hbase4:40955] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:45,376 DEBUG [RS:0;jenkins-hbase4:40955] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:45,376 INFO [RS:1;jenkins-hbase4:38323] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:45,376 INFO [RS:1;jenkins-hbase4:38323] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:45,376 INFO [RS:1;jenkins-hbase4:38323] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:45,377 INFO [RS:0;jenkins-hbase4:40955] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:45,377 INFO [RS:0;jenkins-hbase4:40955] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:45,377 INFO [RS:0;jenkins-hbase4:40955] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:45,389 INFO [RS:1;jenkins-hbase4:38323] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-17 02:01:45,389 INFO [RS:0;jenkins-hbase4:40955] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-17 02:01:45,389 INFO [RS:1;jenkins-hbase4:38323] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38323,1676599305080-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:45,389 INFO [RS:0;jenkins-hbase4:40955] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40955,1676599305055-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:45,400 INFO [RS:1;jenkins-hbase4:38323] regionserver.Replication(203): jenkins-hbase4.apache.org,38323,1676599305080 started 2023-02-17 02:01:45,400 INFO [RS:1;jenkins-hbase4:38323] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,38323,1676599305080, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:38323, sessionid=0x10060030ce80002 2023-02-17 02:01:45,400 DEBUG [RS:1;jenkins-hbase4:38323] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-17 02:01:45,400 DEBUG [RS:1;jenkins-hbase4:38323] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,38323,1676599305080 2023-02-17 02:01:45,400 DEBUG [RS:1;jenkins-hbase4:38323] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38323,1676599305080' 2023-02-17 02:01:45,400 DEBUG [RS:1;jenkins-hbase4:38323] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 02:01:45,400 DEBUG [RS:1;jenkins-hbase4:38323] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 02:01:45,401 DEBUG [RS:1;jenkins-hbase4:38323] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-17 02:01:45,401 DEBUG [RS:1;jenkins-hbase4:38323] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-17 02:01:45,401 DEBUG [RS:1;jenkins-hbase4:38323] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,38323,1676599305080 2023-02-17 02:01:45,401 DEBUG [RS:1;jenkins-hbase4:38323] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38323,1676599305080' 2023-02-17 02:01:45,401 DEBUG [RS:1;jenkins-hbase4:38323] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 02:01:45,401 DEBUG [RS:1;jenkins-hbase4:38323] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 02:01:45,401 DEBUG [RS:1;jenkins-hbase4:38323] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-17 02:01:45,401 INFO [RS:1;jenkins-hbase4:38323] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-17 02:01:45,401 INFO [RS:1;jenkins-hbase4:38323] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-17 02:01:45,402 INFO [RS:0;jenkins-hbase4:40955] regionserver.Replication(203): jenkins-hbase4.apache.org,40955,1676599305055 started 2023-02-17 02:01:45,402 INFO [RS:0;jenkins-hbase4:40955] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,40955,1676599305055, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40955, sessionid=0x10060030ce80001 2023-02-17 02:01:45,402 DEBUG [RS:0;jenkins-hbase4:40955] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-17 02:01:45,402 DEBUG [RS:0;jenkins-hbase4:40955] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40955,1676599305055 2023-02-17 02:01:45,402 DEBUG [RS:0;jenkins-hbase4:40955] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40955,1676599305055' 2023-02-17 02:01:45,402 DEBUG [RS:0;jenkins-hbase4:40955] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 02:01:45,402 DEBUG [RS:0;jenkins-hbase4:40955] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 02:01:45,403 DEBUG [RS:0;jenkins-hbase4:40955] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-17 02:01:45,403 DEBUG [RS:0;jenkins-hbase4:40955] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-17 02:01:45,403 DEBUG [RS:0;jenkins-hbase4:40955] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40955,1676599305055 2023-02-17 02:01:45,403 DEBUG [RS:0;jenkins-hbase4:40955] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40955,1676599305055' 2023-02-17 02:01:45,403 DEBUG [RS:0;jenkins-hbase4:40955] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 02:01:45,403 DEBUG [RS:0;jenkins-hbase4:40955] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 02:01:45,403 DEBUG [RS:0;jenkins-hbase4:40955] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-17 02:01:45,403 INFO [RS:0;jenkins-hbase4:40955] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-17 02:01:45,403 INFO [RS:0;jenkins-hbase4:40955] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-17 02:01:45,525 DEBUG [jenkins-hbase4:39221] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-17 02:01:45,525 DEBUG [jenkins-hbase4:39221] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-17 02:01:45,527 DEBUG [jenkins-hbase4:39221] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-17 02:01:45,527 DEBUG [jenkins-hbase4:39221] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-17 02:01:45,527 DEBUG [jenkins-hbase4:39221] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-17 02:01:45,527 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40955,1676599305055, state=OPENING 2023-02-17 02:01:45,529 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-17 02:01:45,530 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): master:39221-0x10060030ce80000, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 02:01:45,530 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-17 02:01:45,533 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40955,1676599305055}] 2023-02-17 02:01:45,540 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-17 02:01:45,687 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,40955,1676599305055 2023-02-17 02:01:45,687 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-17 02:01:45,689 INFO [RS-EventLoopGroup-16-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55790, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-17 02:01:45,692 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-17 02:01:45,692 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 02:01:45,693 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40955%2C1676599305055.meta, suffix=.meta, logDir=hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/WALs/jenkins-hbase4.apache.org,40955,1676599305055, archiveDir=hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/oldWALs, maxLogs=32 2023-02-17 02:01:45,707 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34289,DS-0ec111ad-c221-43a0-beb6-5686d6e6cb24,DISK] 2023-02-17 02:01:45,707 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45015,DS-00edc618-dc7f-44f2-ab41-34fc6decc957,DISK] 2023-02-17 02:01:45,709 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/WALs/jenkins-hbase4.apache.org,40955,1676599305055/jenkins-hbase4.apache.org%2C40955%2C1676599305055.meta.1676599305694.meta 2023-02-17 02:01:45,709 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34289,DS-0ec111ad-c221-43a0-beb6-5686d6e6cb24,DISK], DatanodeInfoWithStorage[127.0.0.1:45015,DS-00edc618-dc7f-44f2-ab41-34fc6decc957,DISK]] 2023-02-17 02:01:45,709 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-17 02:01:45,709 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-17 02:01:45,710 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-17 02:01:45,710 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-17 02:01:45,710 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-17 02:01:45,710 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:45,710 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-17 02:01:45,710 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-17 02:01:45,711 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-17 02:01:45,712 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/data/hbase/meta/1588230740/info 2023-02-17 02:01:45,712 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/data/hbase/meta/1588230740/info 2023-02-17 02:01:45,712 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-17 02:01:45,712 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:45,712 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-17 02:01:45,713 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/data/hbase/meta/1588230740/rep_barrier 2023-02-17 02:01:45,713 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/data/hbase/meta/1588230740/rep_barrier 2023-02-17 02:01:45,713 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-17 02:01:45,714 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:45,714 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-17 02:01:45,714 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/data/hbase/meta/1588230740/table 2023-02-17 02:01:45,714 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/data/hbase/meta/1588230740/table 2023-02-17 02:01:45,714 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-17 02:01:45,715 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:45,715 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/data/hbase/meta/1588230740 2023-02-17 02:01:45,716 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/data/hbase/meta/1588230740 2023-02-17 02:01:45,717 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-17 02:01:45,718 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-17 02:01:45,719 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68672772, jitterRate=0.0233040452003479}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-17 02:01:45,719 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-17 02:01:45,720 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676599305687 2023-02-17 02:01:45,723 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-17 02:01:45,724 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-17 02:01:45,724 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40955,1676599305055, state=OPEN 2023-02-17 02:01:45,726 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): master:39221-0x10060030ce80000, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-17 02:01:45,726 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-17 02:01:45,729 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-17 02:01:45,730 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40955,1676599305055 in 196 msec 2023-02-17 02:01:45,731 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-17 02:01:45,731 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 364 msec 2023-02-17 02:01:45,732 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 439 msec 2023-02-17 02:01:45,732 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676599305732, completionTime=-1 2023-02-17 02:01:45,733 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-17 02:01:45,733 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-17 02:01:45,736 DEBUG [hconnection-0x3fcd438a-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 02:01:45,742 INFO [RS-EventLoopGroup-16-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55796, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 02:01:45,744 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-17 02:01:45,744 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676599365744 2023-02-17 02:01:45,744 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676599425744 2023-02-17 02:01:45,744 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 11 msec 2023-02-17 02:01:45,759 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39221,1676599305013-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:45,759 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39221,1676599305013-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:45,759 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39221,1676599305013-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:45,759 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:39221, period=300000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:45,759 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:45,759 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-17 02:01:45,759 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-17 02:01:45,760 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-17 02:01:45,766 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-17 02:01:45,766 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-17 02:01:45,766 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-17 02:01:45,768 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/.tmp/data/hbase/namespace/ce4bfa955b3b11d2855328f7d8e4131a 2023-02-17 02:01:45,768 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/.tmp/data/hbase/namespace/ce4bfa955b3b11d2855328f7d8e4131a empty. 2023-02-17 02:01:45,769 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/.tmp/data/hbase/namespace/ce4bfa955b3b11d2855328f7d8e4131a 2023-02-17 02:01:45,769 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-17 02:01:45,780 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-17 02:01:45,781 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => ce4bfa955b3b11d2855328f7d8e4131a, NAME => 'hbase:namespace,,1676599305759.ce4bfa955b3b11d2855328f7d8e4131a.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/.tmp 2023-02-17 02:01:45,790 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676599305759.ce4bfa955b3b11d2855328f7d8e4131a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:45,790 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing ce4bfa955b3b11d2855328f7d8e4131a, disabling compactions & flushes 2023-02-17 02:01:45,790 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676599305759.ce4bfa955b3b11d2855328f7d8e4131a. 2023-02-17 02:01:45,790 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676599305759.ce4bfa955b3b11d2855328f7d8e4131a. 2023-02-17 02:01:45,790 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676599305759.ce4bfa955b3b11d2855328f7d8e4131a. after waiting 0 ms 2023-02-17 02:01:45,790 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676599305759.ce4bfa955b3b11d2855328f7d8e4131a. 2023-02-17 02:01:45,790 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676599305759.ce4bfa955b3b11d2855328f7d8e4131a. 2023-02-17 02:01:45,790 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for ce4bfa955b3b11d2855328f7d8e4131a: 2023-02-17 02:01:45,792 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-17 02:01:45,793 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676599305759.ce4bfa955b3b11d2855328f7d8e4131a.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676599305793"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676599305793"}]},"ts":"1676599305793"} 2023-02-17 02:01:45,796 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-17 02:01:45,796 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-17 02:01:45,796 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676599305796"}]},"ts":"1676599305796"} 2023-02-17 02:01:45,797 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-17 02:01:45,802 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-17 02:01:45,803 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-17 02:01:45,803 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-17 02:01:45,803 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-17 02:01:45,803 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=ce4bfa955b3b11d2855328f7d8e4131a, ASSIGN}] 2023-02-17 02:01:45,806 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=ce4bfa955b3b11d2855328f7d8e4131a, ASSIGN 2023-02-17 02:01:45,806 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=ce4bfa955b3b11d2855328f7d8e4131a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40955,1676599305055; forceNewPlan=false, retain=false 2023-02-17 02:01:45,956 INFO [jenkins-hbase4:39221] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-17 02:01:45,957 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=ce4bfa955b3b11d2855328f7d8e4131a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40955,1676599305055 2023-02-17 02:01:45,957 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676599305759.ce4bfa955b3b11d2855328f7d8e4131a.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676599305957"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676599305957"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676599305957"}]},"ts":"1676599305957"} 2023-02-17 02:01:45,958 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure ce4bfa955b3b11d2855328f7d8e4131a, server=jenkins-hbase4.apache.org,40955,1676599305055}] 2023-02-17 02:01:46,115 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676599305759.ce4bfa955b3b11d2855328f7d8e4131a. 2023-02-17 02:01:46,116 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40955%2C1676599305055, suffix=, logDir=hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/WALs/jenkins-hbase4.apache.org,40955,1676599305055, archiveDir=hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/oldWALs, maxLogs=32 2023-02-17 02:01:46,131 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34289,DS-0ec111ad-c221-43a0-beb6-5686d6e6cb24,DISK] 2023-02-17 02:01:46,131 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45015,DS-00edc618-dc7f-44f2-ab41-34fc6decc957,DISK] 2023-02-17 02:01:46,133 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/WALs/jenkins-hbase4.apache.org,40955,1676599305055/jenkins-hbase4.apache.org%2C40955%2C1676599305055.1676599306117 2023-02-17 02:01:46,133 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45015,DS-00edc618-dc7f-44f2-ab41-34fc6decc957,DISK], DatanodeInfoWithStorage[127.0.0.1:34289,DS-0ec111ad-c221-43a0-beb6-5686d6e6cb24,DISK]] 2023-02-17 02:01:46,133 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ce4bfa955b3b11d2855328f7d8e4131a, NAME => 'hbase:namespace,,1676599305759.ce4bfa955b3b11d2855328f7d8e4131a.', STARTKEY => '', ENDKEY => ''} 2023-02-17 02:01:46,133 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace ce4bfa955b3b11d2855328f7d8e4131a 2023-02-17 02:01:46,133 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676599305759.ce4bfa955b3b11d2855328f7d8e4131a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:46,133 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for ce4bfa955b3b11d2855328f7d8e4131a 2023-02-17 02:01:46,133 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for ce4bfa955b3b11d2855328f7d8e4131a 2023-02-17 02:01:46,135 INFO [StoreOpener-ce4bfa955b3b11d2855328f7d8e4131a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region ce4bfa955b3b11d2855328f7d8e4131a 2023-02-17 02:01:46,136 DEBUG [StoreOpener-ce4bfa955b3b11d2855328f7d8e4131a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/data/hbase/namespace/ce4bfa955b3b11d2855328f7d8e4131a/info 2023-02-17 02:01:46,136 DEBUG [StoreOpener-ce4bfa955b3b11d2855328f7d8e4131a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/data/hbase/namespace/ce4bfa955b3b11d2855328f7d8e4131a/info 2023-02-17 02:01:46,136 INFO [StoreOpener-ce4bfa955b3b11d2855328f7d8e4131a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ce4bfa955b3b11d2855328f7d8e4131a columnFamilyName info 2023-02-17 02:01:46,137 INFO [StoreOpener-ce4bfa955b3b11d2855328f7d8e4131a-1] regionserver.HStore(310): Store=ce4bfa955b3b11d2855328f7d8e4131a/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:46,137 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/data/hbase/namespace/ce4bfa955b3b11d2855328f7d8e4131a 2023-02-17 02:01:46,138 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/data/hbase/namespace/ce4bfa955b3b11d2855328f7d8e4131a 2023-02-17 02:01:46,140 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for ce4bfa955b3b11d2855328f7d8e4131a 2023-02-17 02:01:46,142 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/data/hbase/namespace/ce4bfa955b3b11d2855328f7d8e4131a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 02:01:46,143 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened ce4bfa955b3b11d2855328f7d8e4131a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74941349, jitterRate=0.11671312153339386}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-17 02:01:46,143 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for ce4bfa955b3b11d2855328f7d8e4131a: 2023-02-17 02:01:46,144 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676599305759.ce4bfa955b3b11d2855328f7d8e4131a., pid=6, masterSystemTime=1676599306111 2023-02-17 02:01:46,146 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676599305759.ce4bfa955b3b11d2855328f7d8e4131a. 2023-02-17 02:01:46,146 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676599305759.ce4bfa955b3b11d2855328f7d8e4131a. 2023-02-17 02:01:46,147 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=ce4bfa955b3b11d2855328f7d8e4131a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40955,1676599305055 2023-02-17 02:01:46,147 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676599305759.ce4bfa955b3b11d2855328f7d8e4131a.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676599306147"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676599306147"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676599306147"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676599306147"}]},"ts":"1676599306147"} 2023-02-17 02:01:46,150 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-17 02:01:46,150 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure ce4bfa955b3b11d2855328f7d8e4131a, server=jenkins-hbase4.apache.org,40955,1676599305055 in 191 msec 2023-02-17 02:01:46,152 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-17 02:01:46,152 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=ce4bfa955b3b11d2855328f7d8e4131a, ASSIGN in 347 msec 2023-02-17 02:01:46,152 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-17 02:01:46,152 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676599306152"}]},"ts":"1676599306152"} 2023-02-17 02:01:46,153 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-17 02:01:46,156 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-17 02:01:46,157 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 396 msec 2023-02-17 02:01:46,161 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39221-0x10060030ce80000, quorum=127.0.0.1:64305, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-17 02:01:46,163 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): master:39221-0x10060030ce80000, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-17 02:01:46,163 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): master:39221-0x10060030ce80000, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 02:01:46,167 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-17 02:01:46,174 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): master:39221-0x10060030ce80000, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-17 02:01:46,176 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 9 msec 2023-02-17 02:01:46,178 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-17 02:01:46,184 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): master:39221-0x10060030ce80000, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-17 02:01:46,190 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 12 msec 2023-02-17 02:01:46,202 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): master:39221-0x10060030ce80000, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-17 02:01:46,205 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): master:39221-0x10060030ce80000, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-17 02:01:46,205 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.103sec 2023-02-17 02:01:46,205 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-17 02:01:46,205 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-17 02:01:46,205 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-17 02:01:46,205 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39221,1676599305013-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-17 02:01:46,205 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39221,1676599305013-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-17 02:01:46,207 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-17 02:01:46,296 DEBUG [Listener at localhost/41671] zookeeper.ReadOnlyZKClient(139): Connect 0x31de32bb to 127.0.0.1:64305 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 02:01:46,304 DEBUG [Listener at localhost/41671] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@29d0a8db, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 02:01:46,305 DEBUG [hconnection-0x5a009734-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 02:01:46,307 INFO [RS-EventLoopGroup-16-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55806, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 02:01:46,308 INFO [Listener at localhost/41671] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,39221,1676599305013 2023-02-17 02:01:46,308 DEBUG [Listener at localhost/41671] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-17 02:01:46,310 DEBUG [Listener at localhost/41671] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-17 02:01:46,312 INFO [RS-EventLoopGroup-15-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44724, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-17 02:01:46,312 INFO [Listener at localhost/41671] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-17 02:01:46,312 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39221] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceSingleRegion 2023-02-17 02:01:46,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39221] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-17 02:01:46,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39221] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 95 connection: 172.31.14.131:44724 deadline: 1676599366312, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion 2023-02-17 02:01:46,313 INFO [Listener at localhost/41671] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceSingleRegion' 2023-02-17 02:01:46,315 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39221] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-17 02:01:46,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39221] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-17 02:01:46,317 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-17 02:01:46,317 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39221] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceSingleRegion" procId is: 10 2023-02-17 02:01:46,318 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-17 02:01:46,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39221] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 02:01:46,319 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/.tmp/data/default/testWithMockedMapReduceSingleRegion/00759a7c78131ff855da2987e16385af 2023-02-17 02:01:46,320 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/.tmp/data/default/testWithMockedMapReduceSingleRegion/00759a7c78131ff855da2987e16385af empty. 2023-02-17 02:01:46,320 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/.tmp/data/default/testWithMockedMapReduceSingleRegion/00759a7c78131ff855da2987e16385af 2023-02-17 02:01:46,320 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-17 02:01:46,328 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/.tmp/data/default/testWithMockedMapReduceSingleRegion/.tabledesc/.tableinfo.0000000001 2023-02-17 02:01:46,329 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 00759a7c78131ff855da2987e16385af, NAME => 'testWithMockedMapReduceSingleRegion,,1676599306315.00759a7c78131ff855da2987e16385af.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/.tmp 2023-02-17 02:01:46,338 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676599306315.00759a7c78131ff855da2987e16385af.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:46,338 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1603): Closing 00759a7c78131ff855da2987e16385af, disabling compactions & flushes 2023-02-17 02:01:46,338 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676599306315.00759a7c78131ff855da2987e16385af. 2023-02-17 02:01:46,338 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676599306315.00759a7c78131ff855da2987e16385af. 2023-02-17 02:01:46,338 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676599306315.00759a7c78131ff855da2987e16385af. after waiting 0 ms 2023-02-17 02:01:46,339 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676599306315.00759a7c78131ff855da2987e16385af. 2023-02-17 02:01:46,339 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676599306315.00759a7c78131ff855da2987e16385af. 2023-02-17 02:01:46,339 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1557): Region close journal for 00759a7c78131ff855da2987e16385af: 2023-02-17 02:01:46,341 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-17 02:01:46,342 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1676599306315.00759a7c78131ff855da2987e16385af.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676599306342"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676599306342"}]},"ts":"1676599306342"} 2023-02-17 02:01:46,343 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-17 02:01:46,344 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-17 02:01:46,344 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676599306344"}]},"ts":"1676599306344"} 2023-02-17 02:01:46,346 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLING in hbase:meta 2023-02-17 02:01:46,350 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-17 02:01:46,351 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-17 02:01:46,351 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-17 02:01:46,351 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-17 02:01:46,352 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=00759a7c78131ff855da2987e16385af, ASSIGN}] 2023-02-17 02:01:46,354 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=00759a7c78131ff855da2987e16385af, ASSIGN 2023-02-17 02:01:46,354 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=00759a7c78131ff855da2987e16385af, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40955,1676599305055; forceNewPlan=false, retain=false 2023-02-17 02:01:46,403 INFO [RS:1;jenkins-hbase4:38323] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38323%2C1676599305080, suffix=, logDir=hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/WALs/jenkins-hbase4.apache.org,38323,1676599305080, archiveDir=hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/oldWALs, maxLogs=32 2023-02-17 02:01:46,418 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45015,DS-00edc618-dc7f-44f2-ab41-34fc6decc957,DISK] 2023-02-17 02:01:46,418 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34289,DS-0ec111ad-c221-43a0-beb6-5686d6e6cb24,DISK] 2023-02-17 02:01:46,420 INFO [RS:1;jenkins-hbase4:38323] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/WALs/jenkins-hbase4.apache.org,38323,1676599305080/jenkins-hbase4.apache.org%2C38323%2C1676599305080.1676599306403 2023-02-17 02:01:46,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39221] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 02:01:46,420 DEBUG [RS:1;jenkins-hbase4:38323] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34289,DS-0ec111ad-c221-43a0-beb6-5686d6e6cb24,DISK], DatanodeInfoWithStorage[127.0.0.1:45015,DS-00edc618-dc7f-44f2-ab41-34fc6decc957,DISK]] 2023-02-17 02:01:46,504 INFO [jenkins-hbase4:39221] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-17 02:01:46,505 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=00759a7c78131ff855da2987e16385af, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40955,1676599305055 2023-02-17 02:01:46,505 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1676599306315.00759a7c78131ff855da2987e16385af.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676599306505"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676599306505"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676599306505"}]},"ts":"1676599306505"} 2023-02-17 02:01:46,507 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 00759a7c78131ff855da2987e16385af, server=jenkins-hbase4.apache.org,40955,1676599305055}] 2023-02-17 02:01:46,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39221] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 02:01:46,661 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceSingleRegion,,1676599306315.00759a7c78131ff855da2987e16385af. 2023-02-17 02:01:46,662 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 00759a7c78131ff855da2987e16385af, NAME => 'testWithMockedMapReduceSingleRegion,,1676599306315.00759a7c78131ff855da2987e16385af.', STARTKEY => '', ENDKEY => ''} 2023-02-17 02:01:46,662 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceSingleRegion 00759a7c78131ff855da2987e16385af 2023-02-17 02:01:46,662 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676599306315.00759a7c78131ff855da2987e16385af.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:46,662 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 00759a7c78131ff855da2987e16385af 2023-02-17 02:01:46,662 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 00759a7c78131ff855da2987e16385af 2023-02-17 02:01:46,663 INFO [StoreOpener-00759a7c78131ff855da2987e16385af-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 00759a7c78131ff855da2987e16385af 2023-02-17 02:01:46,664 DEBUG [StoreOpener-00759a7c78131ff855da2987e16385af-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/data/default/testWithMockedMapReduceSingleRegion/00759a7c78131ff855da2987e16385af/f1 2023-02-17 02:01:46,664 DEBUG [StoreOpener-00759a7c78131ff855da2987e16385af-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/data/default/testWithMockedMapReduceSingleRegion/00759a7c78131ff855da2987e16385af/f1 2023-02-17 02:01:46,664 INFO [StoreOpener-00759a7c78131ff855da2987e16385af-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 00759a7c78131ff855da2987e16385af columnFamilyName f1 2023-02-17 02:01:46,665 INFO [StoreOpener-00759a7c78131ff855da2987e16385af-1] regionserver.HStore(310): Store=00759a7c78131ff855da2987e16385af/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:46,665 INFO [StoreOpener-00759a7c78131ff855da2987e16385af-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 00759a7c78131ff855da2987e16385af 2023-02-17 02:01:46,666 DEBUG [StoreOpener-00759a7c78131ff855da2987e16385af-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/data/default/testWithMockedMapReduceSingleRegion/00759a7c78131ff855da2987e16385af/f2 2023-02-17 02:01:46,666 DEBUG [StoreOpener-00759a7c78131ff855da2987e16385af-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/data/default/testWithMockedMapReduceSingleRegion/00759a7c78131ff855da2987e16385af/f2 2023-02-17 02:01:46,666 INFO [StoreOpener-00759a7c78131ff855da2987e16385af-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 00759a7c78131ff855da2987e16385af columnFamilyName f2 2023-02-17 02:01:46,666 INFO [StoreOpener-00759a7c78131ff855da2987e16385af-1] regionserver.HStore(310): Store=00759a7c78131ff855da2987e16385af/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:46,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/data/default/testWithMockedMapReduceSingleRegion/00759a7c78131ff855da2987e16385af 2023-02-17 02:01:46,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/data/default/testWithMockedMapReduceSingleRegion/00759a7c78131ff855da2987e16385af 2023-02-17 02:01:46,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 02:01:46,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 00759a7c78131ff855da2987e16385af 2023-02-17 02:01:46,671 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/data/default/testWithMockedMapReduceSingleRegion/00759a7c78131ff855da2987e16385af/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 02:01:46,671 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 00759a7c78131ff855da2987e16385af; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72067578, jitterRate=0.07389059662818909}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 02:01:46,671 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 00759a7c78131ff855da2987e16385af: 2023-02-17 02:01:46,672 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceSingleRegion,,1676599306315.00759a7c78131ff855da2987e16385af., pid=12, masterSystemTime=1676599306658 2023-02-17 02:01:46,673 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceSingleRegion,,1676599306315.00759a7c78131ff855da2987e16385af. 2023-02-17 02:01:46,673 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceSingleRegion,,1676599306315.00759a7c78131ff855da2987e16385af. 2023-02-17 02:01:46,673 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=00759a7c78131ff855da2987e16385af, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40955,1676599305055 2023-02-17 02:01:46,674 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceSingleRegion,,1676599306315.00759a7c78131ff855da2987e16385af.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676599306673"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676599306673"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676599306673"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676599306673"}]},"ts":"1676599306673"} 2023-02-17 02:01:46,676 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-17 02:01:46,676 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 00759a7c78131ff855da2987e16385af, server=jenkins-hbase4.apache.org,40955,1676599305055 in 168 msec 2023-02-17 02:01:46,677 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-17 02:01:46,677 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=00759a7c78131ff855da2987e16385af, ASSIGN in 325 msec 2023-02-17 02:01:46,678 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-17 02:01:46,678 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676599306678"}]},"ts":"1676599306678"} 2023-02-17 02:01:46,679 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLED in hbase:meta 2023-02-17 02:01:46,681 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-17 02:01:46,682 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceSingleRegion in 366 msec 2023-02-17 02:01:46,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39221] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 02:01:46,923 INFO [Listener at localhost/41671] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 10 completed 2023-02-17 02:01:46,923 DEBUG [Listener at localhost/41671] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceSingleRegion get assigned. Timeout = 60000ms 2023-02-17 02:01:46,923 INFO [Listener at localhost/41671] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-17 02:01:46,925 INFO [Listener at localhost/41671] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceSingleRegion assigned to meta. Checking AM states. 2023-02-17 02:01:46,926 INFO [Listener at localhost/41671] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-17 02:01:46,926 INFO [Listener at localhost/41671] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceSingleRegion assigned. 2023-02-17 02:01:46,926 INFO [Listener at localhost/41671] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-17 02:01:46,965 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40955] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceSingleRegion,,1676599306315.00759a7c78131ff855da2987e16385af. 2023-02-17 02:01:47,055 INFO [Listener at localhost/41671] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-17 02:01:47,055 INFO [Listener at localhost/41671] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-17 02:01:47,056 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39221] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-17 02:01:47,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39221] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676599307056 (current time:1676599307056). 2023-02-17 02:01:47,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39221] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-17 02:01:47,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39221] zookeeper.ReadOnlyZKClient(139): Connect 0x3fb1281c to 127.0.0.1:64305 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 02:01:47,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39221] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4d2acd26, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 02:01:47,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39221] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 02:01:47,063 INFO [RS-EventLoopGroup-16-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55822, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 02:01:47,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39221] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3fb1281c to 127.0.0.1:64305 2023-02-17 02:01:47,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39221] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 02:01:47,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39221] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-17 02:01:47,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39221] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-17 02:01:47,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39221] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-17 02:01:47,068 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-17 02:01:47,068 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE; timeout=600000, timestamp=1676599907068 2023-02-17 02:01:47,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39221] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-17 02:01:47,069 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,070 DEBUG [Listener at localhost/41671] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-17 02:01:47,070 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-17 02:01:47,071 DEBUG [Listener at localhost/41671] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-17 02:01:47,071 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-17 02:01:47,072 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE in 5 msec 2023-02-17 02:01:47,072 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-17 02:01:47,073 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED; timeout=600000, timestamp=1676599907073 2023-02-17 02:01:47,083 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,084 INFO [(jenkins-hbase4.apache.org,39221,1676599305013)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-17 02:01:47,084 DEBUG [(jenkins-hbase4.apache.org,39221,1676599305013)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-17 02:01:47,085 DEBUG [(jenkins-hbase4.apache.org,39221,1676599305013)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-17 02:01:47,085 DEBUG [(jenkins-hbase4.apache.org,39221,1676599305013)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-17 02:01:47,085 DEBUG [(jenkins-hbase4.apache.org,39221,1676599305013)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39221-0x10060030ce80000, quorum=127.0.0.1:64305, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,085 DEBUG [(jenkins-hbase4.apache.org,39221,1676599305013)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,086 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): regionserver:38323-0x10060030ce80002, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 02:01:47,087 DEBUG [(jenkins-hbase4.apache.org,39221,1676599305013)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40955,1676599305055 2023-02-17 02:01:47,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 02:01:47,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 02:01:47,087 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): regionserver:40955-0x10060030ce80001, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 02:01:47,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 02:01:47,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 02:01:47,087 DEBUG [(jenkins-hbase4.apache.org,39221,1676599305013)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39221-0x10060030ce80000, quorum=127.0.0.1:64305, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40955,1676599305055 2023-02-17 02:01:47,087 DEBUG [(jenkins-hbase4.apache.org,39221,1676599305013)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-17 02:01:47,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,087 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38323-0x10060030ce80002, quorum=127.0.0.1:64305, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,087 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40955-0x10060030ce80001, quorum=127.0.0.1:64305, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-17 02:01:47,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,088 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-17 02:01:47,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-17 02:01:47,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,088 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-17 02:01:47,088 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,092 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,092 DEBUG [member: 'jenkins-hbase4.apache.org,38323,1676599305080' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-17 02:01:47,092 DEBUG [member: 'jenkins-hbase4.apache.org,40955,1676599305055' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-17 02:01:47,092 DEBUG [member: 'jenkins-hbase4.apache.org,40955,1676599305055' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-17 02:01:47,092 DEBUG [member: 'jenkins-hbase4.apache.org,38323,1676599305080' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-17 02:01:47,093 DEBUG [member: 'jenkins-hbase4.apache.org,40955,1676599305055' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-17 02:01:47,094 DEBUG [member: 'jenkins-hbase4.apache.org,38323,1676599305080' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-17 02:01:47,094 DEBUG [member: 'jenkins-hbase4.apache.org,38323,1676599305080' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-17 02:01:47,094 DEBUG [member: 'jenkins-hbase4.apache.org,40955,1676599305055' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-17 02:01:47,094 DEBUG [member: 'jenkins-hbase4.apache.org,40955,1676599305055' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40955,1676599305055' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-17 02:01:47,094 DEBUG [member: 'jenkins-hbase4.apache.org,38323,1676599305080' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38323,1676599305080' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-17 02:01:47,095 DEBUG [member: 'jenkins-hbase4.apache.org,38323,1676599305080' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,097 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): master:39221-0x10060030ce80000, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40955,1676599305055 2023-02-17 02:01:47,097 DEBUG [member: 'jenkins-hbase4.apache.org,38323,1676599305080' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38323-0x10060030ce80002, quorum=127.0.0.1:64305, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,098 DEBUG [member: 'jenkins-hbase4.apache.org,38323,1676599305080' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 02:01:47,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40955,1676599305055 2023-02-17 02:01:47,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 02:01:47,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-17 02:01:47,097 DEBUG [member: 'jenkins-hbase4.apache.org,40955,1676599305055' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,098 DEBUG [member: 'jenkins-hbase4.apache.org,40955,1676599305055' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40955-0x10060030ce80001, quorum=127.0.0.1:64305, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,098 DEBUG [member: 'jenkins-hbase4.apache.org,40955,1676599305055' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 02:01:47,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 02:01:47,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 02:01:47,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38323,1676599305080 2023-02-17 02:01:47,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40955,1676599305055 2023-02-17 02:01:47,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 02:01:47,099 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40955,1676599305055' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-17 02:01:47,100 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3f8855c3[Count = 0] remaining members to acquire global barrier 2023-02-17 02:01:47,100 DEBUG [(jenkins-hbase4.apache.org,39221,1676599305013)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-17 02:01:47,100 DEBUG [(jenkins-hbase4.apache.org,39221,1676599305013)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,101 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): regionserver:38323-0x10060030ce80002, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,101 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): regionserver:40955-0x10060030ce80001, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,101 DEBUG [member: 'jenkins-hbase4.apache.org,40955,1676599305055' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-17 02:01:47,101 DEBUG [member: 'jenkins-hbase4.apache.org,38323,1676599305080' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-17 02:01:47,101 DEBUG [member: 'jenkins-hbase4.apache.org,38323,1676599305080' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-17 02:01:47,101 DEBUG [(jenkins-hbase4.apache.org,39221,1676599305013)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39221-0x10060030ce80000, quorum=127.0.0.1:64305, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40955,1676599305055 2023-02-17 02:01:47,101 DEBUG [member: 'jenkins-hbase4.apache.org,40955,1676599305055' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-17 02:01:47,101 DEBUG [member: 'jenkins-hbase4.apache.org,40955,1676599305055' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-17 02:01:47,101 DEBUG [member: 'jenkins-hbase4.apache.org,38323,1676599305080' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,38323,1676599305080' in zk 2023-02-17 02:01:47,101 DEBUG [rs(jenkins-hbase4.apache.org,40955,1676599305055)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceSingleRegion,,1676599306315.00759a7c78131ff855da2987e16385af. 2023-02-17 02:01:47,101 DEBUG [(jenkins-hbase4.apache.org,39221,1676599305013)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-17 02:01:47,101 DEBUG [rs(jenkins-hbase4.apache.org,40955,1676599305055)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1676599306315.00759a7c78131ff855da2987e16385af. started... 2023-02-17 02:01:47,101 INFO [rs(jenkins-hbase4.apache.org,40955,1676599305055)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 00759a7c78131ff855da2987e16385af 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-17 02:01:47,103 DEBUG [member: 'jenkins-hbase4.apache.org,38323,1676599305080' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-17 02:01:47,103 DEBUG [member: 'jenkins-hbase4.apache.org,38323,1676599305080' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 02:01:47,103 DEBUG [member: 'jenkins-hbase4.apache.org,38323,1676599305080' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-17 02:01:47,116 INFO [rs(jenkins-hbase4.apache.org,40955,1676599305055)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/data/default/testWithMockedMapReduceSingleRegion/00759a7c78131ff855da2987e16385af/.tmp/f1/a11a2cd73027448f9aca91b031075431 2023-02-17 02:01:47,144 INFO [rs(jenkins-hbase4.apache.org,40955,1676599305055)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/data/default/testWithMockedMapReduceSingleRegion/00759a7c78131ff855da2987e16385af/.tmp/f2/20115870b98a4a00a7f6e3d7bb934150 2023-02-17 02:01:47,149 DEBUG [rs(jenkins-hbase4.apache.org,40955,1676599305055)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/data/default/testWithMockedMapReduceSingleRegion/00759a7c78131ff855da2987e16385af/.tmp/f1/a11a2cd73027448f9aca91b031075431 as hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/data/default/testWithMockedMapReduceSingleRegion/00759a7c78131ff855da2987e16385af/f1/a11a2cd73027448f9aca91b031075431 2023-02-17 02:01:47,153 INFO [rs(jenkins-hbase4.apache.org,40955,1676599305055)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/data/default/testWithMockedMapReduceSingleRegion/00759a7c78131ff855da2987e16385af/f1/a11a2cd73027448f9aca91b031075431, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-17 02:01:47,154 DEBUG [rs(jenkins-hbase4.apache.org,40955,1676599305055)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/data/default/testWithMockedMapReduceSingleRegion/00759a7c78131ff855da2987e16385af/.tmp/f2/20115870b98a4a00a7f6e3d7bb934150 as hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/data/default/testWithMockedMapReduceSingleRegion/00759a7c78131ff855da2987e16385af/f2/20115870b98a4a00a7f6e3d7bb934150 2023-02-17 02:01:47,158 INFO [rs(jenkins-hbase4.apache.org,40955,1676599305055)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/data/default/testWithMockedMapReduceSingleRegion/00759a7c78131ff855da2987e16385af/f2/20115870b98a4a00a7f6e3d7bb934150, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-17 02:01:47,159 INFO [rs(jenkins-hbase4.apache.org,40955,1676599305055)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 00759a7c78131ff855da2987e16385af in 58ms, sequenceid=5, compaction requested=false 2023-02-17 02:01:47,159 DEBUG [rs(jenkins-hbase4.apache.org,40955,1676599305055)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceSingleRegion' 2023-02-17 02:01:47,159 DEBUG [rs(jenkins-hbase4.apache.org,40955,1676599305055)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 00759a7c78131ff855da2987e16385af: 2023-02-17 02:01:47,159 DEBUG [rs(jenkins-hbase4.apache.org,40955,1676599305055)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceSingleRegion,,1676599306315.00759a7c78131ff855da2987e16385af.' region-info for snapshot=testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,159 DEBUG [rs(jenkins-hbase4.apache.org,40955,1676599305055)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 02:01:47,159 DEBUG [rs(jenkins-hbase4.apache.org,40955,1676599305055)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/data/default/testWithMockedMapReduceSingleRegion/00759a7c78131ff855da2987e16385af/f1/a11a2cd73027448f9aca91b031075431] hfiles 2023-02-17 02:01:47,159 DEBUG [rs(jenkins-hbase4.apache.org,40955,1676599305055)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/data/default/testWithMockedMapReduceSingleRegion/00759a7c78131ff855da2987e16385af/f1/a11a2cd73027448f9aca91b031075431 for snapshot=testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,159 DEBUG [rs(jenkins-hbase4.apache.org,40955,1676599305055)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/data/default/testWithMockedMapReduceSingleRegion/00759a7c78131ff855da2987e16385af/f2/20115870b98a4a00a7f6e3d7bb934150] hfiles 2023-02-17 02:01:47,159 DEBUG [rs(jenkins-hbase4.apache.org,40955,1676599305055)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/data/default/testWithMockedMapReduceSingleRegion/00759a7c78131ff855da2987e16385af/f2/20115870b98a4a00a7f6e3d7bb934150 for snapshot=testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,165 DEBUG [rs(jenkins-hbase4.apache.org,40955,1676599305055)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1676599306315.00759a7c78131ff855da2987e16385af. completed. 2023-02-17 02:01:47,165 DEBUG [rs(jenkins-hbase4.apache.org,40955,1676599305055)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceSingleRegion,,1676599306315.00759a7c78131ff855da2987e16385af. 2023-02-17 02:01:47,165 DEBUG [member: 'jenkins-hbase4.apache.org,40955,1676599305055' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-17 02:01:47,165 DEBUG [member: 'jenkins-hbase4.apache.org,40955,1676599305055' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-17 02:01:47,165 DEBUG [member: 'jenkins-hbase4.apache.org,40955,1676599305055' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40955,1676599305055 2023-02-17 02:01:47,166 DEBUG [member: 'jenkins-hbase4.apache.org,40955,1676599305055' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-17 02:01:47,166 DEBUG [member: 'jenkins-hbase4.apache.org,40955,1676599305055' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,40955,1676599305055' in zk 2023-02-17 02:01:47,169 DEBUG [member: 'jenkins-hbase4.apache.org,40955,1676599305055' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-17 02:01:47,169 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): master:39221-0x10060030ce80000, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40955,1676599305055 2023-02-17 02:01:47,169 DEBUG [member: 'jenkins-hbase4.apache.org,40955,1676599305055' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 02:01:47,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40955,1676599305055 2023-02-17 02:01:47,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 02:01:47,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-17 02:01:47,170 DEBUG [member: 'jenkins-hbase4.apache.org,40955,1676599305055' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-17 02:01:47,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 02:01:47,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 02:01:47,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38323,1676599305080 2023-02-17 02:01:47,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40955,1676599305055 2023-02-17 02:01:47,171 DEBUG [Listener at localhost/41671] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-17 02:01:47,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 02:01:47,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38323,1676599305080 2023-02-17 02:01:47,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39221] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-17 02:01:47,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39221] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-17 02:01:47,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40955,1676599305055 2023-02-17 02:01:47,172 DEBUG [Listener at localhost/41671] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-17 02:01:47,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,40955,1676599305055': 2023-02-17 02:01:47,173 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40955,1676599305055' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-17 02:01:47,173 INFO [(jenkins-hbase4.apache.org,39221,1676599305013)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-17 02:01:47,173 DEBUG [(jenkins-hbase4.apache.org,39221,1676599305013)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-17 02:01:47,173 DEBUG [(jenkins-hbase4.apache.org,39221,1676599305013)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-17 02:01:47,173 DEBUG [(jenkins-hbase4.apache.org,39221,1676599305013)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,173 INFO [(jenkins-hbase4.apache.org,39221,1676599305013)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-17 02:01:47,175 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): regionserver:38323-0x10060030ce80002, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,175 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): master:39221-0x10060030ce80000, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,175 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): regionserver:38323-0x10060030ce80002, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 02:01:47,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 02:01:47,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-17 02:01:47,175 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): regionserver:40955-0x10060030ce80001, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,175 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,175 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,175 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): regionserver:40955-0x10060030ce80001, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 02:01:47,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 02:01:47,175 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 02:01:47,175 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 02:01:47,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,175 DEBUG [(jenkins-hbase4.apache.org,39221,1676599305013)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39221-0x10060030ce80000, quorum=127.0.0.1:64305, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38323,1676599305080 2023-02-17 02:01:47,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 02:01:47,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 02:01:47,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 02:01:47,176 DEBUG [(jenkins-hbase4.apache.org,39221,1676599305013)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39221-0x10060030ce80000, quorum=127.0.0.1:64305, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40955,1676599305055 2023-02-17 02:01:47,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38323,1676599305080 2023-02-17 02:01:47,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40955,1676599305055 2023-02-17 02:01:47,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 02:01:47,177 DEBUG [(jenkins-hbase4.apache.org,39221,1676599305013)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39221-0x10060030ce80000, quorum=127.0.0.1:64305, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38323,1676599305080 2023-02-17 02:01:47,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,177 DEBUG [(jenkins-hbase4.apache.org,39221,1676599305013)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39221-0x10060030ce80000, quorum=127.0.0.1:64305, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40955,1676599305055 2023-02-17 02:01:47,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38323,1676599305080 2023-02-17 02:01:47,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40955,1676599305055 2023-02-17 02:01:47,183 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): master:39221-0x10060030ce80000, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40955,1676599305055 2023-02-17 02:01:47,183 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): regionserver:40955-0x10060030ce80001, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 02:01:47,183 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): regionserver:38323-0x10060030ce80002, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 02:01:47,183 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): regionserver:40955-0x10060030ce80001, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 02:01:47,183 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): regionserver:38323-0x10060030ce80002, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 02:01:47,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 02:01:47,183 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): master:39221-0x10060030ce80000, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 02:01:47,183 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,183 DEBUG [(jenkins-hbase4.apache.org,39221,1676599305013)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 02:01:47,183 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 02:01:47,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 02:01:47,183 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): master:39221-0x10060030ce80000, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38323,1676599305080 2023-02-17 02:01:47,184 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): master:39221-0x10060030ce80000, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 02:01:47,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 02:01:47,184 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): master:39221-0x10060030ce80000, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40955,1676599305055 2023-02-17 02:01:47,184 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): master:39221-0x10060030ce80000, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 02:01:47,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 02:01:47,184 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): master:39221-0x10060030ce80000, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38323,1676599305080 2023-02-17 02:01:47,184 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): master:39221-0x10060030ce80000, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,184 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): master:39221-0x10060030ce80000, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,184 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,198 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion to hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/.hbase-snapshot/testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,211 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed 2023-02-17 02:01:47,212 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,212 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,212 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion at 1676599307069Consolidate snapshot: testWithMockedMapReduceSingleRegion at 1676599307183 (+114 ms)Loading Region manifests for testWithMockedMapReduceSingleRegion at 1676599307184 (+1 ms)Writing data manifest for testWithMockedMapReduceSingleRegion at 1676599307186 (+2 ms)Verifying snapshot: testWithMockedMapReduceSingleRegion at 1676599307193 (+7 ms)Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed at 1676599307211 (+18 ms) 2023-02-17 02:01:47,214 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-17 02:01:47,215 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED in 144 msec 2023-02-17 02:01:47,372 DEBUG [Listener at localhost/41671] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-17 02:01:47,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39221] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-17 02:01:47,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39221] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-17 02:01:47,374 INFO [Listener at localhost/41671] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-17 02:01:47,378 INFO [Listener at localhost/41671] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-17 02:01:47,382 INFO [Listener at localhost/41671] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-17 02:01:47,410 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40955] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceSingleRegion,,1676599306315.00759a7c78131ff855da2987e16385af. 2023-02-17 02:01:47,558 INFO [Listener at localhost/41671] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-17 02:01:47,563 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39221] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-17 02:01:47,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39221] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,565 INFO [(jenkins-hbase4.apache.org,39221,1676599305013)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-17 02:01:47,565 DEBUG [(jenkins-hbase4.apache.org,39221,1676599305013)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-17 02:01:47,566 DEBUG [(jenkins-hbase4.apache.org,39221,1676599305013)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-17 02:01:47,566 DEBUG [(jenkins-hbase4.apache.org,39221,1676599305013)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-17 02:01:47,567 DEBUG [(jenkins-hbase4.apache.org,39221,1676599305013)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39221-0x10060030ce80000, quorum=127.0.0.1:64305, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,567 DEBUG [(jenkins-hbase4.apache.org,39221,1676599305013)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,569 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): regionserver:38323-0x10060030ce80002, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 02:01:47,569 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): regionserver:40955-0x10060030ce80001, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 02:01:47,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 02:01:47,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 02:01:47,569 DEBUG [(jenkins-hbase4.apache.org,39221,1676599305013)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40955,1676599305055 2023-02-17 02:01:47,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 02:01:47,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 02:01:47,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,569 DEBUG [(jenkins-hbase4.apache.org,39221,1676599305013)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39221-0x10060030ce80000, quorum=127.0.0.1:64305, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40955,1676599305055 2023-02-17 02:01:47,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,570 DEBUG [(jenkins-hbase4.apache.org,39221,1676599305013)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-17 02:01:47,570 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38323-0x10060030ce80002, quorum=127.0.0.1:64305, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,570 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40955-0x10060030ce80001, quorum=127.0.0.1:64305, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-17 02:01:47,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,570 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-17 02:01:47,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,570 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,570 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,571 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,571 DEBUG [member: 'jenkins-hbase4.apache.org,40955,1676599305055' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-17 02:01:47,571 DEBUG [member: 'jenkins-hbase4.apache.org,40955,1676599305055' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-17 02:01:47,571 DEBUG [member: 'jenkins-hbase4.apache.org,38323,1676599305080' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-17 02:01:47,572 DEBUG [member: 'jenkins-hbase4.apache.org,40955,1676599305055' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-17 02:01:47,572 DEBUG [member: 'jenkins-hbase4.apache.org,38323,1676599305080' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-17 02:01:47,573 DEBUG [member: 'jenkins-hbase4.apache.org,38323,1676599305080' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-17 02:01:47,573 DEBUG [member: 'jenkins-hbase4.apache.org,40955,1676599305055' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-17 02:01:47,573 DEBUG [member: 'jenkins-hbase4.apache.org,40955,1676599305055' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-17 02:01:47,573 DEBUG [rs(jenkins-hbase4.apache.org,40955,1676599305055)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceSingleRegion,,1676599306315.00759a7c78131ff855da2987e16385af. 2023-02-17 02:01:47,573 DEBUG [member: 'jenkins-hbase4.apache.org,38323,1676599305080' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-17 02:01:47,573 DEBUG [rs(jenkins-hbase4.apache.org,40955,1676599305055)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceSingleRegion,,1676599306315.00759a7c78131ff855da2987e16385af. started... 2023-02-17 02:01:47,573 DEBUG [member: 'jenkins-hbase4.apache.org,38323,1676599305080' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38323,1676599305080' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-17 02:01:47,573 INFO [rs(jenkins-hbase4.apache.org,40955,1676599305055)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 00759a7c78131ff855da2987e16385af 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-17 02:01:47,574 DEBUG [member: 'jenkins-hbase4.apache.org,38323,1676599305080' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,575 DEBUG [member: 'jenkins-hbase4.apache.org,38323,1676599305080' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38323-0x10060030ce80002, quorum=127.0.0.1:64305, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,575 DEBUG [member: 'jenkins-hbase4.apache.org,38323,1676599305080' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 02:01:47,591 INFO [rs(jenkins-hbase4.apache.org,40955,1676599305055)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/data/default/testWithMockedMapReduceSingleRegion/00759a7c78131ff855da2987e16385af/.tmp/f1/ef854ac363ab4091adf1b8200ecac401 2023-02-17 02:01:47,613 INFO [rs(jenkins-hbase4.apache.org,40955,1676599305055)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/data/default/testWithMockedMapReduceSingleRegion/00759a7c78131ff855da2987e16385af/.tmp/f2/b5b3b2db2b06465c90af2b505b4cc3a3 2023-02-17 02:01:47,618 DEBUG [rs(jenkins-hbase4.apache.org,40955,1676599305055)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/data/default/testWithMockedMapReduceSingleRegion/00759a7c78131ff855da2987e16385af/.tmp/f1/ef854ac363ab4091adf1b8200ecac401 as hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/data/default/testWithMockedMapReduceSingleRegion/00759a7c78131ff855da2987e16385af/f1/ef854ac363ab4091adf1b8200ecac401 2023-02-17 02:01:47,622 INFO [rs(jenkins-hbase4.apache.org,40955,1676599305055)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/data/default/testWithMockedMapReduceSingleRegion/00759a7c78131ff855da2987e16385af/f1/ef854ac363ab4091adf1b8200ecac401, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-17 02:01:47,623 DEBUG [rs(jenkins-hbase4.apache.org,40955,1676599305055)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/data/default/testWithMockedMapReduceSingleRegion/00759a7c78131ff855da2987e16385af/.tmp/f2/b5b3b2db2b06465c90af2b505b4cc3a3 as hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/data/default/testWithMockedMapReduceSingleRegion/00759a7c78131ff855da2987e16385af/f2/b5b3b2db2b06465c90af2b505b4cc3a3 2023-02-17 02:01:47,627 INFO [rs(jenkins-hbase4.apache.org,40955,1676599305055)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/data/default/testWithMockedMapReduceSingleRegion/00759a7c78131ff855da2987e16385af/f2/b5b3b2db2b06465c90af2b505b4cc3a3, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-17 02:01:47,628 INFO [rs(jenkins-hbase4.apache.org,40955,1676599305055)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 00759a7c78131ff855da2987e16385af in 55ms, sequenceid=9, compaction requested=false 2023-02-17 02:01:47,629 DEBUG [rs(jenkins-hbase4.apache.org,40955,1676599305055)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 00759a7c78131ff855da2987e16385af: 2023-02-17 02:01:47,629 DEBUG [rs(jenkins-hbase4.apache.org,40955,1676599305055)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceSingleRegion,,1676599306315.00759a7c78131ff855da2987e16385af. 2023-02-17 02:01:47,630 DEBUG [member: 'jenkins-hbase4.apache.org,40955,1676599305055' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-17 02:01:47,630 DEBUG [member: 'jenkins-hbase4.apache.org,40955,1676599305055' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-17 02:01:47,630 DEBUG [member: 'jenkins-hbase4.apache.org,40955,1676599305055' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40955,1676599305055 2023-02-17 02:01:47,630 DEBUG [member: 'jenkins-hbase4.apache.org,40955,1676599305055' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-17 02:01:47,630 DEBUG [member: 'jenkins-hbase4.apache.org,40955,1676599305055' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40955,1676599305055' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-17 02:01:47,631 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): master:39221-0x10060030ce80000, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40955,1676599305055 2023-02-17 02:01:47,631 DEBUG [member: 'jenkins-hbase4.apache.org,40955,1676599305055' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40955,1676599305055 2023-02-17 02:01:47,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 02:01:47,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-17 02:01:47,632 DEBUG [member: 'jenkins-hbase4.apache.org,40955,1676599305055' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40955-0x10060030ce80001, quorum=127.0.0.1:64305, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,632 DEBUG [member: 'jenkins-hbase4.apache.org,40955,1676599305055' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 02:01:47,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 02:01:47,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 02:01:47,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38323,1676599305080 2023-02-17 02:01:47,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40955,1676599305055 2023-02-17 02:01:47,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 02:01:47,634 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40955,1676599305055' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-17 02:01:47,634 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3bb7d6ea[Count = 0] remaining members to acquire global barrier 2023-02-17 02:01:47,634 DEBUG [(jenkins-hbase4.apache.org,39221,1676599305013)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-17 02:01:47,634 DEBUG [(jenkins-hbase4.apache.org,39221,1676599305013)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,635 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): regionserver:38323-0x10060030ce80002, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,635 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): regionserver:40955-0x10060030ce80001, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,635 DEBUG [member: 'jenkins-hbase4.apache.org,38323,1676599305080' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-17 02:01:47,635 DEBUG [member: 'jenkins-hbase4.apache.org,40955,1676599305055' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-17 02:01:47,635 DEBUG [member: 'jenkins-hbase4.apache.org,40955,1676599305055' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-17 02:01:47,635 DEBUG [member: 'jenkins-hbase4.apache.org,38323,1676599305080' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-17 02:01:47,635 DEBUG [member: 'jenkins-hbase4.apache.org,40955,1676599305055' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,40955,1676599305055' in zk 2023-02-17 02:01:47,635 DEBUG [(jenkins-hbase4.apache.org,39221,1676599305013)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39221-0x10060030ce80000, quorum=127.0.0.1:64305, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40955,1676599305055 2023-02-17 02:01:47,635 DEBUG [(jenkins-hbase4.apache.org,39221,1676599305013)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-17 02:01:47,635 DEBUG [member: 'jenkins-hbase4.apache.org,38323,1676599305080' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,38323,1676599305080' in zk 2023-02-17 02:01:47,637 DEBUG [member: 'jenkins-hbase4.apache.org,38323,1676599305080' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-17 02:01:47,637 DEBUG [member: 'jenkins-hbase4.apache.org,38323,1676599305080' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 02:01:47,637 DEBUG [member: 'jenkins-hbase4.apache.org,38323,1676599305080' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-17 02:01:47,638 DEBUG [member: 'jenkins-hbase4.apache.org,40955,1676599305055' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-17 02:01:47,638 DEBUG [member: 'jenkins-hbase4.apache.org,40955,1676599305055' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 02:01:47,638 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): master:39221-0x10060030ce80000, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40955,1676599305055 2023-02-17 02:01:47,638 DEBUG [member: 'jenkins-hbase4.apache.org,40955,1676599305055' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-17 02:01:47,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40955,1676599305055 2023-02-17 02:01:47,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 02:01:47,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-17 02:01:47,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 02:01:47,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 02:01:47,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38323,1676599305080 2023-02-17 02:01:47,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40955,1676599305055 2023-02-17 02:01:47,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 02:01:47,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38323,1676599305080 2023-02-17 02:01:47,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40955,1676599305055 2023-02-17 02:01:47,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,40955,1676599305055': 2023-02-17 02:01:47,641 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40955,1676599305055' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-17 02:01:47,641 INFO [(jenkins-hbase4.apache.org,39221,1676599305013)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-17 02:01:47,641 DEBUG [(jenkins-hbase4.apache.org,39221,1676599305013)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-17 02:01:47,641 DEBUG [(jenkins-hbase4.apache.org,39221,1676599305013)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-17 02:01:47,641 DEBUG [(jenkins-hbase4.apache.org,39221,1676599305013)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,641 INFO [(jenkins-hbase4.apache.org,39221,1676599305013)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-17 02:01:47,642 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): regionserver:38323-0x10060030ce80002, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,642 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): regionserver:40955-0x10060030ce80001, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,642 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): regionserver:38323-0x10060030ce80002, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 02:01:47,642 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): master:39221-0x10060030ce80000, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,643 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,643 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): regionserver:40955-0x10060030ce80001, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 02:01:47,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 02:01:47,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-17 02:01:47,643 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 02:01:47,643 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 02:01:47,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 02:01:47,643 DEBUG [(jenkins-hbase4.apache.org,39221,1676599305013)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39221-0x10060030ce80000, quorum=127.0.0.1:64305, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38323,1676599305080 2023-02-17 02:01:47,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 02:01:47,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 02:01:47,644 DEBUG [(jenkins-hbase4.apache.org,39221,1676599305013)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39221-0x10060030ce80000, quorum=127.0.0.1:64305, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40955,1676599305055 2023-02-17 02:01:47,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 02:01:47,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38323,1676599305080 2023-02-17 02:01:47,646 DEBUG [(jenkins-hbase4.apache.org,39221,1676599305013)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39221-0x10060030ce80000, quorum=127.0.0.1:64305, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38323,1676599305080 2023-02-17 02:01:47,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40955,1676599305055 2023-02-17 02:01:47,646 DEBUG [(jenkins-hbase4.apache.org,39221,1676599305013)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39221-0x10060030ce80000, quorum=127.0.0.1:64305, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40955,1676599305055 2023-02-17 02:01:47,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 02:01:47,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38323,1676599305080 2023-02-17 02:01:47,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40955,1676599305055 2023-02-17 02:01:47,649 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): master:39221-0x10060030ce80000, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40955,1676599305055 2023-02-17 02:01:47,649 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): regionserver:40955-0x10060030ce80001, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 02:01:47,649 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): master:39221-0x10060030ce80000, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,649 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 02:01:47,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 02:01:47,649 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39221] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceSingleRegion' 2023-02-17 02:01:47,649 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39221] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-17 02:01:47,649 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): master:39221-0x10060030ce80000, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38323,1676599305080 2023-02-17 02:01:47,649 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): regionserver:40955-0x10060030ce80001, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 02:01:47,649 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): regionserver:38323-0x10060030ce80002, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 02:01:47,649 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): master:39221-0x10060030ce80000, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,649 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): regionserver:38323-0x10060030ce80002, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 02:01:47,649 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:39221-0x10060030ce80000, quorum=127.0.0.1:64305, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion because node does not exist (not an error) 2023-02-17 02:01:47,649 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 02:01:47,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 02:01:47,649 DEBUG [(jenkins-hbase4.apache.org,39221,1676599305013)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 02:01:47,649 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): master:39221-0x10060030ce80000, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40955,1676599305055 2023-02-17 02:01:47,649 DEBUG [Listener at localhost/41671] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceSingleRegion'' to complete. (max 20000 ms per retry) 2023-02-17 02:01:47,649 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 02:01:47,649 DEBUG [Listener at localhost/41671] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-17 02:01:47,649 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): master:39221-0x10060030ce80000, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 02:01:47,650 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): master:39221-0x10060030ce80000, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38323,1676599305080 2023-02-17 02:01:47,650 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): master:39221-0x10060030ce80000, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,650 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): master:39221-0x10060030ce80000, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 02:01:47,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 02:01:47,750 DEBUG [Listener at localhost/41671] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-17 02:01:47,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39221] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-17 02:01:47,755 INFO [Listener at localhost/41671] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1676599307056 type: FLUSH version: 2 ttl: 0 2023-02-17 02:01:47,755 DEBUG [Listener at localhost/41671] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:35683/user/jenkins/test-data/7782fbc0-81a6-fdea-a814-5539fbeaabe2/testWithMockedMapReduceSingleRegion/59dc45ad-aad1-42eb-835a-3b73d421170e/data/default/testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,755 INFO [Listener at localhost/41671] snapshot.RestoreSnapshotHelper(239): region to add: 00759a7c78131ff855da2987e16385af 2023-02-17 02:01:47,755 INFO [Listener at localhost/41671] snapshot.RestoreSnapshotHelper(585): clone region=00759a7c78131ff855da2987e16385af as 00759a7c78131ff855da2987e16385af in snapshot testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,756 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 00759a7c78131ff855da2987e16385af, NAME => 'testWithMockedMapReduceSingleRegion,,1676599306315.00759a7c78131ff855da2987e16385af.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35683/user/jenkins/test-data/7782fbc0-81a6-fdea-a814-5539fbeaabe2/testWithMockedMapReduceSingleRegion/59dc45ad-aad1-42eb-835a-3b73d421170e 2023-02-17 02:01:47,762 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676599306315.00759a7c78131ff855da2987e16385af.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:47,762 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a11a2cd73027448f9aca91b031075431 from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,764 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 20115870b98a4a00a7f6e3d7bb934150 from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,765 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 00759a7c78131ff855da2987e16385af, disabling compactions & flushes 2023-02-17 02:01:47,765 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676599306315.00759a7c78131ff855da2987e16385af. 2023-02-17 02:01:47,765 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676599306315.00759a7c78131ff855da2987e16385af. 2023-02-17 02:01:47,765 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676599306315.00759a7c78131ff855da2987e16385af. after waiting 0 ms 2023-02-17 02:01:47,765 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676599306315.00759a7c78131ff855da2987e16385af. 2023-02-17 02:01:47,765 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676599306315.00759a7c78131ff855da2987e16385af. 2023-02-17 02:01:47,765 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 00759a7c78131ff855da2987e16385af: 2023-02-17 02:01:47,766 INFO [Listener at localhost/41671] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1676599307056 type: FLUSH version: 2 ttl: 0 2023-02-17 02:01:47,766 DEBUG [Listener at localhost/41671] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:35683/user/jenkins/test-data/7782fbc0-81a6-fdea-a814-5539fbeaabe2/testWithMockedMapReduceSingleRegion/59dc45ad-aad1-42eb-835a-3b73d421170e 2023-02-17 02:01:47,766 DEBUG [Listener at localhost/41671] util.CommonFSUtils(682): File system contents for path hdfs://localhost:35683/user/jenkins/test-data/7782fbc0-81a6-fdea-a814-5539fbeaabe2/testWithMockedMapReduceSingleRegion/59dc45ad-aad1-42eb-835a-3b73d421170e 2023-02-17 02:01:47,766 DEBUG [Listener at localhost/41671] util.CommonFSUtils(699): |-data/ 2023-02-17 02:01:47,767 DEBUG [Listener at localhost/41671] util.CommonFSUtils(699): |----default/ 2023-02-17 02:01:47,767 DEBUG [Listener at localhost/41671] util.CommonFSUtils(699): |-------testWithMockedMapReduceSingleRegion/ 2023-02-17 02:01:47,767 DEBUG [Listener at localhost/41671] util.CommonFSUtils(699): |----------00759a7c78131ff855da2987e16385af/ 2023-02-17 02:01:47,767 DEBUG [Listener at localhost/41671] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 02:01:47,767 DEBUG [Listener at localhost/41671] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 02:01:47,768 DEBUG [Listener at localhost/41671] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=00759a7c78131ff855da2987e16385af-a11a2cd73027448f9aca91b031075431 2023-02-17 02:01:47,768 DEBUG [Listener at localhost/41671] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 02:01:47,768 DEBUG [Listener at localhost/41671] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=00759a7c78131ff855da2987e16385af-20115870b98a4a00a7f6e3d7bb934150 2023-02-17 02:01:47,771 INFO [Listener at localhost/41671] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-17 02:01:47,774 DEBUG [Listener at localhost/41671] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676599306315.00759a7c78131ff855da2987e16385af.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:47,774 INFO [Listener at localhost/41671] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 02:01:47,774 DEBUG [Listener at localhost/41671] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 02:01:47,777 INFO [StoreOpener-00759a7c78131ff855da2987e16385af-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 00759a7c78131ff855da2987e16385af 2023-02-17 02:01:47,778 DEBUG [StoreOpener-00759a7c78131ff855da2987e16385af-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35683/user/jenkins/test-data/7782fbc0-81a6-fdea-a814-5539fbeaabe2/testWithMockedMapReduceSingleRegion/59dc45ad-aad1-42eb-835a-3b73d421170e/data/default/testWithMockedMapReduceSingleRegion/00759a7c78131ff855da2987e16385af/f1 2023-02-17 02:01:47,778 INFO [StoreOpener-00759a7c78131ff855da2987e16385af-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 00759a7c78131ff855da2987e16385af columnFamilyName f1 2023-02-17 02:01:47,782 DEBUG [StoreOpener-00759a7c78131ff855da2987e16385af-1] regionserver.HStore(539): loaded hdfs://localhost:35683/user/jenkins/test-data/7782fbc0-81a6-fdea-a814-5539fbeaabe2/testWithMockedMapReduceSingleRegion/59dc45ad-aad1-42eb-835a-3b73d421170e/data/default/testWithMockedMapReduceSingleRegion/00759a7c78131ff855da2987e16385af/f1/testWithMockedMapReduceSingleRegion=00759a7c78131ff855da2987e16385af-a11a2cd73027448f9aca91b031075431 2023-02-17 02:01:47,782 INFO [StoreOpener-00759a7c78131ff855da2987e16385af-1] regionserver.HStore(310): Store=00759a7c78131ff855da2987e16385af/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:47,782 INFO [StoreOpener-00759a7c78131ff855da2987e16385af-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 00759a7c78131ff855da2987e16385af 2023-02-17 02:01:47,783 DEBUG [StoreOpener-00759a7c78131ff855da2987e16385af-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35683/user/jenkins/test-data/7782fbc0-81a6-fdea-a814-5539fbeaabe2/testWithMockedMapReduceSingleRegion/59dc45ad-aad1-42eb-835a-3b73d421170e/data/default/testWithMockedMapReduceSingleRegion/00759a7c78131ff855da2987e16385af/f2 2023-02-17 02:01:47,783 INFO [StoreOpener-00759a7c78131ff855da2987e16385af-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 00759a7c78131ff855da2987e16385af columnFamilyName f2 2023-02-17 02:01:47,787 DEBUG [StoreOpener-00759a7c78131ff855da2987e16385af-1] regionserver.HStore(539): loaded hdfs://localhost:35683/user/jenkins/test-data/7782fbc0-81a6-fdea-a814-5539fbeaabe2/testWithMockedMapReduceSingleRegion/59dc45ad-aad1-42eb-835a-3b73d421170e/data/default/testWithMockedMapReduceSingleRegion/00759a7c78131ff855da2987e16385af/f2/testWithMockedMapReduceSingleRegion=00759a7c78131ff855da2987e16385af-20115870b98a4a00a7f6e3d7bb934150 2023-02-17 02:01:47,787 INFO [StoreOpener-00759a7c78131ff855da2987e16385af-1] regionserver.HStore(310): Store=00759a7c78131ff855da2987e16385af/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:47,787 DEBUG [Listener at localhost/41671] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 02:01:47,787 INFO [Listener at localhost/41671] regionserver.HRegion(1071): Opened 00759a7c78131ff855da2987e16385af; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74330802, jitterRate=0.10761526226997375}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 02:01:47,787 DEBUG [Listener at localhost/41671] regionserver.HRegion(964): Region open journal for 00759a7c78131ff855da2987e16385af: 2023-02-17 02:01:47,836 DEBUG [Listener at localhost/41671] regionserver.HRegion(1603): Closing 00759a7c78131ff855da2987e16385af, disabling compactions & flushes 2023-02-17 02:01:47,836 INFO [Listener at localhost/41671] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676599306315.00759a7c78131ff855da2987e16385af. 2023-02-17 02:01:47,836 DEBUG [Listener at localhost/41671] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676599306315.00759a7c78131ff855da2987e16385af. 2023-02-17 02:01:47,836 DEBUG [Listener at localhost/41671] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676599306315.00759a7c78131ff855da2987e16385af. after waiting 0 ms 2023-02-17 02:01:47,836 DEBUG [Listener at localhost/41671] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676599306315.00759a7c78131ff855da2987e16385af. 2023-02-17 02:01:47,837 INFO [Listener at localhost/41671] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676599306315.00759a7c78131ff855da2987e16385af. 2023-02-17 02:01:47,837 DEBUG [Listener at localhost/41671] regionserver.HRegion(1557): Region close journal for 00759a7c78131ff855da2987e16385af: 2023-02-17 02:01:47,841 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39221] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMockedMapReduceSingleRegion" 2023-02-17 02:01:47,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39221] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,844 INFO [Listener at localhost/41671] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,844 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39221] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39221] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-17 02:01:47,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39221] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-17 02:01:47,848 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676599307848"}]},"ts":"1676599307848"} 2023-02-17 02:01:47,849 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLING in hbase:meta 2023-02-17 02:01:47,853 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceSingleRegion to state=DISABLING 2023-02-17 02:01:47,853 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=00759a7c78131ff855da2987e16385af, UNASSIGN}] 2023-02-17 02:01:47,855 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=00759a7c78131ff855da2987e16385af, UNASSIGN 2023-02-17 02:01:47,855 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=00759a7c78131ff855da2987e16385af, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40955,1676599305055 2023-02-17 02:01:47,855 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1676599306315.00759a7c78131ff855da2987e16385af.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676599307855"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676599307855"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676599307855"}]},"ts":"1676599307855"} 2023-02-17 02:01:47,857 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 00759a7c78131ff855da2987e16385af, server=jenkins-hbase4.apache.org,40955,1676599305055}] 2023-02-17 02:01:47,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39221] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-17 02:01:48,012 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 00759a7c78131ff855da2987e16385af 2023-02-17 02:01:48,012 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 00759a7c78131ff855da2987e16385af, disabling compactions & flushes 2023-02-17 02:01:48,012 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676599306315.00759a7c78131ff855da2987e16385af. 2023-02-17 02:01:48,012 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676599306315.00759a7c78131ff855da2987e16385af. 2023-02-17 02:01:48,012 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676599306315.00759a7c78131ff855da2987e16385af. after waiting 0 ms 2023-02-17 02:01:48,012 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676599306315.00759a7c78131ff855da2987e16385af. 2023-02-17 02:01:48,019 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/data/default/testWithMockedMapReduceSingleRegion/00759a7c78131ff855da2987e16385af/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 02:01:48,019 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676599306315.00759a7c78131ff855da2987e16385af. 2023-02-17 02:01:48,019 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 00759a7c78131ff855da2987e16385af: 2023-02-17 02:01:48,022 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=00759a7c78131ff855da2987e16385af, regionState=CLOSED 2023-02-17 02:01:48,022 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1676599306315.00759a7c78131ff855da2987e16385af.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676599308022"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676599308022"}]},"ts":"1676599308022"} 2023-02-17 02:01:48,022 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 00759a7c78131ff855da2987e16385af 2023-02-17 02:01:48,025 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-17 02:01:48,025 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 00759a7c78131ff855da2987e16385af, server=jenkins-hbase4.apache.org,40955,1676599305055 in 167 msec 2023-02-17 02:01:48,026 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-17 02:01:48,026 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=00759a7c78131ff855da2987e16385af, UNASSIGN in 172 msec 2023-02-17 02:01:48,026 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676599308026"}]},"ts":"1676599308026"} 2023-02-17 02:01:48,027 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLED in hbase:meta 2023-02-17 02:01:48,029 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceSingleRegion to state=DISABLED 2023-02-17 02:01:48,030 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceSingleRegion in 184 msec 2023-02-17 02:01:48,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39221] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-17 02:01:48,151 INFO [Listener at localhost/41671] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 15 completed 2023-02-17 02:01:48,152 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39221] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testWithMockedMapReduceSingleRegion 2023-02-17 02:01:48,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39221] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-17 02:01:48,154 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-17 02:01:48,155 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-17 02:01:48,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39221] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-17 02:01:48,158 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/.tmp/data/default/testWithMockedMapReduceSingleRegion/00759a7c78131ff855da2987e16385af 2023-02-17 02:01:48,160 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/.tmp/data/default/testWithMockedMapReduceSingleRegion/00759a7c78131ff855da2987e16385af/f1, FileablePath, hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/.tmp/data/default/testWithMockedMapReduceSingleRegion/00759a7c78131ff855da2987e16385af/f2, FileablePath, hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/.tmp/data/default/testWithMockedMapReduceSingleRegion/00759a7c78131ff855da2987e16385af/recovered.edits] 2023-02-17 02:01:48,162 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/.tmp/data/default/testWithMockedMapReduceSingleRegion/00759a7c78131ff855da2987e16385af/f1/a11a2cd73027448f9aca91b031075431 to hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/archive/data/default/testWithMockedMapReduceSingleRegion/00759a7c78131ff855da2987e16385af/f1/a11a2cd73027448f9aca91b031075431 2023-02-17 02:01:48,164 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/.tmp/data/default/testWithMockedMapReduceSingleRegion/00759a7c78131ff855da2987e16385af/f1/ef854ac363ab4091adf1b8200ecac401 to hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/archive/data/default/testWithMockedMapReduceSingleRegion/00759a7c78131ff855da2987e16385af/f1/ef854ac363ab4091adf1b8200ecac401 2023-02-17 02:01:48,166 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/.tmp/data/default/testWithMockedMapReduceSingleRegion/00759a7c78131ff855da2987e16385af/f2/20115870b98a4a00a7f6e3d7bb934150 to hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/archive/data/default/testWithMockedMapReduceSingleRegion/00759a7c78131ff855da2987e16385af/f2/20115870b98a4a00a7f6e3d7bb934150 2023-02-17 02:01:48,167 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/.tmp/data/default/testWithMockedMapReduceSingleRegion/00759a7c78131ff855da2987e16385af/f2/b5b3b2db2b06465c90af2b505b4cc3a3 to hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/archive/data/default/testWithMockedMapReduceSingleRegion/00759a7c78131ff855da2987e16385af/f2/b5b3b2db2b06465c90af2b505b4cc3a3 2023-02-17 02:01:48,169 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/.tmp/data/default/testWithMockedMapReduceSingleRegion/00759a7c78131ff855da2987e16385af/recovered.edits/12.seqid to hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/archive/data/default/testWithMockedMapReduceSingleRegion/00759a7c78131ff855da2987e16385af/recovered.edits/12.seqid 2023-02-17 02:01:48,170 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/.tmp/data/default/testWithMockedMapReduceSingleRegion/00759a7c78131ff855da2987e16385af 2023-02-17 02:01:48,170 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-17 02:01:48,172 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-17 02:01:48,173 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMockedMapReduceSingleRegion from hbase:meta 2023-02-17 02:01:48,174 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceSingleRegion' descriptor. 2023-02-17 02:01:48,175 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-17 02:01:48,175 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceSingleRegion' from region states. 2023-02-17 02:01:48,175 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion,,1676599306315.00759a7c78131ff855da2987e16385af.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676599308175"}]},"ts":"9223372036854775807"} 2023-02-17 02:01:48,176 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-17 02:01:48,176 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 00759a7c78131ff855da2987e16385af, NAME => 'testWithMockedMapReduceSingleRegion,,1676599306315.00759a7c78131ff855da2987e16385af.', STARTKEY => '', ENDKEY => ''}] 2023-02-17 02:01:48,176 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceSingleRegion' as deleted. 2023-02-17 02:01:48,177 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676599308176"}]},"ts":"9223372036854775807"} 2023-02-17 02:01:48,178 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceSingleRegion state from META 2023-02-17 02:01:48,179 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-17 02:01:48,180 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion in 27 msec 2023-02-17 02:01:48,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39221] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-17 02:01:48,257 INFO [Listener at localhost/41671] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 18 completed 2023-02-17 02:01:48,257 INFO [Listener at localhost/41671] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-17 02:01:48,257 INFO [Listener at localhost/41671] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-17 02:01:48,257 DEBUG [Listener at localhost/41671] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x31de32bb to 127.0.0.1:64305 2023-02-17 02:01:48,258 DEBUG [Listener at localhost/41671] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 02:01:48,258 DEBUG [Listener at localhost/41671] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-17 02:01:48,258 DEBUG [Listener at localhost/41671] util.JVMClusterUtil(257): Found active master hash=2041037635, stopped=false 2023-02-17 02:01:48,258 INFO [Listener at localhost/41671] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,39221,1676599305013 2023-02-17 02:01:48,261 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): master:39221-0x10060030ce80000, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-17 02:01:48,261 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): regionserver:38323-0x10060030ce80002, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-17 02:01:48,261 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): regionserver:40955-0x10060030ce80001, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-17 02:01:48,261 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): master:39221-0x10060030ce80000, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 02:01:48,261 INFO [Listener at localhost/41671] procedure2.ProcedureExecutor(629): Stopping 2023-02-17 02:01:48,261 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38323-0x10060030ce80002, quorum=127.0.0.1:64305, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 02:01:48,261 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39221-0x10060030ce80000, quorum=127.0.0.1:64305, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 02:01:48,263 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40955-0x10060030ce80001, quorum=127.0.0.1:64305, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 02:01:48,263 DEBUG [Listener at localhost/41671] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2f2c353e to 127.0.0.1:64305 2023-02-17 02:01:48,263 DEBUG [Listener at localhost/41671] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 02:01:48,263 INFO [Listener at localhost/41671] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,40955,1676599305055' ***** 2023-02-17 02:01:48,263 INFO [Listener at localhost/41671] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-17 02:01:48,263 INFO [Listener at localhost/41671] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,38323,1676599305080' ***** 2023-02-17 02:01:48,263 INFO [Listener at localhost/41671] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-17 02:01:48,263 INFO [RS:0;jenkins-hbase4:40955] regionserver.HeapMemoryManager(220): Stopping 2023-02-17 02:01:48,264 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-17 02:01:48,264 INFO [RS:0;jenkins-hbase4:40955] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-17 02:01:48,264 INFO [RS:1;jenkins-hbase4:38323] regionserver.HeapMemoryManager(220): Stopping 2023-02-17 02:01:48,264 INFO [RS:0;jenkins-hbase4:40955] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-17 02:01:48,265 INFO [RS:1;jenkins-hbase4:38323] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-17 02:01:48,265 INFO [RS:0;jenkins-hbase4:40955] regionserver.HRegionServer(3304): Received CLOSE for ce4bfa955b3b11d2855328f7d8e4131a 2023-02-17 02:01:48,265 INFO [RS:1;jenkins-hbase4:38323] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-17 02:01:48,265 INFO [RS:0;jenkins-hbase4:40955] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,40955,1676599305055 2023-02-17 02:01:48,265 INFO [RS:1;jenkins-hbase4:38323] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,38323,1676599305080 2023-02-17 02:01:48,265 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-17 02:01:48,265 DEBUG [RS:1;jenkins-hbase4:38323] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x30ced96b to 127.0.0.1:64305 2023-02-17 02:01:48,265 DEBUG [RS:0;jenkins-hbase4:40955] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3d8d3869 to 127.0.0.1:64305 2023-02-17 02:01:48,265 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing ce4bfa955b3b11d2855328f7d8e4131a, disabling compactions & flushes 2023-02-17 02:01:48,266 DEBUG [RS:0;jenkins-hbase4:40955] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 02:01:48,266 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676599305759.ce4bfa955b3b11d2855328f7d8e4131a. 2023-02-17 02:01:48,266 INFO [RS:0;jenkins-hbase4:40955] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-17 02:01:48,266 DEBUG [RS:1;jenkins-hbase4:38323] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 02:01:48,266 INFO [RS:0;jenkins-hbase4:40955] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-17 02:01:48,266 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676599305759.ce4bfa955b3b11d2855328f7d8e4131a. 2023-02-17 02:01:48,266 INFO [RS:0;jenkins-hbase4:40955] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-17 02:01:48,266 INFO [RS:1;jenkins-hbase4:38323] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,38323,1676599305080; all regions closed. 2023-02-17 02:01:48,266 INFO [RS:0;jenkins-hbase4:40955] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-17 02:01:48,266 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676599305759.ce4bfa955b3b11d2855328f7d8e4131a. after waiting 0 ms 2023-02-17 02:01:48,266 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676599305759.ce4bfa955b3b11d2855328f7d8e4131a. 2023-02-17 02:01:48,266 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing ce4bfa955b3b11d2855328f7d8e4131a 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-17 02:01:48,266 INFO [RS:0;jenkins-hbase4:40955] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-17 02:01:48,266 DEBUG [RS:0;jenkins-hbase4:40955] regionserver.HRegionServer(1479): Online Regions={ce4bfa955b3b11d2855328f7d8e4131a=hbase:namespace,,1676599305759.ce4bfa955b3b11d2855328f7d8e4131a., 1588230740=hbase:meta,,1.1588230740} 2023-02-17 02:01:48,266 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-17 02:01:48,266 DEBUG [RS:0;jenkins-hbase4:40955] regionserver.HRegionServer(1505): Waiting on 1588230740, ce4bfa955b3b11d2855328f7d8e4131a 2023-02-17 02:01:48,266 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-17 02:01:48,266 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-17 02:01:48,266 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-17 02:01:48,266 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-17 02:01:48,267 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.21 KB heapSize=7.63 KB 2023-02-17 02:01:48,272 DEBUG [RS:1;jenkins-hbase4:38323] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/oldWALs 2023-02-17 02:01:48,272 INFO [RS:1;jenkins-hbase4:38323] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38323%2C1676599305080:(num 1676599306403) 2023-02-17 02:01:48,272 DEBUG [RS:1;jenkins-hbase4:38323] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 02:01:48,272 INFO [RS:1;jenkins-hbase4:38323] regionserver.LeaseManager(133): Closed leases 2023-02-17 02:01:48,272 INFO [RS:1;jenkins-hbase4:38323] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-17 02:01:48,272 INFO [RS:1;jenkins-hbase4:38323] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-17 02:01:48,272 INFO [RS:1;jenkins-hbase4:38323] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-17 02:01:48,272 INFO [RS:1;jenkins-hbase4:38323] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-17 02:01:48,272 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-17 02:01:48,273 INFO [RS:1;jenkins-hbase4:38323] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38323 2023-02-17 02:01:48,283 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/data/hbase/namespace/ce4bfa955b3b11d2855328f7d8e4131a/.tmp/info/2884aa4585964fd3a7162fe5bf468b7f 2023-02-17 02:01:48,283 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.57 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/data/hbase/meta/1588230740/.tmp/info/06e70d10f9b24ed89c9b313ab2c3ddfe 2023-02-17 02:01:48,287 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 06e70d10f9b24ed89c9b313ab2c3ddfe 2023-02-17 02:01:48,287 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/data/hbase/namespace/ce4bfa955b3b11d2855328f7d8e4131a/.tmp/info/2884aa4585964fd3a7162fe5bf468b7f as hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/data/hbase/namespace/ce4bfa955b3b11d2855328f7d8e4131a/info/2884aa4585964fd3a7162fe5bf468b7f 2023-02-17 02:01:48,291 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/data/hbase/namespace/ce4bfa955b3b11d2855328f7d8e4131a/info/2884aa4585964fd3a7162fe5bf468b7f, entries=2, sequenceid=6, filesize=4.8 K 2023-02-17 02:01:48,291 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for ce4bfa955b3b11d2855328f7d8e4131a in 25ms, sequenceid=6, compaction requested=false 2023-02-17 02:01:48,294 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-17 02:01:48,294 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-17 02:01:48,297 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/data/hbase/namespace/ce4bfa955b3b11d2855328f7d8e4131a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-17 02:01:48,298 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676599305759.ce4bfa955b3b11d2855328f7d8e4131a. 2023-02-17 02:01:48,298 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for ce4bfa955b3b11d2855328f7d8e4131a: 2023-02-17 02:01:48,298 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676599305759.ce4bfa955b3b11d2855328f7d8e4131a. 2023-02-17 02:01:48,298 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=115 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/data/hbase/meta/1588230740/.tmp/rep_barrier/6a18c5d6f90f47dea8a85748819b1c66 2023-02-17 02:01:48,301 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6a18c5d6f90f47dea8a85748819b1c66 2023-02-17 02:01:48,308 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=536 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/data/hbase/meta/1588230740/.tmp/table/4db21b490d634676ab8ad6ca4958e961 2023-02-17 02:01:48,311 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4db21b490d634676ab8ad6ca4958e961 2023-02-17 02:01:48,311 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/data/hbase/meta/1588230740/.tmp/info/06e70d10f9b24ed89c9b313ab2c3ddfe as hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/data/hbase/meta/1588230740/info/06e70d10f9b24ed89c9b313ab2c3ddfe 2023-02-17 02:01:48,315 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 06e70d10f9b24ed89c9b313ab2c3ddfe 2023-02-17 02:01:48,315 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/data/hbase/meta/1588230740/info/06e70d10f9b24ed89c9b313ab2c3ddfe, entries=12, sequenceid=21, filesize=6.3 K 2023-02-17 02:01:48,316 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/data/hbase/meta/1588230740/.tmp/rep_barrier/6a18c5d6f90f47dea8a85748819b1c66 as hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/data/hbase/meta/1588230740/rep_barrier/6a18c5d6f90f47dea8a85748819b1c66 2023-02-17 02:01:48,319 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6a18c5d6f90f47dea8a85748819b1c66 2023-02-17 02:01:48,319 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/data/hbase/meta/1588230740/rep_barrier/6a18c5d6f90f47dea8a85748819b1c66, entries=1, sequenceid=21, filesize=5.0 K 2023-02-17 02:01:48,320 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/data/hbase/meta/1588230740/.tmp/table/4db21b490d634676ab8ad6ca4958e961 as hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/data/hbase/meta/1588230740/table/4db21b490d634676ab8ad6ca4958e961 2023-02-17 02:01:48,323 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4db21b490d634676ab8ad6ca4958e961 2023-02-17 02:01:48,323 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/data/hbase/meta/1588230740/table/4db21b490d634676ab8ad6ca4958e961, entries=4, sequenceid=21, filesize=5.1 K 2023-02-17 02:01:48,326 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.21 KB/4311, heapSize ~7.58 KB/7760, currentSize=0 B/0 for 1588230740 in 60ms, sequenceid=21, compaction requested=false 2023-02-17 02:01:48,330 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-17 02:01:48,330 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-17 02:01:48,330 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-17 02:01:48,330 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-17 02:01:48,330 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-17 02:01:48,373 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): regionserver:40955-0x10060030ce80001, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38323,1676599305080 2023-02-17 02:01:48,373 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): master:39221-0x10060030ce80000, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 02:01:48,373 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): regionserver:38323-0x10060030ce80002, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38323,1676599305080 2023-02-17 02:01:48,373 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): regionserver:40955-0x10060030ce80001, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 02:01:48,374 ERROR [Listener at localhost/41671-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3ba2eea2 rejected from java.util.concurrent.ThreadPoolExecutor@3f9d6d0e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 02:01:48,374 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): regionserver:38323-0x10060030ce80002, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 02:01:48,374 ERROR [Listener at localhost/41671-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@67544b42 rejected from java.util.concurrent.ThreadPoolExecutor@3f9d6d0e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 02:01:48,374 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,38323,1676599305080] 2023-02-17 02:01:48,375 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,38323,1676599305080; numProcessing=1 2023-02-17 02:01:48,376 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,38323,1676599305080 already deleted, retry=false 2023-02-17 02:01:48,376 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,38323,1676599305080 expired; onlineServers=1 2023-02-17 02:01:48,437 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-17 02:01:48,437 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-17 02:01:48,466 INFO [RS:0;jenkins-hbase4:40955] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,40955,1676599305055; all regions closed. 2023-02-17 02:01:48,471 DEBUG [RS:0;jenkins-hbase4:40955] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/oldWALs 2023-02-17 02:01:48,471 INFO [RS:0;jenkins-hbase4:40955] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40955%2C1676599305055.meta:.meta(num 1676599305694) 2023-02-17 02:01:48,475 DEBUG [RS:0;jenkins-hbase4:40955] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/oldWALs 2023-02-17 02:01:48,475 INFO [RS:0;jenkins-hbase4:40955] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40955%2C1676599305055:(num 1676599306117) 2023-02-17 02:01:48,475 DEBUG [RS:0;jenkins-hbase4:40955] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 02:01:48,475 INFO [RS:0;jenkins-hbase4:40955] regionserver.LeaseManager(133): Closed leases 2023-02-17 02:01:48,476 INFO [RS:0;jenkins-hbase4:40955] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-17 02:01:48,476 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-17 02:01:48,477 INFO [RS:0;jenkins-hbase4:40955] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40955 2023-02-17 02:01:48,480 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): master:39221-0x10060030ce80000, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 02:01:48,480 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): regionserver:40955-0x10060030ce80001, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40955,1676599305055 2023-02-17 02:01:48,480 ERROR [Listener at localhost/41671-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@12b41929 rejected from java.util.concurrent.ThreadPoolExecutor@168b8fa7[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 02:01:48,480 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40955,1676599305055] 2023-02-17 02:01:48,480 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40955,1676599305055; numProcessing=2 2023-02-17 02:01:48,482 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40955,1676599305055 already deleted, retry=false 2023-02-17 02:01:48,482 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,40955,1676599305055 expired; onlineServers=0 2023-02-17 02:01:48,482 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,39221,1676599305013' ***** 2023-02-17 02:01:48,482 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-17 02:01:48,483 DEBUG [M:0;jenkins-hbase4:39221] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7d9858af, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-17 02:01:48,483 INFO [M:0;jenkins-hbase4:39221] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,39221,1676599305013 2023-02-17 02:01:48,483 INFO [M:0;jenkins-hbase4:39221] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,39221,1676599305013; all regions closed. 2023-02-17 02:01:48,483 DEBUG [M:0;jenkins-hbase4:39221] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 02:01:48,483 DEBUG [M:0;jenkins-hbase4:39221] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-17 02:01:48,483 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-17 02:01:48,483 DEBUG [M:0;jenkins-hbase4:39221] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-17 02:01:48,483 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676599305316] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676599305316,5,FailOnTimeoutGroup] 2023-02-17 02:01:48,483 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676599305315] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676599305315,5,FailOnTimeoutGroup] 2023-02-17 02:01:48,483 INFO [M:0;jenkins-hbase4:39221] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-17 02:01:48,485 INFO [M:0;jenkins-hbase4:39221] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-17 02:01:48,485 INFO [M:0;jenkins-hbase4:39221] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-17 02:01:48,485 DEBUG [M:0;jenkins-hbase4:39221] master.HMaster(1512): Stopping service threads 2023-02-17 02:01:48,485 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): master:39221-0x10060030ce80000, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-17 02:01:48,485 INFO [M:0;jenkins-hbase4:39221] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-17 02:01:48,485 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): master:39221-0x10060030ce80000, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 02:01:48,486 ERROR [M:0;jenkins-hbase4:39221] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-17 02:01:48,486 INFO [M:0;jenkins-hbase4:39221] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-17 02:01:48,486 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39221-0x10060030ce80000, quorum=127.0.0.1:64305, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 02:01:48,486 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-17 02:01:48,487 DEBUG [M:0;jenkins-hbase4:39221] zookeeper.ZKUtil(398): master:39221-0x10060030ce80000, quorum=127.0.0.1:64305, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-17 02:01:48,487 WARN [M:0;jenkins-hbase4:39221] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-17 02:01:48,487 INFO [M:0;jenkins-hbase4:39221] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-17 02:01:48,487 INFO [M:0;jenkins-hbase4:39221] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-17 02:01:48,488 DEBUG [M:0;jenkins-hbase4:39221] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-17 02:01:48,488 INFO [M:0;jenkins-hbase4:39221] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 02:01:48,488 DEBUG [M:0;jenkins-hbase4:39221] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 02:01:48,488 DEBUG [M:0;jenkins-hbase4:39221] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-17 02:01:48,488 DEBUG [M:0;jenkins-hbase4:39221] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 02:01:48,488 INFO [M:0;jenkins-hbase4:39221] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.15 KB heapSize=67.07 KB 2023-02-17 02:01:48,498 INFO [M:0;jenkins-hbase4:39221] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.15 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/2aa0a0c5f2b7429c82fef8ba3a8c48dd 2023-02-17 02:01:48,502 DEBUG [M:0;jenkins-hbase4:39221] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/2aa0a0c5f2b7429c82fef8ba3a8c48dd as hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/2aa0a0c5f2b7429c82fef8ba3a8c48dd 2023-02-17 02:01:48,506 INFO [M:0;jenkins-hbase4:39221] regionserver.HStore(1080): Added hdfs://localhost:35683/user/jenkins/test-data/c313b978-ebe1-05be-f07c-f4ee24e9436f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/2aa0a0c5f2b7429c82fef8ba3a8c48dd, entries=17, sequenceid=132, filesize=8.7 K 2023-02-17 02:01:48,507 INFO [M:0;jenkins-hbase4:39221] regionserver.HRegion(2947): Finished flush of dataSize ~56.15 KB/57497, heapSize ~67.05 KB/68664, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 19ms, sequenceid=132, compaction requested=false 2023-02-17 02:01:48,508 INFO [M:0;jenkins-hbase4:39221] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 02:01:48,508 DEBUG [M:0;jenkins-hbase4:39221] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-17 02:01:48,510 INFO [M:0;jenkins-hbase4:39221] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-17 02:01:48,510 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-17 02:01:48,511 INFO [M:0;jenkins-hbase4:39221] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39221 2023-02-17 02:01:48,515 DEBUG [M:0;jenkins-hbase4:39221] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,39221,1676599305013 already deleted, retry=false 2023-02-17 02:01:48,660 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): master:39221-0x10060030ce80000, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 02:01:48,660 INFO [M:0;jenkins-hbase4:39221] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,39221,1676599305013; zookeeper connection closed. 2023-02-17 02:01:48,660 ERROR [Listener at localhost/41671-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@100556d3 rejected from java.util.concurrent.ThreadPoolExecutor@143ad00b[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 02:01:48,661 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): master:39221-0x10060030ce80000, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 02:01:48,661 ERROR [Listener at localhost/41671-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5aaa2cd7 rejected from java.util.concurrent.ThreadPoolExecutor@143ad00b[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 02:01:48,760 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): regionserver:40955-0x10060030ce80001, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 02:01:48,760 INFO [RS:0;jenkins-hbase4:40955] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,40955,1676599305055; zookeeper connection closed. 2023-02-17 02:01:48,760 ERROR [Listener at localhost/41671-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@505f00e8 rejected from java.util.concurrent.ThreadPoolExecutor@168b8fa7[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 02:01:48,760 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): regionserver:40955-0x10060030ce80001, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 02:01:48,760 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@587f6676] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@587f6676 2023-02-17 02:01:48,760 ERROR [Listener at localhost/41671-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@282c6bc9 rejected from java.util.concurrent.ThreadPoolExecutor@168b8fa7[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 02:01:48,860 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): regionserver:38323-0x10060030ce80002, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 02:01:48,860 INFO [RS:1;jenkins-hbase4:38323] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,38323,1676599305080; zookeeper connection closed. 2023-02-17 02:01:48,860 ERROR [Listener at localhost/41671-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1f8e8f92 rejected from java.util.concurrent.ThreadPoolExecutor@3f9d6d0e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 02:01:48,862 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@6b61f523] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@6b61f523 2023-02-17 02:01:48,862 DEBUG [Listener at localhost/41671-EventThread] zookeeper.ZKWatcher(600): regionserver:38323-0x10060030ce80002, quorum=127.0.0.1:64305, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 02:01:48,862 ERROR [Listener at localhost/41671-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5ffb5d99 rejected from java.util.concurrent.ThreadPoolExecutor@3f9d6d0e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 02:01:48,862 INFO [Listener at localhost/41671] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-17 02:01:48,863 WARN [Listener at localhost/41671] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-17 02:01:48,866 INFO [Listener at localhost/41671] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-17 02:01:48,972 WARN [BP-1340101427-172.31.14.131-1676599304405 heartbeating to localhost/127.0.0.1:35683] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-17 02:01:48,972 WARN [BP-1340101427-172.31.14.131-1676599304405 heartbeating to localhost/127.0.0.1:35683] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1340101427-172.31.14.131-1676599304405 (Datanode Uuid b6904d76-5f44-4106-8f28-b228a31bb3f8) service to localhost/127.0.0.1:35683 2023-02-17 02:01:48,973 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9440df8-f718-d21e-3493-16dc72ea0e0d/cluster_a7500156-fa50-d925-020d-c6d11b249bd3/dfs/data/data3/current/BP-1340101427-172.31.14.131-1676599304405] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 02:01:48,973 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9440df8-f718-d21e-3493-16dc72ea0e0d/cluster_a7500156-fa50-d925-020d-c6d11b249bd3/dfs/data/data4/current/BP-1340101427-172.31.14.131-1676599304405] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 02:01:48,974 WARN [Listener at localhost/41671] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-17 02:01:48,979 INFO [Listener at localhost/41671] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-17 02:01:49,082 WARN [BP-1340101427-172.31.14.131-1676599304405 heartbeating to localhost/127.0.0.1:35683] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-17 02:01:49,082 WARN [BP-1340101427-172.31.14.131-1676599304405 heartbeating to localhost/127.0.0.1:35683] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1340101427-172.31.14.131-1676599304405 (Datanode Uuid 46a5c068-c24c-435a-81f4-234897490832) service to localhost/127.0.0.1:35683 2023-02-17 02:01:49,083 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9440df8-f718-d21e-3493-16dc72ea0e0d/cluster_a7500156-fa50-d925-020d-c6d11b249bd3/dfs/data/data1/current/BP-1340101427-172.31.14.131-1676599304405] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 02:01:49,083 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9440df8-f718-d21e-3493-16dc72ea0e0d/cluster_a7500156-fa50-d925-020d-c6d11b249bd3/dfs/data/data2/current/BP-1340101427-172.31.14.131-1676599304405] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 02:01:49,093 INFO [Listener at localhost/41671] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-17 02:01:49,208 INFO [Listener at localhost/41671] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-17 02:01:49,233 INFO [Listener at localhost/41671] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-17 02:01:49,245 INFO [Listener at localhost/41671] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=254 (was 230) Potentially hanging thread: IPC Client (1508527786) connection to localhost/127.0.0.1:35683 from jenkins.hfs.8 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-17-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:35683 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1508527786) connection to localhost/127.0.0.1:35683 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Listener at localhost/41671 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.9@localhost:35683 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,39221,1676599305013)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1508527786) connection to localhost/127.0.0.1:35683 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-21-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.8@localhost:35683 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-13 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-14 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/41671.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Client (1508527786) connection to localhost/127.0.0.1:35683 from jenkins.hfs.9 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-19-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=641 (was 623) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=392 (was 356) - SystemLoadAverage LEAK? -, ProcessCount=170 (was 170), AvailableMemoryMB=7358 (was 7403) 2023-02-17 02:01:49,256 INFO [Listener at localhost/41671] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=254, OpenFileDescriptor=641, MaxFileDescriptor=60000, SystemLoadAverage=392, ProcessCount=170, AvailableMemoryMB=7358 2023-02-17 02:01:49,267 INFO [Listener at localhost/41671] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9440df8-f718-d21e-3493-16dc72ea0e0d/hadoop.log.dir so I do NOT create it in target/test-data/d2420a49-123a-e71b-5652-068fed1258f1 2023-02-17 02:01:49,267 WARN [Listener at localhost/41671] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9440df8-f718-d21e-3493-16dc72ea0e0d/hadoop.log.dir Erasing configuration value by system value. 2023-02-17 02:01:49,267 INFO [Listener at localhost/41671] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9440df8-f718-d21e-3493-16dc72ea0e0d/hadoop.tmp.dir so I do NOT create it in target/test-data/d2420a49-123a-e71b-5652-068fed1258f1 2023-02-17 02:01:49,267 WARN [Listener at localhost/41671] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9440df8-f718-d21e-3493-16dc72ea0e0d/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-17 02:01:49,267 DEBUG [Listener at localhost/41671] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d2420a49-123a-e71b-5652-068fed1258f1 2023-02-17 02:01:49,267 INFO [Listener at localhost/41671] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-17 02:01:49,267 INFO [Listener at localhost/41671] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d2420a49-123a-e71b-5652-068fed1258f1/cluster_c38d1cec-c137-1d2c-a863-434836f60b00, deleteOnExit=true 2023-02-17 02:01:49,267 INFO [Listener at localhost/41671] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-17 02:01:49,268 INFO [Listener at localhost/41671] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d2420a49-123a-e71b-5652-068fed1258f1/test.cache.data in system properties and HBase conf 2023-02-17 02:01:49,268 INFO [Listener at localhost/41671] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d2420a49-123a-e71b-5652-068fed1258f1/hadoop.tmp.dir in system properties and HBase conf 2023-02-17 02:01:49,268 INFO [Listener at localhost/41671] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d2420a49-123a-e71b-5652-068fed1258f1/hadoop.log.dir in system properties and HBase conf 2023-02-17 02:01:49,268 INFO [Listener at localhost/41671] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d2420a49-123a-e71b-5652-068fed1258f1/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-17 02:01:49,268 INFO [Listener at localhost/41671] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d2420a49-123a-e71b-5652-068fed1258f1/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-17 02:01:49,268 INFO [Listener at localhost/41671] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-17 02:01:49,268 DEBUG [Listener at localhost/41671] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-17 02:01:49,268 INFO [Listener at localhost/41671] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d2420a49-123a-e71b-5652-068fed1258f1/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-17 02:01:49,268 INFO [Listener at localhost/41671] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d2420a49-123a-e71b-5652-068fed1258f1/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-17 02:01:49,268 INFO [Listener at localhost/41671] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d2420a49-123a-e71b-5652-068fed1258f1/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-17 02:01:49,269 INFO [Listener at localhost/41671] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d2420a49-123a-e71b-5652-068fed1258f1/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-17 02:01:49,269 INFO [Listener at localhost/41671] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d2420a49-123a-e71b-5652-068fed1258f1/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-17 02:01:49,269 INFO [Listener at localhost/41671] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d2420a49-123a-e71b-5652-068fed1258f1/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-17 02:01:49,269 INFO [Listener at localhost/41671] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d2420a49-123a-e71b-5652-068fed1258f1/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-17 02:01:49,269 INFO [Listener at localhost/41671] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d2420a49-123a-e71b-5652-068fed1258f1/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-17 02:01:49,269 INFO [Listener at localhost/41671] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d2420a49-123a-e71b-5652-068fed1258f1/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-17 02:01:49,269 INFO [Listener at localhost/41671] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d2420a49-123a-e71b-5652-068fed1258f1/nfs.dump.dir in system properties and HBase conf 2023-02-17 02:01:49,269 INFO [Listener at localhost/41671] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d2420a49-123a-e71b-5652-068fed1258f1/java.io.tmpdir in system properties and HBase conf 2023-02-17 02:01:49,269 INFO [Listener at localhost/41671] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d2420a49-123a-e71b-5652-068fed1258f1/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-17 02:01:49,269 INFO [Listener at localhost/41671] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d2420a49-123a-e71b-5652-068fed1258f1/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-17 02:01:49,269 INFO [Listener at localhost/41671] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d2420a49-123a-e71b-5652-068fed1258f1/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-17 02:01:49,274 WARN [Listener at localhost/41671] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-17 02:01:49,274 WARN [Listener at localhost/41671] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-17 02:01:49,320 WARN [Listener at localhost/41671] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-17 02:01:49,323 INFO [Listener at localhost/41671] log.Slf4jLog(67): jetty-6.1.26 2023-02-17 02:01:49,329 INFO [Listener at localhost/41671] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d2420a49-123a-e71b-5652-068fed1258f1/java.io.tmpdir/Jetty_localhost_41683_hdfs____.y7bxaa/webapp 2023-02-17 02:01:49,446 INFO [Listener at localhost/41671] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41683 2023-02-17 02:01:49,451 WARN [Listener at localhost/41671] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-17 02:01:49,451 WARN [Listener at localhost/41671] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-17 02:01:49,500 WARN [Listener at localhost/38701] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-17 02:01:49,524 WARN [Listener at localhost/38701] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-17 02:01:49,526 WARN [Listener at localhost/38701] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-17 02:01:49,527 INFO [Listener at localhost/38701] log.Slf4jLog(67): jetty-6.1.26 2023-02-17 02:01:49,533 INFO [Listener at localhost/38701] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d2420a49-123a-e71b-5652-068fed1258f1/java.io.tmpdir/Jetty_localhost_41133_datanode____.a0f23p/webapp 2023-02-17 02:01:49,626 INFO [Listener at localhost/38701] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41133 2023-02-17 02:01:49,634 WARN [Listener at localhost/43211] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-17 02:01:49,660 WARN [Listener at localhost/43211] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-17 02:01:49,672 WARN [Listener at localhost/43211] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-17 02:01:49,673 INFO [Listener at localhost/43211] log.Slf4jLog(67): jetty-6.1.26 2023-02-17 02:01:49,678 INFO [Listener at localhost/43211] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d2420a49-123a-e71b-5652-068fed1258f1/java.io.tmpdir/Jetty_localhost_45135_datanode____hjhmop/webapp 2023-02-17 02:01:49,749 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5e80c8fcda9b12e: Processing first storage report for DS-c2cf8a2f-d706-4378-bb01-3e4aec265dd1 from datanode c2f4c1d0-a3b9-4d55-81a7-8492962efb5f 2023-02-17 02:01:49,750 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5e80c8fcda9b12e: from storage DS-c2cf8a2f-d706-4378-bb01-3e4aec265dd1 node DatanodeRegistration(127.0.0.1:36097, datanodeUuid=c2f4c1d0-a3b9-4d55-81a7-8492962efb5f, infoPort=42343, infoSecurePort=0, ipcPort=43211, storageInfo=lv=-57;cid=testClusterID;nsid=2007370508;c=1676599309276), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-17 02:01:49,750 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5e80c8fcda9b12e: Processing first storage report for DS-1f9404fb-56f2-43b3-991e-7646ef725602 from datanode c2f4c1d0-a3b9-4d55-81a7-8492962efb5f 2023-02-17 02:01:49,750 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5e80c8fcda9b12e: from storage DS-1f9404fb-56f2-43b3-991e-7646ef725602 node DatanodeRegistration(127.0.0.1:36097, datanodeUuid=c2f4c1d0-a3b9-4d55-81a7-8492962efb5f, infoPort=42343, infoSecurePort=0, ipcPort=43211, storageInfo=lv=-57;cid=testClusterID;nsid=2007370508;c=1676599309276), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-17 02:01:49,777 INFO [Listener at localhost/43211] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45135 2023-02-17 02:01:49,785 WARN [Listener at localhost/46505] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-17 02:01:49,887 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x16be6b2987cf5ebe: Processing first storage report for DS-7ae460a6-2477-444b-9d5d-643fe24205a1 from datanode 64d22006-ba66-4c45-aa45-1498a23b329d 2023-02-17 02:01:49,887 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x16be6b2987cf5ebe: from storage DS-7ae460a6-2477-444b-9d5d-643fe24205a1 node DatanodeRegistration(127.0.0.1:43973, datanodeUuid=64d22006-ba66-4c45-aa45-1498a23b329d, infoPort=41795, infoSecurePort=0, ipcPort=46505, storageInfo=lv=-57;cid=testClusterID;nsid=2007370508;c=1676599309276), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-17 02:01:49,887 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x16be6b2987cf5ebe: Processing first storage report for DS-8ea92229-41f7-4e7e-a81e-3d4711db0d43 from datanode 64d22006-ba66-4c45-aa45-1498a23b329d 2023-02-17 02:01:49,887 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x16be6b2987cf5ebe: from storage DS-8ea92229-41f7-4e7e-a81e-3d4711db0d43 node DatanodeRegistration(127.0.0.1:43973, datanodeUuid=64d22006-ba66-4c45-aa45-1498a23b329d, infoPort=41795, infoSecurePort=0, ipcPort=46505, storageInfo=lv=-57;cid=testClusterID;nsid=2007370508;c=1676599309276), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-17 02:01:49,891 DEBUG [Listener at localhost/46505] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d2420a49-123a-e71b-5652-068fed1258f1 2023-02-17 02:01:49,893 INFO [Listener at localhost/46505] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d2420a49-123a-e71b-5652-068fed1258f1/cluster_c38d1cec-c137-1d2c-a863-434836f60b00/zookeeper_0, clientPort=59593, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d2420a49-123a-e71b-5652-068fed1258f1/cluster_c38d1cec-c137-1d2c-a863-434836f60b00/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d2420a49-123a-e71b-5652-068fed1258f1/cluster_c38d1cec-c137-1d2c-a863-434836f60b00/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-17 02:01:49,894 INFO [Listener at localhost/46505] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=59593 2023-02-17 02:01:49,894 INFO [Listener at localhost/46505] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 02:01:49,895 INFO [Listener at localhost/46505] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 02:01:49,912 INFO [Listener at localhost/46505] util.FSUtils(479): Created version file at hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78 with version=8 2023-02-17 02:01:49,913 INFO [Listener at localhost/46505] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 02:01:49,914 INFO [Listener at localhost/46505] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 02:01:49,915 INFO [Listener at localhost/46505] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:38701/user/jenkins/test-data/2b72b1ec-cd12-ebc6-c216-f6433e505499/hbase-staging 2023-02-17 02:01:49,917 INFO [Listener at localhost/46505] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-17 02:01:49,917 INFO [Listener at localhost/46505] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 02:01:49,917 INFO [Listener at localhost/46505] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-17 02:01:49,917 INFO [Listener at localhost/46505] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-17 02:01:49,918 INFO [Listener at localhost/46505] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 02:01:49,918 INFO [Listener at localhost/46505] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-17 02:01:49,918 INFO [Listener at localhost/46505] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-17 02:01:49,919 INFO [Listener at localhost/46505] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45095 2023-02-17 02:01:49,919 INFO [Listener at localhost/46505] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 02:01:49,920 INFO [Listener at localhost/46505] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 02:01:49,921 INFO [Listener at localhost/46505] zookeeper.RecoverableZooKeeper(93): Process identifier=master:45095 connecting to ZooKeeper ensemble=127.0.0.1:59593 2023-02-17 02:01:49,928 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): master:450950x0, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-17 02:01:49,928 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:45095-0x1006003200a0000 connected 2023-02-17 02:01:49,946 DEBUG [Listener at localhost/46505] zookeeper.ZKUtil(164): master:45095-0x1006003200a0000, quorum=127.0.0.1:59593, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 02:01:49,946 DEBUG [Listener at localhost/46505] zookeeper.ZKUtil(164): master:45095-0x1006003200a0000, quorum=127.0.0.1:59593, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 02:01:49,947 DEBUG [Listener at localhost/46505] zookeeper.ZKUtil(164): master:45095-0x1006003200a0000, quorum=127.0.0.1:59593, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-17 02:01:49,948 DEBUG [Listener at localhost/46505] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45095 2023-02-17 02:01:49,948 DEBUG [Listener at localhost/46505] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45095 2023-02-17 02:01:49,948 DEBUG [Listener at localhost/46505] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45095 2023-02-17 02:01:49,949 DEBUG [Listener at localhost/46505] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45095 2023-02-17 02:01:49,950 DEBUG [Listener at localhost/46505] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45095 2023-02-17 02:01:49,950 INFO [Listener at localhost/46505] master.HMaster(444): hbase.rootdir=hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78, hbase.cluster.distributed=false 2023-02-17 02:01:49,964 INFO [Listener at localhost/46505] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-17 02:01:49,964 INFO [Listener at localhost/46505] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 02:01:49,964 INFO [Listener at localhost/46505] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-17 02:01:49,964 INFO [Listener at localhost/46505] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-17 02:01:49,964 INFO [Listener at localhost/46505] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 02:01:49,964 INFO [Listener at localhost/46505] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-17 02:01:49,964 INFO [Listener at localhost/46505] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-17 02:01:49,966 INFO [Listener at localhost/46505] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33613 2023-02-17 02:01:49,966 INFO [Listener at localhost/46505] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-17 02:01:49,967 DEBUG [Listener at localhost/46505] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 02:01:49,967 INFO [Listener at localhost/46505] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 02:01:49,969 INFO [Listener at localhost/46505] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 02:01:49,970 INFO [Listener at localhost/46505] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:33613 connecting to ZooKeeper ensemble=127.0.0.1:59593 2023-02-17 02:01:49,972 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): regionserver:336130x0, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-17 02:01:49,972 DEBUG [Listener at localhost/46505] zookeeper.ZKUtil(164): regionserver:336130x0, quorum=127.0.0.1:59593, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 02:01:49,973 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:33613-0x1006003200a0001 connected 2023-02-17 02:01:49,974 DEBUG [Listener at localhost/46505] zookeeper.ZKUtil(164): regionserver:33613-0x1006003200a0001, quorum=127.0.0.1:59593, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 02:01:49,974 DEBUG [Listener at localhost/46505] zookeeper.ZKUtil(164): regionserver:33613-0x1006003200a0001, quorum=127.0.0.1:59593, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-17 02:01:49,976 DEBUG [Listener at localhost/46505] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33613 2023-02-17 02:01:49,976 DEBUG [Listener at localhost/46505] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33613 2023-02-17 02:01:49,976 DEBUG [Listener at localhost/46505] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33613 2023-02-17 02:01:49,977 DEBUG [Listener at localhost/46505] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33613 2023-02-17 02:01:49,977 DEBUG [Listener at localhost/46505] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33613 2023-02-17 02:01:49,990 INFO [Listener at localhost/46505] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-17 02:01:49,991 INFO [Listener at localhost/46505] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 02:01:49,991 INFO [Listener at localhost/46505] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-17 02:01:49,991 INFO [Listener at localhost/46505] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-17 02:01:49,991 INFO [Listener at localhost/46505] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 02:01:49,991 INFO [Listener at localhost/46505] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-17 02:01:49,991 INFO [Listener at localhost/46505] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-17 02:01:49,996 INFO [Listener at localhost/46505] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43275 2023-02-17 02:01:49,996 INFO [Listener at localhost/46505] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-17 02:01:50,000 DEBUG [Listener at localhost/46505] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 02:01:50,000 INFO [Listener at localhost/46505] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 02:01:50,002 INFO [Listener at localhost/46505] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 02:01:50,003 INFO [Listener at localhost/46505] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43275 connecting to ZooKeeper ensemble=127.0.0.1:59593 2023-02-17 02:01:50,005 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): regionserver:432750x0, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-17 02:01:50,005 DEBUG [Listener at localhost/46505] zookeeper.ZKUtil(164): regionserver:432750x0, quorum=127.0.0.1:59593, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 02:01:50,006 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:43275-0x1006003200a0002 connected 2023-02-17 02:01:50,007 DEBUG [Listener at localhost/46505] zookeeper.ZKUtil(164): regionserver:43275-0x1006003200a0002, quorum=127.0.0.1:59593, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 02:01:50,007 DEBUG [Listener at localhost/46505] zookeeper.ZKUtil(164): regionserver:43275-0x1006003200a0002, quorum=127.0.0.1:59593, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-17 02:01:50,007 DEBUG [Listener at localhost/46505] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43275 2023-02-17 02:01:50,008 DEBUG [Listener at localhost/46505] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43275 2023-02-17 02:01:50,013 DEBUG [Listener at localhost/46505] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43275 2023-02-17 02:01:50,013 DEBUG [Listener at localhost/46505] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43275 2023-02-17 02:01:50,014 DEBUG [Listener at localhost/46505] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43275 2023-02-17 02:01:50,016 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,45095,1676599309917 2023-02-17 02:01:50,018 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): master:45095-0x1006003200a0000, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-17 02:01:50,019 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45095-0x1006003200a0000, quorum=127.0.0.1:59593, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,45095,1676599309917 2023-02-17 02:01:50,020 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): regionserver:43275-0x1006003200a0002, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-17 02:01:50,020 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): regionserver:33613-0x1006003200a0001, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-17 02:01:50,020 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): master:45095-0x1006003200a0000, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-17 02:01:50,021 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): master:45095-0x1006003200a0000, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 02:01:50,021 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45095-0x1006003200a0000, quorum=127.0.0.1:59593, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-17 02:01:50,025 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,45095,1676599309917 from backup master directory 2023-02-17 02:01:50,025 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:45095-0x1006003200a0000, quorum=127.0.0.1:59593, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-17 02:01:50,026 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): master:45095-0x1006003200a0000, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,45095,1676599309917 2023-02-17 02:01:50,026 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): master:45095-0x1006003200a0000, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-17 02:01:50,026 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-17 02:01:50,026 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,45095,1676599309917 2023-02-17 02:01:50,038 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/hbase.id with ID: 606333e9-2e3a-418b-be91-fe9156bf8f0c 2023-02-17 02:01:50,046 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 02:01:50,048 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): master:45095-0x1006003200a0000, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 02:01:50,057 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x4c5a55bd to 127.0.0.1:59593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 02:01:50,063 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@40ad185a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 02:01:50,063 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-17 02:01:50,063 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-17 02:01:50,064 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 02:01:50,065 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/MasterData/data/master/store-tmp 2023-02-17 02:01:50,071 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:50,071 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-17 02:01:50,071 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 02:01:50,071 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 02:01:50,071 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-17 02:01:50,071 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 02:01:50,071 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 02:01:50,071 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-17 02:01:50,072 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/MasterData/WALs/jenkins-hbase4.apache.org,45095,1676599309917 2023-02-17 02:01:50,074 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45095%2C1676599309917, suffix=, logDir=hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/MasterData/WALs/jenkins-hbase4.apache.org,45095,1676599309917, archiveDir=hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/MasterData/oldWALs, maxLogs=10 2023-02-17 02:01:50,087 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43973,DS-7ae460a6-2477-444b-9d5d-643fe24205a1,DISK] 2023-02-17 02:01:50,087 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36097,DS-c2cf8a2f-d706-4378-bb01-3e4aec265dd1,DISK] 2023-02-17 02:01:50,088 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/MasterData/WALs/jenkins-hbase4.apache.org,45095,1676599309917/jenkins-hbase4.apache.org%2C45095%2C1676599309917.1676599310074 2023-02-17 02:01:50,089 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43973,DS-7ae460a6-2477-444b-9d5d-643fe24205a1,DISK], DatanodeInfoWithStorage[127.0.0.1:36097,DS-c2cf8a2f-d706-4378-bb01-3e4aec265dd1,DISK]] 2023-02-17 02:01:50,089 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-17 02:01:50,089 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:50,089 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-17 02:01:50,089 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-17 02:01:50,090 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-17 02:01:50,091 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-17 02:01:50,091 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-17 02:01:50,092 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:50,092 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-17 02:01:50,092 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-17 02:01:50,094 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-17 02:01:50,095 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 02:01:50,096 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64617196, jitterRate=-0.037128746509552}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-17 02:01:50,096 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-17 02:01:50,096 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-17 02:01:50,097 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-17 02:01:50,097 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-17 02:01:50,097 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-17 02:01:50,098 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-17 02:01:50,098 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-17 02:01:50,098 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-17 02:01:50,099 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-17 02:01:50,099 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-17 02:01:50,109 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-17 02:01:50,110 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-17 02:01:50,110 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45095-0x1006003200a0000, quorum=127.0.0.1:59593, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-17 02:01:50,110 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-17 02:01:50,110 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45095-0x1006003200a0000, quorum=127.0.0.1:59593, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-17 02:01:50,112 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): master:45095-0x1006003200a0000, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 02:01:50,112 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45095-0x1006003200a0000, quorum=127.0.0.1:59593, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-17 02:01:50,113 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45095-0x1006003200a0000, quorum=127.0.0.1:59593, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-17 02:01:50,113 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45095-0x1006003200a0000, quorum=127.0.0.1:59593, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-17 02:01:50,114 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): master:45095-0x1006003200a0000, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-17 02:01:50,114 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): regionserver:33613-0x1006003200a0001, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-17 02:01:50,114 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): master:45095-0x1006003200a0000, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 02:01:50,114 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): regionserver:43275-0x1006003200a0002, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-17 02:01:50,118 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,45095,1676599309917, sessionid=0x1006003200a0000, setting cluster-up flag (Was=false) 2023-02-17 02:01:50,121 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): master:45095-0x1006003200a0000, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 02:01:50,124 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-17 02:01:50,125 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,45095,1676599309917 2023-02-17 02:01:50,128 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): master:45095-0x1006003200a0000, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 02:01:50,133 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-17 02:01:50,133 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,45095,1676599309917 2023-02-17 02:01:50,134 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/.hbase-snapshot/.tmp 2023-02-17 02:01:50,135 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-17 02:01:50,136 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-17 02:01:50,136 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-17 02:01:50,136 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-17 02:01:50,136 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-17 02:01:50,136 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-17 02:01:50,136 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:50,136 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-17 02:01:50,136 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:50,138 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676599340138 2023-02-17 02:01:50,139 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-17 02:01:50,139 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-17 02:01:50,139 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-17 02:01:50,139 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-17 02:01:50,139 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-17 02:01:50,139 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-17 02:01:50,140 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:50,140 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-17 02:01:50,140 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-17 02:01:50,141 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-17 02:01:50,141 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-17 02:01:50,141 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-17 02:01:50,141 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-17 02:01:50,141 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-17 02:01:50,142 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676599310141,5,FailOnTimeoutGroup] 2023-02-17 02:01:50,142 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676599310142,5,FailOnTimeoutGroup] 2023-02-17 02:01:50,142 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-17 02:01:50,142 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:50,142 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-17 02:01:50,142 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:50,142 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:50,150 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-17 02:01:50,150 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-17 02:01:50,150 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78 2023-02-17 02:01:50,157 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:50,158 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-17 02:01:50,159 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/data/hbase/meta/1588230740/info 2023-02-17 02:01:50,160 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-17 02:01:50,160 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:50,160 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-17 02:01:50,161 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/data/hbase/meta/1588230740/rep_barrier 2023-02-17 02:01:50,162 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-17 02:01:50,162 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:50,162 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-17 02:01:50,163 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/data/hbase/meta/1588230740/table 2023-02-17 02:01:50,164 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-17 02:01:50,164 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:50,165 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/data/hbase/meta/1588230740 2023-02-17 02:01:50,165 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/data/hbase/meta/1588230740 2023-02-17 02:01:50,167 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-17 02:01:50,169 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-17 02:01:50,170 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 02:01:50,171 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71461911, jitterRate=0.06486545503139496}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-17 02:01:50,171 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-17 02:01:50,171 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-17 02:01:50,171 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-17 02:01:50,171 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-17 02:01:50,171 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-17 02:01:50,171 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-17 02:01:50,171 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-17 02:01:50,171 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-17 02:01:50,172 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-17 02:01:50,172 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-17 02:01:50,172 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-17 02:01:50,174 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-17 02:01:50,175 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-17 02:01:50,216 INFO [RS:0;jenkins-hbase4:33613] regionserver.HRegionServer(952): ClusterId : 606333e9-2e3a-418b-be91-fe9156bf8f0c 2023-02-17 02:01:50,216 INFO [RS:1;jenkins-hbase4:43275] regionserver.HRegionServer(952): ClusterId : 606333e9-2e3a-418b-be91-fe9156bf8f0c 2023-02-17 02:01:50,217 DEBUG [RS:0;jenkins-hbase4:33613] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-17 02:01:50,217 DEBUG [RS:1;jenkins-hbase4:43275] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-17 02:01:50,218 DEBUG [RS:0;jenkins-hbase4:33613] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-17 02:01:50,219 DEBUG [RS:0;jenkins-hbase4:33613] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-17 02:01:50,219 DEBUG [RS:1;jenkins-hbase4:43275] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-17 02:01:50,219 DEBUG [RS:1;jenkins-hbase4:43275] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-17 02:01:50,221 DEBUG [RS:0;jenkins-hbase4:33613] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-17 02:01:50,222 DEBUG [RS:0;jenkins-hbase4:33613] zookeeper.ReadOnlyZKClient(139): Connect 0x198d0d12 to 127.0.0.1:59593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 02:01:50,222 DEBUG [RS:1;jenkins-hbase4:43275] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-17 02:01:50,223 DEBUG [RS:1;jenkins-hbase4:43275] zookeeper.ReadOnlyZKClient(139): Connect 0x101e6d7a to 127.0.0.1:59593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 02:01:50,228 DEBUG [RS:0;jenkins-hbase4:33613] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@174af053, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 02:01:50,228 DEBUG [RS:0;jenkins-hbase4:33613] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@13756662, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-17 02:01:50,228 DEBUG [RS:1;jenkins-hbase4:43275] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1ed99109, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 02:01:50,228 DEBUG [RS:1;jenkins-hbase4:43275] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1ae6060a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-17 02:01:50,242 DEBUG [RS:0;jenkins-hbase4:33613] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:33613 2023-02-17 02:01:50,242 DEBUG [RS:1;jenkins-hbase4:43275] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:43275 2023-02-17 02:01:50,243 INFO [RS:0;jenkins-hbase4:33613] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-17 02:01:50,243 INFO [RS:0;jenkins-hbase4:33613] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-17 02:01:50,243 INFO [RS:1;jenkins-hbase4:43275] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-17 02:01:50,243 INFO [RS:1;jenkins-hbase4:43275] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-17 02:01:50,243 DEBUG [RS:0;jenkins-hbase4:33613] regionserver.HRegionServer(1023): About to register with Master. 2023-02-17 02:01:50,243 DEBUG [RS:1;jenkins-hbase4:43275] regionserver.HRegionServer(1023): About to register with Master. 2023-02-17 02:01:50,243 INFO [RS:1;jenkins-hbase4:43275] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,45095,1676599309917 with isa=jenkins-hbase4.apache.org/172.31.14.131:43275, startcode=1676599309990 2023-02-17 02:01:50,243 INFO [RS:0;jenkins-hbase4:33613] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,45095,1676599309917 with isa=jenkins-hbase4.apache.org/172.31.14.131:33613, startcode=1676599309963 2023-02-17 02:01:50,245 DEBUG [RS:1;jenkins-hbase4:43275] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-17 02:01:50,245 DEBUG [RS:0;jenkins-hbase4:33613] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-17 02:01:50,247 INFO [RS-EventLoopGroup-18-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60739, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.11 (auth:SIMPLE), service=RegionServerStatusService 2023-02-17 02:01:50,247 INFO [RS-EventLoopGroup-18-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50071, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.10 (auth:SIMPLE), service=RegionServerStatusService 2023-02-17 02:01:50,248 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45095] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,43275,1676599309990 2023-02-17 02:01:50,249 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45095] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,33613,1676599309963 2023-02-17 02:01:50,249 DEBUG [RS:1;jenkins-hbase4:43275] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78 2023-02-17 02:01:50,249 DEBUG [RS:1;jenkins-hbase4:43275] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:38701 2023-02-17 02:01:50,250 DEBUG [RS:0;jenkins-hbase4:33613] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78 2023-02-17 02:01:50,250 DEBUG [RS:1;jenkins-hbase4:43275] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-17 02:01:50,250 DEBUG [RS:0;jenkins-hbase4:33613] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:38701 2023-02-17 02:01:50,250 DEBUG [RS:0;jenkins-hbase4:33613] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-17 02:01:50,254 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): master:45095-0x1006003200a0000, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 02:01:50,254 DEBUG [RS:1;jenkins-hbase4:43275] zookeeper.ZKUtil(162): regionserver:43275-0x1006003200a0002, quorum=127.0.0.1:59593, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43275,1676599309990 2023-02-17 02:01:50,254 DEBUG [RS:0;jenkins-hbase4:33613] zookeeper.ZKUtil(162): regionserver:33613-0x1006003200a0001, quorum=127.0.0.1:59593, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33613,1676599309963 2023-02-17 02:01:50,255 WARN [RS:1;jenkins-hbase4:43275] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-17 02:01:50,255 WARN [RS:0;jenkins-hbase4:33613] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-17 02:01:50,255 INFO [RS:1;jenkins-hbase4:43275] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 02:01:50,255 INFO [RS:0;jenkins-hbase4:33613] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 02:01:50,255 DEBUG [RS:1;jenkins-hbase4:43275] regionserver.HRegionServer(1947): logDir=hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/WALs/jenkins-hbase4.apache.org,43275,1676599309990 2023-02-17 02:01:50,255 DEBUG [RS:0;jenkins-hbase4:33613] regionserver.HRegionServer(1947): logDir=hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/WALs/jenkins-hbase4.apache.org,33613,1676599309963 2023-02-17 02:01:50,255 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,33613,1676599309963] 2023-02-17 02:01:50,255 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,43275,1676599309990] 2023-02-17 02:01:50,259 DEBUG [RS:0;jenkins-hbase4:33613] zookeeper.ZKUtil(162): regionserver:33613-0x1006003200a0001, quorum=127.0.0.1:59593, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43275,1676599309990 2023-02-17 02:01:50,259 DEBUG [RS:1;jenkins-hbase4:43275] zookeeper.ZKUtil(162): regionserver:43275-0x1006003200a0002, quorum=127.0.0.1:59593, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43275,1676599309990 2023-02-17 02:01:50,259 DEBUG [RS:0;jenkins-hbase4:33613] zookeeper.ZKUtil(162): regionserver:33613-0x1006003200a0001, quorum=127.0.0.1:59593, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33613,1676599309963 2023-02-17 02:01:50,260 DEBUG [RS:1;jenkins-hbase4:43275] zookeeper.ZKUtil(162): regionserver:43275-0x1006003200a0002, quorum=127.0.0.1:59593, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33613,1676599309963 2023-02-17 02:01:50,260 DEBUG [RS:0;jenkins-hbase4:33613] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-17 02:01:50,260 INFO [RS:0;jenkins-hbase4:33613] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-17 02:01:50,260 DEBUG [RS:1;jenkins-hbase4:43275] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-17 02:01:50,261 INFO [RS:1;jenkins-hbase4:43275] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-17 02:01:50,261 INFO [RS:0;jenkins-hbase4:33613] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-17 02:01:50,262 INFO [RS:0;jenkins-hbase4:33613] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-17 02:01:50,262 INFO [RS:0;jenkins-hbase4:33613] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:50,262 INFO [RS:0;jenkins-hbase4:33613] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-17 02:01:50,263 INFO [RS:0;jenkins-hbase4:33613] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:50,263 INFO [RS:1;jenkins-hbase4:43275] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-17 02:01:50,263 DEBUG [RS:0;jenkins-hbase4:33613] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:50,263 DEBUG [RS:0;jenkins-hbase4:33613] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:50,264 DEBUG [RS:0;jenkins-hbase4:33613] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:50,264 INFO [RS:1;jenkins-hbase4:43275] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-17 02:01:50,264 DEBUG [RS:0;jenkins-hbase4:33613] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:50,264 INFO [RS:1;jenkins-hbase4:43275] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:50,264 DEBUG [RS:0;jenkins-hbase4:33613] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:50,264 DEBUG [RS:0;jenkins-hbase4:33613] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-17 02:01:50,264 DEBUG [RS:0;jenkins-hbase4:33613] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:50,264 DEBUG [RS:0;jenkins-hbase4:33613] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:50,264 DEBUG [RS:0;jenkins-hbase4:33613] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:50,264 DEBUG [RS:0;jenkins-hbase4:33613] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:50,267 INFO [RS:1;jenkins-hbase4:43275] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-17 02:01:50,269 INFO [RS:0;jenkins-hbase4:33613] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:50,269 INFO [RS:0;jenkins-hbase4:33613] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:50,269 INFO [RS:0;jenkins-hbase4:33613] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:50,270 INFO [RS:1;jenkins-hbase4:43275] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:50,270 DEBUG [RS:1;jenkins-hbase4:43275] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:50,270 DEBUG [RS:1;jenkins-hbase4:43275] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:50,270 DEBUG [RS:1;jenkins-hbase4:43275] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:50,270 DEBUG [RS:1;jenkins-hbase4:43275] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:50,270 DEBUG [RS:1;jenkins-hbase4:43275] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:50,270 DEBUG [RS:1;jenkins-hbase4:43275] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-17 02:01:50,270 DEBUG [RS:1;jenkins-hbase4:43275] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:50,270 DEBUG [RS:1;jenkins-hbase4:43275] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:50,270 DEBUG [RS:1;jenkins-hbase4:43275] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:50,270 DEBUG [RS:1;jenkins-hbase4:43275] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:50,272 INFO [RS:1;jenkins-hbase4:43275] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:50,272 INFO [RS:1;jenkins-hbase4:43275] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:50,272 INFO [RS:1;jenkins-hbase4:43275] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:50,281 INFO [RS:0;jenkins-hbase4:33613] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-17 02:01:50,281 INFO [RS:0;jenkins-hbase4:33613] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33613,1676599309963-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:50,283 INFO [RS:1;jenkins-hbase4:43275] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-17 02:01:50,283 INFO [RS:1;jenkins-hbase4:43275] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43275,1676599309990-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:50,293 INFO [RS:0;jenkins-hbase4:33613] regionserver.Replication(203): jenkins-hbase4.apache.org,33613,1676599309963 started 2023-02-17 02:01:50,293 INFO [RS:0;jenkins-hbase4:33613] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,33613,1676599309963, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:33613, sessionid=0x1006003200a0001 2023-02-17 02:01:50,293 INFO [RS:1;jenkins-hbase4:43275] regionserver.Replication(203): jenkins-hbase4.apache.org,43275,1676599309990 started 2023-02-17 02:01:50,293 DEBUG [RS:0;jenkins-hbase4:33613] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-17 02:01:50,293 INFO [RS:1;jenkins-hbase4:43275] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,43275,1676599309990, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:43275, sessionid=0x1006003200a0002 2023-02-17 02:01:50,293 DEBUG [RS:0;jenkins-hbase4:33613] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,33613,1676599309963 2023-02-17 02:01:50,293 DEBUG [RS:0;jenkins-hbase4:33613] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33613,1676599309963' 2023-02-17 02:01:50,293 DEBUG [RS:0;jenkins-hbase4:33613] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 02:01:50,293 DEBUG [RS:1;jenkins-hbase4:43275] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-17 02:01:50,293 DEBUG [RS:1;jenkins-hbase4:43275] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,43275,1676599309990 2023-02-17 02:01:50,293 DEBUG [RS:1;jenkins-hbase4:43275] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43275,1676599309990' 2023-02-17 02:01:50,293 DEBUG [RS:1;jenkins-hbase4:43275] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 02:01:50,293 DEBUG [RS:0;jenkins-hbase4:33613] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 02:01:50,293 DEBUG [RS:1;jenkins-hbase4:43275] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 02:01:50,294 DEBUG [RS:0;jenkins-hbase4:33613] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-17 02:01:50,294 DEBUG [RS:0;jenkins-hbase4:33613] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-17 02:01:50,294 DEBUG [RS:1;jenkins-hbase4:43275] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-17 02:01:50,294 DEBUG [RS:1;jenkins-hbase4:43275] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-17 02:01:50,294 DEBUG [RS:1;jenkins-hbase4:43275] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,43275,1676599309990 2023-02-17 02:01:50,294 DEBUG [RS:1;jenkins-hbase4:43275] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43275,1676599309990' 2023-02-17 02:01:50,294 DEBUG [RS:1;jenkins-hbase4:43275] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 02:01:50,294 DEBUG [RS:0;jenkins-hbase4:33613] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,33613,1676599309963 2023-02-17 02:01:50,294 DEBUG [RS:0;jenkins-hbase4:33613] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33613,1676599309963' 2023-02-17 02:01:50,294 DEBUG [RS:0;jenkins-hbase4:33613] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 02:01:50,294 DEBUG [RS:1;jenkins-hbase4:43275] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 02:01:50,294 DEBUG [RS:0;jenkins-hbase4:33613] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 02:01:50,294 DEBUG [RS:1;jenkins-hbase4:43275] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-17 02:01:50,294 DEBUG [RS:0;jenkins-hbase4:33613] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-17 02:01:50,295 INFO [RS:1;jenkins-hbase4:43275] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-17 02:01:50,295 INFO [RS:1;jenkins-hbase4:43275] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-17 02:01:50,295 INFO [RS:0;jenkins-hbase4:33613] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-17 02:01:50,295 INFO [RS:0;jenkins-hbase4:33613] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-17 02:01:50,326 DEBUG [jenkins-hbase4:45095] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-17 02:01:50,326 DEBUG [jenkins-hbase4:45095] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-17 02:01:50,327 DEBUG [jenkins-hbase4:45095] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-17 02:01:50,327 DEBUG [jenkins-hbase4:45095] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-17 02:01:50,327 DEBUG [jenkins-hbase4:45095] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-17 02:01:50,328 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,33613,1676599309963, state=OPENING 2023-02-17 02:01:50,330 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-17 02:01:50,331 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): master:45095-0x1006003200a0000, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 02:01:50,332 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-17 02:01:50,332 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,33613,1676599309963}] 2023-02-17 02:01:50,486 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,33613,1676599309963 2023-02-17 02:01:50,487 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-17 02:01:50,488 INFO [RS-EventLoopGroup-19-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38608, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-17 02:01:50,492 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-17 02:01:50,492 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 02:01:50,493 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33613%2C1676599309963.meta, suffix=.meta, logDir=hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/WALs/jenkins-hbase4.apache.org,33613,1676599309963, archiveDir=hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/oldWALs, maxLogs=32 2023-02-17 02:01:50,507 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43973,DS-7ae460a6-2477-444b-9d5d-643fe24205a1,DISK] 2023-02-17 02:01:50,507 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36097,DS-c2cf8a2f-d706-4378-bb01-3e4aec265dd1,DISK] 2023-02-17 02:01:50,509 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/WALs/jenkins-hbase4.apache.org,33613,1676599309963/jenkins-hbase4.apache.org%2C33613%2C1676599309963.meta.1676599310493.meta 2023-02-17 02:01:50,509 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36097,DS-c2cf8a2f-d706-4378-bb01-3e4aec265dd1,DISK], DatanodeInfoWithStorage[127.0.0.1:43973,DS-7ae460a6-2477-444b-9d5d-643fe24205a1,DISK]] 2023-02-17 02:01:50,509 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-17 02:01:50,509 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-17 02:01:50,509 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-17 02:01:50,510 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-17 02:01:50,510 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-17 02:01:50,510 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:50,510 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-17 02:01:50,510 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-17 02:01:50,512 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-17 02:01:50,513 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/data/hbase/meta/1588230740/info 2023-02-17 02:01:50,513 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/data/hbase/meta/1588230740/info 2023-02-17 02:01:50,513 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-17 02:01:50,514 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:50,514 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-17 02:01:50,514 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/data/hbase/meta/1588230740/rep_barrier 2023-02-17 02:01:50,514 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/data/hbase/meta/1588230740/rep_barrier 2023-02-17 02:01:50,515 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-17 02:01:50,515 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:50,515 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-17 02:01:50,516 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/data/hbase/meta/1588230740/table 2023-02-17 02:01:50,516 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/data/hbase/meta/1588230740/table 2023-02-17 02:01:50,516 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-17 02:01:50,516 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:50,517 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/data/hbase/meta/1588230740 2023-02-17 02:01:50,517 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/data/hbase/meta/1588230740 2023-02-17 02:01:50,519 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-17 02:01:50,520 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-17 02:01:50,520 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68760078, jitterRate=0.024605005979537964}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-17 02:01:50,520 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-17 02:01:50,521 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676599310486 2023-02-17 02:01:50,527 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-17 02:01:50,528 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-17 02:01:50,528 INFO [PEWorker-2] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,33613,1676599309963, state=OPEN 2023-02-17 02:01:50,529 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): master:45095-0x1006003200a0000, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-17 02:01:50,529 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-17 02:01:50,531 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-17 02:01:50,531 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,33613,1676599309963 in 197 msec 2023-02-17 02:01:50,532 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-17 02:01:50,532 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 359 msec 2023-02-17 02:01:50,533 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 397 msec 2023-02-17 02:01:50,533 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676599310533, completionTime=-1 2023-02-17 02:01:50,533 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-17 02:01:50,533 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-17 02:01:50,534 DEBUG [hconnection-0x2aff6fe5-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 02:01:50,536 INFO [RS-EventLoopGroup-19-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38612, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 02:01:50,538 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-17 02:01:50,538 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676599370538 2023-02-17 02:01:50,538 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676599430538 2023-02-17 02:01:50,538 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 4 msec 2023-02-17 02:01:50,549 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45095,1676599309917-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:50,549 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45095,1676599309917-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:50,549 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45095,1676599309917-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:50,549 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:45095, period=300000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:50,549 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:50,549 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-17 02:01:50,550 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-17 02:01:50,550 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-17 02:01:50,551 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-17 02:01:50,551 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-17 02:01:50,552 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-17 02:01:50,553 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/.tmp/data/hbase/namespace/6f3b866d01a86f8137a760957d97815a 2023-02-17 02:01:50,554 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/.tmp/data/hbase/namespace/6f3b866d01a86f8137a760957d97815a empty. 2023-02-17 02:01:50,554 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/.tmp/data/hbase/namespace/6f3b866d01a86f8137a760957d97815a 2023-02-17 02:01:50,554 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-17 02:01:50,563 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-17 02:01:50,564 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 6f3b866d01a86f8137a760957d97815a, NAME => 'hbase:namespace,,1676599310549.6f3b866d01a86f8137a760957d97815a.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/.tmp 2023-02-17 02:01:50,570 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676599310549.6f3b866d01a86f8137a760957d97815a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:50,570 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 6f3b866d01a86f8137a760957d97815a, disabling compactions & flushes 2023-02-17 02:01:50,570 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676599310549.6f3b866d01a86f8137a760957d97815a. 2023-02-17 02:01:50,570 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676599310549.6f3b866d01a86f8137a760957d97815a. 2023-02-17 02:01:50,570 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676599310549.6f3b866d01a86f8137a760957d97815a. after waiting 0 ms 2023-02-17 02:01:50,570 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676599310549.6f3b866d01a86f8137a760957d97815a. 2023-02-17 02:01:50,570 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676599310549.6f3b866d01a86f8137a760957d97815a. 2023-02-17 02:01:50,570 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 6f3b866d01a86f8137a760957d97815a: 2023-02-17 02:01:50,572 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-17 02:01:50,573 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676599310549.6f3b866d01a86f8137a760957d97815a.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676599310573"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676599310573"}]},"ts":"1676599310573"} 2023-02-17 02:01:50,574 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-17 02:01:50,575 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-17 02:01:50,575 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676599310575"}]},"ts":"1676599310575"} 2023-02-17 02:01:50,576 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-17 02:01:50,579 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-17 02:01:50,579 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-17 02:01:50,579 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-17 02:01:50,579 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-17 02:01:50,579 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=6f3b866d01a86f8137a760957d97815a, ASSIGN}] 2023-02-17 02:01:50,582 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=6f3b866d01a86f8137a760957d97815a, ASSIGN 2023-02-17 02:01:50,582 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=6f3b866d01a86f8137a760957d97815a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43275,1676599309990; forceNewPlan=false, retain=false 2023-02-17 02:01:50,733 INFO [jenkins-hbase4:45095] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-17 02:01:50,733 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=6f3b866d01a86f8137a760957d97815a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43275,1676599309990 2023-02-17 02:01:50,733 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676599310549.6f3b866d01a86f8137a760957d97815a.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676599310733"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676599310733"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676599310733"}]},"ts":"1676599310733"} 2023-02-17 02:01:50,736 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 6f3b866d01a86f8137a760957d97815a, server=jenkins-hbase4.apache.org,43275,1676599309990}] 2023-02-17 02:01:50,889 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,43275,1676599309990 2023-02-17 02:01:50,889 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-17 02:01:50,890 INFO [RS-EventLoopGroup-20-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46072, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-17 02:01:50,894 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676599310549.6f3b866d01a86f8137a760957d97815a. 2023-02-17 02:01:50,896 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43275%2C1676599309990, suffix=, logDir=hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/WALs/jenkins-hbase4.apache.org,43275,1676599309990, archiveDir=hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/oldWALs, maxLogs=32 2023-02-17 02:01:50,913 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36097,DS-c2cf8a2f-d706-4378-bb01-3e4aec265dd1,DISK] 2023-02-17 02:01:50,913 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43973,DS-7ae460a6-2477-444b-9d5d-643fe24205a1,DISK] 2023-02-17 02:01:50,915 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/WALs/jenkins-hbase4.apache.org,43275,1676599309990/jenkins-hbase4.apache.org%2C43275%2C1676599309990.1676599310896 2023-02-17 02:01:50,916 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36097,DS-c2cf8a2f-d706-4378-bb01-3e4aec265dd1,DISK], DatanodeInfoWithStorage[127.0.0.1:43973,DS-7ae460a6-2477-444b-9d5d-643fe24205a1,DISK]] 2023-02-17 02:01:50,916 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 6f3b866d01a86f8137a760957d97815a, NAME => 'hbase:namespace,,1676599310549.6f3b866d01a86f8137a760957d97815a.', STARTKEY => '', ENDKEY => ''} 2023-02-17 02:01:50,916 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 6f3b866d01a86f8137a760957d97815a 2023-02-17 02:01:50,916 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676599310549.6f3b866d01a86f8137a760957d97815a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:50,916 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 6f3b866d01a86f8137a760957d97815a 2023-02-17 02:01:50,916 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 6f3b866d01a86f8137a760957d97815a 2023-02-17 02:01:50,918 INFO [StoreOpener-6f3b866d01a86f8137a760957d97815a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 6f3b866d01a86f8137a760957d97815a 2023-02-17 02:01:50,929 DEBUG [StoreOpener-6f3b866d01a86f8137a760957d97815a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/data/hbase/namespace/6f3b866d01a86f8137a760957d97815a/info 2023-02-17 02:01:50,929 DEBUG [StoreOpener-6f3b866d01a86f8137a760957d97815a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/data/hbase/namespace/6f3b866d01a86f8137a760957d97815a/info 2023-02-17 02:01:50,929 INFO [StoreOpener-6f3b866d01a86f8137a760957d97815a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6f3b866d01a86f8137a760957d97815a columnFamilyName info 2023-02-17 02:01:50,930 INFO [StoreOpener-6f3b866d01a86f8137a760957d97815a-1] regionserver.HStore(310): Store=6f3b866d01a86f8137a760957d97815a/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:50,931 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/data/hbase/namespace/6f3b866d01a86f8137a760957d97815a 2023-02-17 02:01:50,931 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/data/hbase/namespace/6f3b866d01a86f8137a760957d97815a 2023-02-17 02:01:50,934 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 6f3b866d01a86f8137a760957d97815a 2023-02-17 02:01:50,936 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/data/hbase/namespace/6f3b866d01a86f8137a760957d97815a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 02:01:50,936 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 6f3b866d01a86f8137a760957d97815a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71185721, jitterRate=0.060749903321266174}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-17 02:01:50,936 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 6f3b866d01a86f8137a760957d97815a: 2023-02-17 02:01:50,937 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676599310549.6f3b866d01a86f8137a760957d97815a., pid=6, masterSystemTime=1676599310889 2023-02-17 02:01:50,940 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676599310549.6f3b866d01a86f8137a760957d97815a. 2023-02-17 02:01:50,941 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676599310549.6f3b866d01a86f8137a760957d97815a. 2023-02-17 02:01:50,941 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=6f3b866d01a86f8137a760957d97815a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43275,1676599309990 2023-02-17 02:01:50,941 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676599310549.6f3b866d01a86f8137a760957d97815a.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676599310941"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676599310941"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676599310941"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676599310941"}]},"ts":"1676599310941"} 2023-02-17 02:01:50,944 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-17 02:01:50,944 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 6f3b866d01a86f8137a760957d97815a, server=jenkins-hbase4.apache.org,43275,1676599309990 in 207 msec 2023-02-17 02:01:50,946 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-17 02:01:50,946 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=6f3b866d01a86f8137a760957d97815a, ASSIGN in 365 msec 2023-02-17 02:01:50,946 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-17 02:01:50,947 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676599310946"}]},"ts":"1676599310946"} 2023-02-17 02:01:50,948 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-17 02:01:50,951 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-17 02:01:50,951 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45095-0x1006003200a0000, quorum=127.0.0.1:59593, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-17 02:01:50,952 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 401 msec 2023-02-17 02:01:50,953 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): master:45095-0x1006003200a0000, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-17 02:01:50,953 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): master:45095-0x1006003200a0000, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 02:01:50,956 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 02:01:50,957 INFO [RS-EventLoopGroup-20-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46086, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 02:01:50,958 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-17 02:01:50,965 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): master:45095-0x1006003200a0000, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-17 02:01:50,967 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 9 msec 2023-02-17 02:01:50,970 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-17 02:01:50,975 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): master:45095-0x1006003200a0000, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-17 02:01:50,979 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 9 msec 2023-02-17 02:01:50,983 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): master:45095-0x1006003200a0000, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-17 02:01:50,986 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): master:45095-0x1006003200a0000, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-17 02:01:50,986 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 0.960sec 2023-02-17 02:01:50,986 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-17 02:01:50,986 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-17 02:01:50,986 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-17 02:01:50,987 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45095,1676599309917-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-17 02:01:50,987 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45095,1676599309917-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-17 02:01:50,988 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-17 02:01:51,017 DEBUG [Listener at localhost/46505] zookeeper.ReadOnlyZKClient(139): Connect 0x29ff03bb to 127.0.0.1:59593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 02:01:51,020 DEBUG [Listener at localhost/46505] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@24e8e8d5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 02:01:51,021 DEBUG [hconnection-0x590e7796-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 02:01:51,023 INFO [RS-EventLoopGroup-19-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38626, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 02:01:51,024 INFO [Listener at localhost/46505] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,45095,1676599309917 2023-02-17 02:01:51,024 DEBUG [Listener at localhost/46505] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-17 02:01:51,026 DEBUG [Listener at localhost/46505] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-17 02:01:51,028 INFO [RS-EventLoopGroup-18-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55250, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-17 02:01:51,028 INFO [Listener at localhost/46505] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 02:01:51,029 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45095] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 02:01:51,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45095] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-17 02:01:51,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45095] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 105 connection: 172.31.14.131:55250 deadline: 1676599371029, exception=org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 02:01:51,029 INFO [Listener at localhost/46505] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-17 02:01:51,031 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45095] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-17 02:01:51,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45095] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 02:01:51,033 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_PRE_OPERATION 2023-02-17 02:01:51,033 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45095] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testRestoreSnapshotDoesNotCreateBackRefLinks" procId is: 10 2023-02-17 02:01:51,034 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-17 02:01:51,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45095] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 02:01:51,035 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/08bb292b0415df015f5df00a429d21d5 2023-02-17 02:01:51,036 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/08bb292b0415df015f5df00a429d21d5 empty. 2023-02-17 02:01:51,036 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/08bb292b0415df015f5df00a429d21d5 2023-02-17 02:01:51,036 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-17 02:01:51,043 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/.tabledesc/.tableinfo.0000000001 2023-02-17 02:01:51,044 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(7671): creating {ENCODED => 08bb292b0415df015f5df00a429d21d5, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676599311031.08bb292b0415df015f5df00a429d21d5.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/.tmp 2023-02-17 02:01:51,046 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-17 02:01:51,054 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676599311031.08bb292b0415df015f5df00a429d21d5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:51,054 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1603): Closing 08bb292b0415df015f5df00a429d21d5, disabling compactions & flushes 2023-02-17 02:01:51,054 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676599311031.08bb292b0415df015f5df00a429d21d5. 2023-02-17 02:01:51,055 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676599311031.08bb292b0415df015f5df00a429d21d5. 2023-02-17 02:01:51,055 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676599311031.08bb292b0415df015f5df00a429d21d5. after waiting 0 ms 2023-02-17 02:01:51,055 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676599311031.08bb292b0415df015f5df00a429d21d5. 2023-02-17 02:01:51,055 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676599311031.08bb292b0415df015f5df00a429d21d5. 2023-02-17 02:01:51,055 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1557): Region close journal for 08bb292b0415df015f5df00a429d21d5: 2023-02-17 02:01:51,057 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ADD_TO_META 2023-02-17 02:01:51,058 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676599311031.08bb292b0415df015f5df00a429d21d5.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676599311058"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676599311058"}]},"ts":"1676599311058"} 2023-02-17 02:01:51,060 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-17 02:01:51,061 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-17 02:01:51,061 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676599311061"}]},"ts":"1676599311061"} 2023-02-17 02:01:51,063 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLING in hbase:meta 2023-02-17 02:01:51,068 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-17 02:01:51,069 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-17 02:01:51,069 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-17 02:01:51,069 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-17 02:01:51,069 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=08bb292b0415df015f5df00a429d21d5, ASSIGN}] 2023-02-17 02:01:51,071 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=08bb292b0415df015f5df00a429d21d5, ASSIGN 2023-02-17 02:01:51,072 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=08bb292b0415df015f5df00a429d21d5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43275,1676599309990; forceNewPlan=false, retain=false 2023-02-17 02:01:51,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45095] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 02:01:51,222 INFO [jenkins-hbase4:45095] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-17 02:01:51,222 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=08bb292b0415df015f5df00a429d21d5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43275,1676599309990 2023-02-17 02:01:51,223 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676599311031.08bb292b0415df015f5df00a429d21d5.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676599311222"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676599311222"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676599311222"}]},"ts":"1676599311222"} 2023-02-17 02:01:51,225 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 08bb292b0415df015f5df00a429d21d5, server=jenkins-hbase4.apache.org,43275,1676599309990}] 2023-02-17 02:01:51,298 INFO [RS:0;jenkins-hbase4:33613] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33613%2C1676599309963, suffix=, logDir=hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/WALs/jenkins-hbase4.apache.org,33613,1676599309963, archiveDir=hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/oldWALs, maxLogs=32 2023-02-17 02:01:51,313 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36097,DS-c2cf8a2f-d706-4378-bb01-3e4aec265dd1,DISK] 2023-02-17 02:01:51,313 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43973,DS-7ae460a6-2477-444b-9d5d-643fe24205a1,DISK] 2023-02-17 02:01:51,316 INFO [RS:0;jenkins-hbase4:33613] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/WALs/jenkins-hbase4.apache.org,33613,1676599309963/jenkins-hbase4.apache.org%2C33613%2C1676599309963.1676599311299 2023-02-17 02:01:51,317 DEBUG [RS:0;jenkins-hbase4:33613] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43973,DS-7ae460a6-2477-444b-9d5d-643fe24205a1,DISK], DatanodeInfoWithStorage[127.0.0.1:36097,DS-c2cf8a2f-d706-4378-bb01-3e4aec265dd1,DISK]] 2023-02-17 02:01:51,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45095] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 02:01:51,380 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testRestoreSnapshotDoesNotCreateBackRefLinks,,1676599311031.08bb292b0415df015f5df00a429d21d5. 2023-02-17 02:01:51,380 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 08bb292b0415df015f5df00a429d21d5, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676599311031.08bb292b0415df015f5df00a429d21d5.', STARTKEY => '', ENDKEY => ''} 2023-02-17 02:01:51,380 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRestoreSnapshotDoesNotCreateBackRefLinks 08bb292b0415df015f5df00a429d21d5 2023-02-17 02:01:51,380 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676599311031.08bb292b0415df015f5df00a429d21d5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:51,381 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 08bb292b0415df015f5df00a429d21d5 2023-02-17 02:01:51,381 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 08bb292b0415df015f5df00a429d21d5 2023-02-17 02:01:51,382 INFO [StoreOpener-08bb292b0415df015f5df00a429d21d5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 08bb292b0415df015f5df00a429d21d5 2023-02-17 02:01:51,383 DEBUG [StoreOpener-08bb292b0415df015f5df00a429d21d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/08bb292b0415df015f5df00a429d21d5/f1 2023-02-17 02:01:51,383 DEBUG [StoreOpener-08bb292b0415df015f5df00a429d21d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/08bb292b0415df015f5df00a429d21d5/f1 2023-02-17 02:01:51,383 INFO [StoreOpener-08bb292b0415df015f5df00a429d21d5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 08bb292b0415df015f5df00a429d21d5 columnFamilyName f1 2023-02-17 02:01:51,384 INFO [StoreOpener-08bb292b0415df015f5df00a429d21d5-1] regionserver.HStore(310): Store=08bb292b0415df015f5df00a429d21d5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:51,384 INFO [StoreOpener-08bb292b0415df015f5df00a429d21d5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 08bb292b0415df015f5df00a429d21d5 2023-02-17 02:01:51,385 DEBUG [StoreOpener-08bb292b0415df015f5df00a429d21d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/08bb292b0415df015f5df00a429d21d5/f2 2023-02-17 02:01:51,385 DEBUG [StoreOpener-08bb292b0415df015f5df00a429d21d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/08bb292b0415df015f5df00a429d21d5/f2 2023-02-17 02:01:51,385 INFO [StoreOpener-08bb292b0415df015f5df00a429d21d5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 08bb292b0415df015f5df00a429d21d5 columnFamilyName f2 2023-02-17 02:01:51,386 INFO [StoreOpener-08bb292b0415df015f5df00a429d21d5-1] regionserver.HStore(310): Store=08bb292b0415df015f5df00a429d21d5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:51,386 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/08bb292b0415df015f5df00a429d21d5 2023-02-17 02:01:51,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/08bb292b0415df015f5df00a429d21d5 2023-02-17 02:01:51,388 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRestoreSnapshotDoesNotCreateBackRefLinks descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 02:01:51,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 08bb292b0415df015f5df00a429d21d5 2023-02-17 02:01:51,391 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/08bb292b0415df015f5df00a429d21d5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 02:01:51,392 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 08bb292b0415df015f5df00a429d21d5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58775348, jitterRate=-0.12417906522750854}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 02:01:51,392 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 08bb292b0415df015f5df00a429d21d5: 2023-02-17 02:01:51,392 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testRestoreSnapshotDoesNotCreateBackRefLinks,,1676599311031.08bb292b0415df015f5df00a429d21d5., pid=12, masterSystemTime=1676599311377 2023-02-17 02:01:51,394 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testRestoreSnapshotDoesNotCreateBackRefLinks,,1676599311031.08bb292b0415df015f5df00a429d21d5. 2023-02-17 02:01:51,394 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testRestoreSnapshotDoesNotCreateBackRefLinks,,1676599311031.08bb292b0415df015f5df00a429d21d5. 2023-02-17 02:01:51,394 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=08bb292b0415df015f5df00a429d21d5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43275,1676599309990 2023-02-17 02:01:51,395 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676599311031.08bb292b0415df015f5df00a429d21d5.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676599311394"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676599311394"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676599311394"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676599311394"}]},"ts":"1676599311394"} 2023-02-17 02:01:51,397 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-17 02:01:51,397 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 08bb292b0415df015f5df00a429d21d5, server=jenkins-hbase4.apache.org,43275,1676599309990 in 171 msec 2023-02-17 02:01:51,399 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-17 02:01:51,399 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=08bb292b0415df015f5df00a429d21d5, ASSIGN in 328 msec 2023-02-17 02:01:51,401 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-17 02:01:51,401 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676599311401"}]},"ts":"1676599311401"} 2023-02-17 02:01:51,404 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLED in hbase:meta 2023-02-17 02:01:51,407 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_POST_OPERATION 2023-02-17 02:01:51,409 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 377 msec 2023-02-17 02:01:51,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45095] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 02:01:51,639 INFO [Listener at localhost/46505] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 10 completed 2023-02-17 02:01:51,639 DEBUG [Listener at localhost/46505] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testRestoreSnapshotDoesNotCreateBackRefLinks get assigned. Timeout = 60000ms 2023-02-17 02:01:51,639 INFO [Listener at localhost/46505] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-17 02:01:51,641 INFO [Listener at localhost/46505] hbase.HBaseTestingUtility(3484): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned to meta. Checking AM states. 2023-02-17 02:01:51,641 INFO [Listener at localhost/46505] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-17 02:01:51,641 INFO [Listener at localhost/46505] hbase.HBaseTestingUtility(3504): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned. 2023-02-17 02:01:51,642 INFO [Listener at localhost/46505] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-17 02:01:51,655 DEBUG [hconnection-0x590e7796-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 02:01:51,669 INFO [RS-EventLoopGroup-20-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46102, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 02:01:51,677 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43275] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1676599311031.08bb292b0415df015f5df00a429d21d5. 2023-02-17 02:01:51,765 INFO [Listener at localhost/46505] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-17 02:01:51,765 INFO [Listener at localhost/46505] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-17 02:01:51,766 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45095] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-17 02:01:51,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45095] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676599311766 (current time:1676599311766). 2023-02-17 02:01:51,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45095] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-17 02:01:51,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45095] zookeeper.ReadOnlyZKClient(139): Connect 0x57fef2d9 to 127.0.0.1:59593 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 02:01:51,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45095] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7151926c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 02:01:51,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45095] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 02:01:51,771 INFO [RS-EventLoopGroup-19-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38640, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 02:01:51,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45095] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x57fef2d9 to 127.0.0.1:59593 2023-02-17 02:01:51,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45095] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 02:01:51,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45095] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-17 02:01:51,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45095] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-17 02:01:51,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45095] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-17 02:01:51,776 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-17 02:01:51,776 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE; timeout=600000, timestamp=1676599911776 2023-02-17 02:01:51,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45095] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-17 02:01:51,777 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 02:01:51,778 DEBUG [Listener at localhost/46505] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-17 02:01:51,778 DEBUG [Listener at localhost/46505] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-17 02:01:51,778 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-17 02:01:51,779 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-17 02:01:51,779 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE in 5 msec 2023-02-17 02:01:51,780 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-17 02:01:51,780 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED; timeout=600000, timestamp=1676599911780 2023-02-17 02:01:51,788 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-17 02:01:51,789 INFO [(jenkins-hbase4.apache.org,45095,1676599309917)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-17 02:01:51,789 DEBUG [(jenkins-hbase4.apache.org,45095,1676599309917)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-17 02:01:51,790 DEBUG [(jenkins-hbase4.apache.org,45095,1676599309917)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-17 02:01:51,790 DEBUG [(jenkins-hbase4.apache.org,45095,1676599309917)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-17 02:01:51,790 DEBUG [(jenkins-hbase4.apache.org,45095,1676599309917)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45095-0x1006003200a0000, quorum=127.0.0.1:59593, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-17 02:01:51,790 DEBUG [(jenkins-hbase4.apache.org,45095,1676599309917)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-17 02:01:51,791 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): regionserver:43275-0x1006003200a0002, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 02:01:51,791 DEBUG [(jenkins-hbase4.apache.org,45095,1676599309917)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,43275,1676599309990 2023-02-17 02:01:51,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 02:01:51,791 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): regionserver:33613-0x1006003200a0001, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 02:01:51,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 02:01:51,792 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 02:01:51,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 02:01:51,792 DEBUG [(jenkins-hbase4.apache.org,45095,1676599309917)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45095-0x1006003200a0000, quorum=127.0.0.1:59593, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,43275,1676599309990 2023-02-17 02:01:51,792 DEBUG [(jenkins-hbase4.apache.org,45095,1676599309917)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-17 02:01:51,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-17 02:01:51,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-17 02:01:51,792 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33613-0x1006003200a0001, quorum=127.0.0.1:59593, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-17 02:01:51,792 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43275-0x1006003200a0002, quorum=127.0.0.1:59593, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-17 02:01:51,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-17 02:01:51,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-17 02:01:51,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-17 02:01:51,793 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-17 02:01:51,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-17 02:01:51,793 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-17 02:01:51,793 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-17 02:01:51,793 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-17 02:01:51,793 DEBUG [member: 'jenkins-hbase4.apache.org,33613,1676599309963' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-17 02:01:51,793 DEBUG [member: 'jenkins-hbase4.apache.org,33613,1676599309963' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-17 02:01:51,794 DEBUG [member: 'jenkins-hbase4.apache.org,33613,1676599309963' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-17 02:01:51,794 DEBUG [member: 'jenkins-hbase4.apache.org,43275,1676599309990' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-17 02:01:51,794 DEBUG [member: 'jenkins-hbase4.apache.org,43275,1676599309990' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-17 02:01:51,794 DEBUG [member: 'jenkins-hbase4.apache.org,33613,1676599309963' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-17 02:01:51,794 DEBUG [member: 'jenkins-hbase4.apache.org,33613,1676599309963' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33613,1676599309963' joining acquired barrier for procedure (foo) in zk 2023-02-17 02:01:51,795 DEBUG [member: 'jenkins-hbase4.apache.org,43275,1676599309990' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-17 02:01:51,795 DEBUG [member: 'jenkins-hbase4.apache.org,43275,1676599309990' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-17 02:01:51,795 DEBUG [member: 'jenkins-hbase4.apache.org,43275,1676599309990' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43275,1676599309990' joining acquired barrier for procedure (foo) in zk 2023-02-17 02:01:51,797 DEBUG [member: 'jenkins-hbase4.apache.org,33613,1676599309963' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-17 02:01:51,797 DEBUG [member: 'jenkins-hbase4.apache.org,43275,1676599309990' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-17 02:01:51,797 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): master:45095-0x1006003200a0000, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,43275,1676599309990 2023-02-17 02:01:51,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,43275,1676599309990 2023-02-17 02:01:51,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 02:01:51,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-17 02:01:51,797 DEBUG [member: 'jenkins-hbase4.apache.org,33613,1676599309963' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33613-0x1006003200a0001, quorum=127.0.0.1:59593, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-17 02:01:51,797 DEBUG [member: 'jenkins-hbase4.apache.org,33613,1676599309963' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 02:01:51,797 DEBUG [member: 'jenkins-hbase4.apache.org,43275,1676599309990' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43275-0x1006003200a0002, quorum=127.0.0.1:59593, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-17 02:01:51,797 DEBUG [member: 'jenkins-hbase4.apache.org,43275,1676599309990' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 02:01:51,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 02:01:51,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 02:01:51,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-17 02:01:51,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43275,1676599309990 2023-02-17 02:01:51,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33613,1676599309963 2023-02-17 02:01:51,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 02:01:51,799 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43275,1676599309990' joining acquired barrier for procedure 'foo' on coordinator 2023-02-17 02:01:51,799 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@236d21c5[Count = 0] remaining members to acquire global barrier 2023-02-17 02:01:51,799 DEBUG [(jenkins-hbase4.apache.org,45095,1676599309917)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-17 02:01:51,799 DEBUG [(jenkins-hbase4.apache.org,45095,1676599309917)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-17 02:01:51,800 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): regionserver:43275-0x1006003200a0002, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-17 02:01:51,800 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): regionserver:33613-0x1006003200a0001, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-17 02:01:51,800 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-17 02:01:51,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-17 02:01:51,800 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-17 02:01:51,800 DEBUG [member: 'jenkins-hbase4.apache.org,43275,1676599309990' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-17 02:01:51,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-17 02:01:51,800 DEBUG [member: 'jenkins-hbase4.apache.org,33613,1676599309963' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-17 02:01:51,800 DEBUG [member: 'jenkins-hbase4.apache.org,33613,1676599309963' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-17 02:01:51,800 DEBUG [member: 'jenkins-hbase4.apache.org,43275,1676599309990' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-17 02:01:51,800 DEBUG [member: 'jenkins-hbase4.apache.org,43275,1676599309990' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-17 02:01:51,800 DEBUG [(jenkins-hbase4.apache.org,45095,1676599309917)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45095-0x1006003200a0000, quorum=127.0.0.1:59593, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,43275,1676599309990 2023-02-17 02:01:51,800 DEBUG [(jenkins-hbase4.apache.org,45095,1676599309917)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-17 02:01:51,800 DEBUG [rs(jenkins-hbase4.apache.org,43275,1676599309990)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676599311031.08bb292b0415df015f5df00a429d21d5. 2023-02-17 02:01:51,800 DEBUG [member: 'jenkins-hbase4.apache.org,33613,1676599309963' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,33613,1676599309963' in zk 2023-02-17 02:01:51,800 DEBUG [rs(jenkins-hbase4.apache.org,43275,1676599309990)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676599311031.08bb292b0415df015f5df00a429d21d5. started... 2023-02-17 02:01:51,801 INFO [rs(jenkins-hbase4.apache.org,43275,1676599309990)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 08bb292b0415df015f5df00a429d21d5 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-17 02:01:51,802 DEBUG [member: 'jenkins-hbase4.apache.org,33613,1676599309963' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-17 02:01:51,802 DEBUG [member: 'jenkins-hbase4.apache.org,33613,1676599309963' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 02:01:51,802 DEBUG [member: 'jenkins-hbase4.apache.org,33613,1676599309963' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-17 02:01:51,815 INFO [rs(jenkins-hbase4.apache.org,43275,1676599309990)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/08bb292b0415df015f5df00a429d21d5/.tmp/f1/51f108fd66ed49e3a233eda65aae5c25 2023-02-17 02:01:51,834 INFO [rs(jenkins-hbase4.apache.org,43275,1676599309990)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/08bb292b0415df015f5df00a429d21d5/.tmp/f2/9d4c3ec56bfc443093067c4ad18aae53 2023-02-17 02:01:51,839 DEBUG [rs(jenkins-hbase4.apache.org,43275,1676599309990)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/08bb292b0415df015f5df00a429d21d5/.tmp/f1/51f108fd66ed49e3a233eda65aae5c25 as hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/08bb292b0415df015f5df00a429d21d5/f1/51f108fd66ed49e3a233eda65aae5c25 2023-02-17 02:01:51,844 INFO [rs(jenkins-hbase4.apache.org,43275,1676599309990)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/08bb292b0415df015f5df00a429d21d5/f1/51f108fd66ed49e3a233eda65aae5c25, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-17 02:01:51,845 DEBUG [rs(jenkins-hbase4.apache.org,43275,1676599309990)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/08bb292b0415df015f5df00a429d21d5/.tmp/f2/9d4c3ec56bfc443093067c4ad18aae53 as hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/08bb292b0415df015f5df00a429d21d5/f2/9d4c3ec56bfc443093067c4ad18aae53 2023-02-17 02:01:51,851 INFO [rs(jenkins-hbase4.apache.org,43275,1676599309990)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/08bb292b0415df015f5df00a429d21d5/f2/9d4c3ec56bfc443093067c4ad18aae53, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-17 02:01:51,852 INFO [rs(jenkins-hbase4.apache.org,43275,1676599309990)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 08bb292b0415df015f5df00a429d21d5 in 51ms, sequenceid=5, compaction requested=false 2023-02-17 02:01:51,852 DEBUG [rs(jenkins-hbase4.apache.org,43275,1676599309990)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-17 02:01:51,853 DEBUG [rs(jenkins-hbase4.apache.org,43275,1676599309990)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 08bb292b0415df015f5df00a429d21d5: 2023-02-17 02:01:51,853 DEBUG [rs(jenkins-hbase4.apache.org,43275,1676599309990)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676599311031.08bb292b0415df015f5df00a429d21d5.' region-info for snapshot=foo 2023-02-17 02:01:51,853 DEBUG [rs(jenkins-hbase4.apache.org,43275,1676599309990)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 02:01:51,853 DEBUG [rs(jenkins-hbase4.apache.org,43275,1676599309990)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/08bb292b0415df015f5df00a429d21d5/f1/51f108fd66ed49e3a233eda65aae5c25] hfiles 2023-02-17 02:01:51,853 DEBUG [rs(jenkins-hbase4.apache.org,43275,1676599309990)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/08bb292b0415df015f5df00a429d21d5/f1/51f108fd66ed49e3a233eda65aae5c25 for snapshot=foo 2023-02-17 02:01:51,853 DEBUG [rs(jenkins-hbase4.apache.org,43275,1676599309990)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/08bb292b0415df015f5df00a429d21d5/f2/9d4c3ec56bfc443093067c4ad18aae53] hfiles 2023-02-17 02:01:51,853 DEBUG [rs(jenkins-hbase4.apache.org,43275,1676599309990)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/08bb292b0415df015f5df00a429d21d5/f2/9d4c3ec56bfc443093067c4ad18aae53 for snapshot=foo 2023-02-17 02:01:51,867 DEBUG [rs(jenkins-hbase4.apache.org,43275,1676599309990)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676599311031.08bb292b0415df015f5df00a429d21d5. completed. 2023-02-17 02:01:51,867 DEBUG [rs(jenkins-hbase4.apache.org,43275,1676599309990)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676599311031.08bb292b0415df015f5df00a429d21d5. 2023-02-17 02:01:51,867 DEBUG [member: 'jenkins-hbase4.apache.org,43275,1676599309990' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-17 02:01:51,867 DEBUG [member: 'jenkins-hbase4.apache.org,43275,1676599309990' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-17 02:01:51,867 DEBUG [member: 'jenkins-hbase4.apache.org,43275,1676599309990' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43275,1676599309990 2023-02-17 02:01:51,867 DEBUG [member: 'jenkins-hbase4.apache.org,43275,1676599309990' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-17 02:01:51,867 DEBUG [member: 'jenkins-hbase4.apache.org,43275,1676599309990' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,43275,1676599309990' in zk 2023-02-17 02:01:51,869 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): master:45095-0x1006003200a0000, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,43275,1676599309990 2023-02-17 02:01:51,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,43275,1676599309990 2023-02-17 02:01:51,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 02:01:51,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-17 02:01:51,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 02:01:51,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 02:01:51,870 DEBUG [member: 'jenkins-hbase4.apache.org,43275,1676599309990' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-17 02:01:51,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-17 02:01:51,870 DEBUG [member: 'jenkins-hbase4.apache.org,43275,1676599309990' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 02:01:51,871 DEBUG [member: 'jenkins-hbase4.apache.org,43275,1676599309990' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-17 02:01:51,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43275,1676599309990 2023-02-17 02:01:51,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33613,1676599309963 2023-02-17 02:01:51,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 02:01:51,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-17 02:01:51,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43275,1676599309990 2023-02-17 02:01:51,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33613,1676599309963 2023-02-17 02:01:51,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase4.apache.org,43275,1676599309990': 2023-02-17 02:01:51,873 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43275,1676599309990' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-17 02:01:51,873 INFO [(jenkins-hbase4.apache.org,45095,1676599309917)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-17 02:01:51,874 DEBUG [(jenkins-hbase4.apache.org,45095,1676599309917)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-17 02:01:51,875 DEBUG [(jenkins-hbase4.apache.org,45095,1676599309917)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-17 02:01:51,875 DEBUG [(jenkins-hbase4.apache.org,45095,1676599309917)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-17 02:01:51,875 INFO [(jenkins-hbase4.apache.org,45095,1676599309917)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-17 02:01:51,879 DEBUG [Listener at localhost/46505] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-17 02:01:51,879 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): regionserver:33613-0x1006003200a0001, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-17 02:01:51,879 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): regionserver:33613-0x1006003200a0001, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 02:01:51,879 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): regionserver:43275-0x1006003200a0002, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-17 02:01:51,879 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): regionserver:43275-0x1006003200a0002, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 02:01:51,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-17 02:01:51,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-17 02:01:51,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-17 02:01:51,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-17 02:01:51,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45095] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-17 02:01:51,880 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 02:01:51,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 02:01:51,880 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): master:45095-0x1006003200a0000, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-17 02:01:51,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45095] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' is still in progress! 2023-02-17 02:01:51,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-17 02:01:51,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 02:01:51,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-17 02:01:51,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 02:01:51,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 02:01:51,881 DEBUG [Listener at localhost/46505] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-17 02:01:51,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-17 02:01:51,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-17 02:01:51,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 02:01:51,883 DEBUG [(jenkins-hbase4.apache.org,45095,1676599309917)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45095-0x1006003200a0000, quorum=127.0.0.1:59593, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,43275,1676599309990 2023-02-17 02:01:51,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-17 02:01:51,883 DEBUG [(jenkins-hbase4.apache.org,45095,1676599309917)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45095-0x1006003200a0000, quorum=127.0.0.1:59593, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,33613,1676599309963 2023-02-17 02:01:51,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 02:01:51,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-17 02:01:51,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43275,1676599309990 2023-02-17 02:01:51,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33613,1676599309963 2023-02-17 02:01:51,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 02:01:51,885 DEBUG [(jenkins-hbase4.apache.org,45095,1676599309917)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45095-0x1006003200a0000, quorum=127.0.0.1:59593, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,43275,1676599309990 2023-02-17 02:01:51,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-17 02:01:51,886 DEBUG [(jenkins-hbase4.apache.org,45095,1676599309917)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45095-0x1006003200a0000, quorum=127.0.0.1:59593, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,33613,1676599309963 2023-02-17 02:01:51,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43275,1676599309990 2023-02-17 02:01:51,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33613,1676599309963 2023-02-17 02:01:51,897 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): regionserver:43275-0x1006003200a0002, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 02:01:51,897 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): master:45095-0x1006003200a0000, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,33613,1676599309963 2023-02-17 02:01:51,897 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): regionserver:33613-0x1006003200a0001, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 02:01:51,897 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-17 02:01:51,897 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): regionserver:33613-0x1006003200a0001, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 02:01:51,897 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-17 02:01:51,897 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 02:01:51,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 02:01:51,897 DEBUG [(jenkins-hbase4.apache.org,45095,1676599309917)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 02:01:51,897 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): master:45095-0x1006003200a0000, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-17 02:01:51,897 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 02:01:51,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 02:01:51,897 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): regionserver:43275-0x1006003200a0002, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 02:01:51,898 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): master:45095-0x1006003200a0000, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,43275,1676599309990 2023-02-17 02:01:51,898 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): master:45095-0x1006003200a0000, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-17 02:01:51,898 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): master:45095-0x1006003200a0000, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,33613,1676599309963 2023-02-17 02:01:51,898 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): master:45095-0x1006003200a0000, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-17 02:01:51,898 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): master:45095-0x1006003200a0000, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,43275,1676599309990 2023-02-17 02:01:51,898 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): master:45095-0x1006003200a0000, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-17 02:01:51,898 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): master:45095-0x1006003200a0000, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-17 02:01:51,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 02:01:51,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 02:01:51,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 02:01:51,898 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/.hbase-snapshot/.tmp/foo 2023-02-17 02:01:51,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 02:01:51,926 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/.hbase-snapshot/.tmp/foo to hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/.hbase-snapshot/foo 2023-02-17 02:01:51,944 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed 2023-02-17 02:01:51,944 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/.hbase-snapshot/.tmp/foo 2023-02-17 02:01:51,945 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/.hbase-snapshot/.tmp/foo 2023-02-17 02:01:51,945 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks at 1676599311777Consolidate snapshot: foo at 1676599311897 (+120 ms)Loading Region manifests for foo at 1676599311897Writing data manifest for foo at 1676599311901 (+4 ms)Verifying snapshot: foo at 1676599311919 (+18 ms)Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed at 1676599311944 (+25 ms) 2023-02-17 02:01:51,947 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-17 02:01:51,948 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED in 169 msec 2023-02-17 02:01:52,081 DEBUG [Listener at localhost/46505] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-17 02:01:52,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45095] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-17 02:01:52,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45095] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-17 02:01:52,083 INFO [Listener at localhost/46505] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-17 02:01:52,086 INFO [Listener at localhost/46505] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-17 02:01:52,145 INFO [Listener at localhost/46505] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-17 02:01:52,174 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43275] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1676599311031.08bb292b0415df015f5df00a429d21d5. 2023-02-17 02:01:52,260 INFO [Listener at localhost/46505] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-17 02:01:52,266 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45095] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-17 02:01:52,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45095] procedure.ProcedureCoordinator(165): Submitting procedure testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 02:01:52,268 INFO [(jenkins-hbase4.apache.org,45095,1676599309917)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-17 02:01:52,268 DEBUG [(jenkins-hbase4.apache.org,45095,1676599309917)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-17 02:01:52,269 DEBUG [(jenkins-hbase4.apache.org,45095,1676599309917)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' 2023-02-17 02:01:52,269 DEBUG [(jenkins-hbase4.apache.org,45095,1676599309917)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks', kicking off acquire phase on members. 2023-02-17 02:01:52,269 DEBUG [(jenkins-hbase4.apache.org,45095,1676599309917)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45095-0x1006003200a0000, quorum=127.0.0.1:59593, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 02:01:52,269 DEBUG [(jenkins-hbase4.apache.org,45095,1676599309917)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 02:01:52,271 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): regionserver:43275-0x1006003200a0002, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 02:01:52,271 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): regionserver:33613-0x1006003200a0001, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 02:01:52,271 DEBUG [(jenkins-hbase4.apache.org,45095,1676599309917)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,43275,1676599309990 2023-02-17 02:01:52,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 02:01:52,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 02:01:52,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 02:01:52,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 02:01:52,271 DEBUG [(jenkins-hbase4.apache.org,45095,1676599309917)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45095-0x1006003200a0000, quorum=127.0.0.1:59593, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,43275,1676599309990 2023-02-17 02:01:52,271 DEBUG [(jenkins-hbase4.apache.org,45095,1676599309917)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-17 02:01:52,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 02:01:52,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 02:01:52,272 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43275-0x1006003200a0002, quorum=127.0.0.1:59593, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 02:01:52,272 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33613-0x1006003200a0001, quorum=127.0.0.1:59593, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 02:01:52,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-17 02:01:52,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 02:01:52,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-17 02:01:52,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 02:01:52,272 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 02:01:52,272 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 02:01:52,273 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 02:01:52,273 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 02:01:52,273 DEBUG [member: 'jenkins-hbase4.apache.org,33613,1676599309963' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-17 02:01:52,273 DEBUG [member: 'jenkins-hbase4.apache.org,33613,1676599309963' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-17 02:01:52,273 DEBUG [member: 'jenkins-hbase4.apache.org,43275,1676599309990' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-17 02:01:52,273 DEBUG [member: 'jenkins-hbase4.apache.org,43275,1676599309990' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-17 02:01:52,274 DEBUG [member: 'jenkins-hbase4.apache.org,33613,1676599309963' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-17 02:01:52,275 DEBUG [member: 'jenkins-hbase4.apache.org,43275,1676599309990' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-17 02:01:52,275 DEBUG [member: 'jenkins-hbase4.apache.org,33613,1676599309963' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-17 02:01:52,275 DEBUG [member: 'jenkins-hbase4.apache.org,33613,1676599309963' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33613,1676599309963' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-17 02:01:52,275 DEBUG [member: 'jenkins-hbase4.apache.org,43275,1676599309990' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-17 02:01:52,275 DEBUG [member: 'jenkins-hbase4.apache.org,43275,1676599309990' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-17 02:01:52,275 DEBUG [rs(jenkins-hbase4.apache.org,43275,1676599309990)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676599311031.08bb292b0415df015f5df00a429d21d5. 2023-02-17 02:01:52,275 DEBUG [rs(jenkins-hbase4.apache.org,43275,1676599309990)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676599311031.08bb292b0415df015f5df00a429d21d5. started... 2023-02-17 02:01:52,275 INFO [rs(jenkins-hbase4.apache.org,43275,1676599309990)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 08bb292b0415df015f5df00a429d21d5 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-17 02:01:52,276 DEBUG [member: 'jenkins-hbase4.apache.org,33613,1676599309963' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 02:01:52,276 DEBUG [member: 'jenkins-hbase4.apache.org,33613,1676599309963' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33613-0x1006003200a0001, quorum=127.0.0.1:59593, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 02:01:52,276 DEBUG [member: 'jenkins-hbase4.apache.org,33613,1676599309963' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 02:01:52,290 INFO [rs(jenkins-hbase4.apache.org,43275,1676599309990)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/08bb292b0415df015f5df00a429d21d5/.tmp/f1/2a78fff707994fa4ba14e941be25e267 2023-02-17 02:01:52,313 INFO [rs(jenkins-hbase4.apache.org,43275,1676599309990)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/08bb292b0415df015f5df00a429d21d5/.tmp/f2/48a0e4df5e6442e1af5c817442f5a43c 2023-02-17 02:01:52,317 DEBUG [rs(jenkins-hbase4.apache.org,43275,1676599309990)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/08bb292b0415df015f5df00a429d21d5/.tmp/f1/2a78fff707994fa4ba14e941be25e267 as hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/08bb292b0415df015f5df00a429d21d5/f1/2a78fff707994fa4ba14e941be25e267 2023-02-17 02:01:52,320 INFO [rs(jenkins-hbase4.apache.org,43275,1676599309990)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/08bb292b0415df015f5df00a429d21d5/f1/2a78fff707994fa4ba14e941be25e267, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-17 02:01:52,321 DEBUG [rs(jenkins-hbase4.apache.org,43275,1676599309990)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/08bb292b0415df015f5df00a429d21d5/.tmp/f2/48a0e4df5e6442e1af5c817442f5a43c as hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/08bb292b0415df015f5df00a429d21d5/f2/48a0e4df5e6442e1af5c817442f5a43c 2023-02-17 02:01:52,325 INFO [rs(jenkins-hbase4.apache.org,43275,1676599309990)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/08bb292b0415df015f5df00a429d21d5/f2/48a0e4df5e6442e1af5c817442f5a43c, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-17 02:01:52,326 INFO [rs(jenkins-hbase4.apache.org,43275,1676599309990)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 08bb292b0415df015f5df00a429d21d5 in 50ms, sequenceid=9, compaction requested=false 2023-02-17 02:01:52,327 DEBUG [rs(jenkins-hbase4.apache.org,43275,1676599309990)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 08bb292b0415df015f5df00a429d21d5: 2023-02-17 02:01:52,327 DEBUG [rs(jenkins-hbase4.apache.org,43275,1676599309990)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676599311031.08bb292b0415df015f5df00a429d21d5. 2023-02-17 02:01:52,327 DEBUG [member: 'jenkins-hbase4.apache.org,43275,1676599309990' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-17 02:01:52,327 DEBUG [member: 'jenkins-hbase4.apache.org,43275,1676599309990' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-17 02:01:52,327 DEBUG [member: 'jenkins-hbase4.apache.org,43275,1676599309990' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43275,1676599309990 2023-02-17 02:01:52,327 DEBUG [member: 'jenkins-hbase4.apache.org,43275,1676599309990' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-17 02:01:52,327 DEBUG [member: 'jenkins-hbase4.apache.org,43275,1676599309990' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43275,1676599309990' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-17 02:01:52,330 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): master:45095-0x1006003200a0000, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,43275,1676599309990 2023-02-17 02:01:52,330 DEBUG [member: 'jenkins-hbase4.apache.org,43275,1676599309990' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 02:01:52,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,43275,1676599309990 2023-02-17 02:01:52,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 02:01:52,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-17 02:01:52,330 DEBUG [member: 'jenkins-hbase4.apache.org,43275,1676599309990' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43275-0x1006003200a0002, quorum=127.0.0.1:59593, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 02:01:52,330 DEBUG [member: 'jenkins-hbase4.apache.org,43275,1676599309990' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 02:01:52,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 02:01:52,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 02:01:52,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 02:01:52,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43275,1676599309990 2023-02-17 02:01:52,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33613,1676599309963 2023-02-17 02:01:52,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 02:01:52,331 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43275,1676599309990' joining acquired barrier for procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' on coordinator 2023-02-17 02:01:52,332 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2752a170[Count = 0] remaining members to acquire global barrier 2023-02-17 02:01:52,332 DEBUG [(jenkins-hbase4.apache.org,45095,1676599309917)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'in-barrier' execution. 2023-02-17 02:01:52,332 DEBUG [(jenkins-hbase4.apache.org,45095,1676599309917)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 02:01:52,333 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): regionserver:33613-0x1006003200a0001, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 02:01:52,333 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): regionserver:43275-0x1006003200a0002, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 02:01:52,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 02:01:52,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 02:01:52,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 02:01:52,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 02:01:52,333 DEBUG [(jenkins-hbase4.apache.org,45095,1676599309917)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45095-0x1006003200a0000, quorum=127.0.0.1:59593, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,43275,1676599309990 2023-02-17 02:01:52,333 DEBUG [(jenkins-hbase4.apache.org,45095,1676599309917)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-17 02:01:52,333 DEBUG [member: 'jenkins-hbase4.apache.org,43275,1676599309990' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-17 02:01:52,333 DEBUG [member: 'jenkins-hbase4.apache.org,33613,1676599309963' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-17 02:01:52,333 DEBUG [member: 'jenkins-hbase4.apache.org,33613,1676599309963' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-17 02:01:52,333 DEBUG [member: 'jenkins-hbase4.apache.org,43275,1676599309990' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-17 02:01:52,333 DEBUG [member: 'jenkins-hbase4.apache.org,33613,1676599309963' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase4.apache.org,33613,1676599309963' in zk 2023-02-17 02:01:52,333 DEBUG [member: 'jenkins-hbase4.apache.org,43275,1676599309990' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase4.apache.org,43275,1676599309990' in zk 2023-02-17 02:01:52,335 DEBUG [member: 'jenkins-hbase4.apache.org,33613,1676599309963' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-17 02:01:52,335 DEBUG [member: 'jenkins-hbase4.apache.org,33613,1676599309963' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 02:01:52,335 DEBUG [member: 'jenkins-hbase4.apache.org,43275,1676599309990' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-17 02:01:52,335 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): master:45095-0x1006003200a0000, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,43275,1676599309990 2023-02-17 02:01:52,335 DEBUG [member: 'jenkins-hbase4.apache.org,43275,1676599309990' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 02:01:52,335 DEBUG [member: 'jenkins-hbase4.apache.org,33613,1676599309963' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-17 02:01:52,335 DEBUG [member: 'jenkins-hbase4.apache.org,43275,1676599309990' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-17 02:01:52,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,43275,1676599309990 2023-02-17 02:01:52,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 02:01:52,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-17 02:01:52,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 02:01:52,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 02:01:52,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 02:01:52,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43275,1676599309990 2023-02-17 02:01:52,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33613,1676599309963 2023-02-17 02:01:52,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 02:01:52,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 02:01:52,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43275,1676599309990 2023-02-17 02:01:52,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33613,1676599309963 2023-02-17 02:01:52,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' member 'jenkins-hbase4.apache.org,43275,1676599309990': 2023-02-17 02:01:52,338 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43275,1676599309990' released barrier for procedure'testRestoreSnapshotDoesNotCreateBackRefLinks', counting down latch. Waiting for 0 more 2023-02-17 02:01:52,338 INFO [(jenkins-hbase4.apache.org,45095,1676599309917)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' execution completed 2023-02-17 02:01:52,338 DEBUG [(jenkins-hbase4.apache.org,45095,1676599309917)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-17 02:01:52,338 DEBUG [(jenkins-hbase4.apache.org,45095,1676599309917)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-17 02:01:52,338 DEBUG [(jenkins-hbase4.apache.org,45095,1676599309917)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 02:01:52,339 INFO [(jenkins-hbase4.apache.org,45095,1676599309917)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testRestoreSnapshotDoesNotCreateBackRefLinksincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-17 02:01:52,341 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): regionserver:43275-0x1006003200a0002, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 02:01:52,341 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): regionserver:33613-0x1006003200a0001, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 02:01:52,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 02:01:52,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 02:01:52,341 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): regionserver:33613-0x1006003200a0001, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 02:01:52,341 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): regionserver:43275-0x1006003200a0002, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 02:01:52,341 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): master:45095-0x1006003200a0000, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 02:01:52,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 02:01:52,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 02:01:52,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 02:01:52,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-17 02:01:52,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 02:01:52,341 DEBUG [(jenkins-hbase4.apache.org,45095,1676599309917)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45095-0x1006003200a0000, quorum=127.0.0.1:59593, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,43275,1676599309990 2023-02-17 02:01:52,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 02:01:52,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 02:01:52,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 02:01:52,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 02:01:52,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 02:01:52,341 DEBUG [(jenkins-hbase4.apache.org,45095,1676599309917)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45095-0x1006003200a0000, quorum=127.0.0.1:59593, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,33613,1676599309963 2023-02-17 02:01:52,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 02:01:52,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 02:01:52,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 02:01:52,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 02:01:52,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 02:01:52,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43275,1676599309990 2023-02-17 02:01:52,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33613,1676599309963 2023-02-17 02:01:52,343 DEBUG [(jenkins-hbase4.apache.org,45095,1676599309917)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45095-0x1006003200a0000, quorum=127.0.0.1:59593, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,43275,1676599309990 2023-02-17 02:01:52,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 02:01:52,343 DEBUG [(jenkins-hbase4.apache.org,45095,1676599309917)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45095-0x1006003200a0000, quorum=127.0.0.1:59593, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,33613,1676599309963 2023-02-17 02:01:52,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 02:01:52,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43275,1676599309990 2023-02-17 02:01:52,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33613,1676599309963 2023-02-17 02:01:52,346 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): master:45095-0x1006003200a0000, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,33613,1676599309963 2023-02-17 02:01:52,347 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): regionserver:43275-0x1006003200a0002, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 02:01:52,347 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): regionserver:33613-0x1006003200a0001, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 02:01:52,347 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): master:45095-0x1006003200a0000, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 02:01:52,347 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): regionserver:43275-0x1006003200a0002, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 02:01:52,347 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): master:45095-0x1006003200a0000, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,43275,1676599309990 2023-02-17 02:01:52,347 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 02:01:52,347 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 02:01:52,347 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): regionserver:33613-0x1006003200a0001, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 02:01:52,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 02:01:52,347 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45095] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-17 02:01:52,347 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45095] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-17 02:01:52,347 DEBUG [(jenkins-hbase4.apache.org,45095,1676599309917)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 02:01:52,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 02:01:52,347 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 02:01:52,347 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): master:45095-0x1006003200a0000, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 02:01:52,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 02:01:52,347 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): master:45095-0x1006003200a0000, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,33613,1676599309963 2023-02-17 02:01:52,347 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): master:45095-0x1006003200a0000, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 02:01:52,347 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): master:45095-0x1006003200a0000, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,43275,1676599309990 2023-02-17 02:01:52,347 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): master:45095-0x1006003200a0000, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 02:01:52,347 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): master:45095-0x1006003200a0000, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 02:01:52,347 DEBUG [Listener at localhost/46505] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testRestoreSnapshotDoesNotCreateBackRefLinks'' to complete. (max 20000 ms per retry) 2023-02-17 02:01:52,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 02:01:52,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 02:01:52,348 DEBUG [Listener at localhost/46505] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-17 02:01:52,448 DEBUG [Listener at localhost/46505] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-17 02:01:52,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45095] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-17 02:01:52,454 INFO [Listener at localhost/46505] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1676599311766 type: FLUSH version: 2 ttl: 0 2023-02-17 02:01:52,454 DEBUG [Listener at localhost/46505] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:38701/user/jenkins/test-data/2b72b1ec-cd12-ebc6-c216-f6433e505499/foo/47442d00-0d63-485f-8338-a5f78feadd32/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 02:01:52,455 INFO [Listener at localhost/46505] snapshot.RestoreSnapshotHelper(239): region to add: 08bb292b0415df015f5df00a429d21d5 2023-02-17 02:01:52,455 INFO [Listener at localhost/46505] snapshot.RestoreSnapshotHelper(585): clone region=08bb292b0415df015f5df00a429d21d5 as 08bb292b0415df015f5df00a429d21d5 in snapshot foo 2023-02-17 02:01:52,456 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 08bb292b0415df015f5df00a429d21d5, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676599311031.08bb292b0415df015f5df00a429d21d5.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38701/user/jenkins/test-data/2b72b1ec-cd12-ebc6-c216-f6433e505499/foo/47442d00-0d63-485f-8338-a5f78feadd32 2023-02-17 02:01:52,466 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676599311031.08bb292b0415df015f5df00a429d21d5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:52,466 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 51f108fd66ed49e3a233eda65aae5c25 from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 02:01:52,468 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9d4c3ec56bfc443093067c4ad18aae53 from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 02:01:52,470 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 08bb292b0415df015f5df00a429d21d5, disabling compactions & flushes 2023-02-17 02:01:52,470 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676599311031.08bb292b0415df015f5df00a429d21d5. 2023-02-17 02:01:52,470 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676599311031.08bb292b0415df015f5df00a429d21d5. 2023-02-17 02:01:52,470 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676599311031.08bb292b0415df015f5df00a429d21d5. after waiting 0 ms 2023-02-17 02:01:52,470 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676599311031.08bb292b0415df015f5df00a429d21d5. 2023-02-17 02:01:52,470 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676599311031.08bb292b0415df015f5df00a429d21d5. 2023-02-17 02:01:52,470 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 08bb292b0415df015f5df00a429d21d5: 2023-02-17 02:01:52,471 INFO [Listener at localhost/46505] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1676599311766 type: FLUSH version: 2 ttl: 0 2023-02-17 02:01:52,472 DEBUG [Listener at localhost/46505] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:38701/user/jenkins/test-data/2b72b1ec-cd12-ebc6-c216-f6433e505499/foo/47442d00-0d63-485f-8338-a5f78feadd32 2023-02-17 02:01:52,472 DEBUG [Listener at localhost/46505] util.CommonFSUtils(682): File system contents for path hdfs://localhost:38701/user/jenkins/test-data/2b72b1ec-cd12-ebc6-c216-f6433e505499/foo/47442d00-0d63-485f-8338-a5f78feadd32 2023-02-17 02:01:52,472 DEBUG [Listener at localhost/46505] util.CommonFSUtils(699): |-data/ 2023-02-17 02:01:52,472 DEBUG [Listener at localhost/46505] util.CommonFSUtils(699): |----default/ 2023-02-17 02:01:52,473 DEBUG [Listener at localhost/46505] util.CommonFSUtils(699): |-------testRestoreSnapshotDoesNotCreateBackRefLinks/ 2023-02-17 02:01:52,473 DEBUG [Listener at localhost/46505] util.CommonFSUtils(699): |----------08bb292b0415df015f5df00a429d21d5/ 2023-02-17 02:01:52,473 DEBUG [Listener at localhost/46505] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 02:01:52,473 DEBUG [Listener at localhost/46505] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 02:01:52,474 DEBUG [Listener at localhost/46505] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=08bb292b0415df015f5df00a429d21d5-51f108fd66ed49e3a233eda65aae5c25 2023-02-17 02:01:52,474 DEBUG [Listener at localhost/46505] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 02:01:52,474 DEBUG [Listener at localhost/46505] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=08bb292b0415df015f5df00a429d21d5-9d4c3ec56bfc443093067c4ad18aae53 hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/08bb292b0415df015f5df00a429d21d5/f1/2a78fff707994fa4ba14e941be25e267 hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/08bb292b0415df015f5df00a429d21d5/f1/51f108fd66ed49e3a233eda65aae5c25 hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/08bb292b0415df015f5df00a429d21d5/f2/48a0e4df5e6442e1af5c817442f5a43c hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/08bb292b0415df015f5df00a429d21d5/f2/9d4c3ec56bfc443093067c4ad18aae53 2023-02-17 02:01:52,480 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45095] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "foo" 2023-02-17 02:01:52,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45095] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-17 02:01:52,483 INFO [Listener at localhost/46505] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 02:01:52,483 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45095] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 02:01:52,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45095] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 02:01:52,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45095] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-17 02:01:52,487 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676599312487"}]},"ts":"1676599312487"} 2023-02-17 02:01:52,488 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLING in hbase:meta 2023-02-17 02:01:52,490 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLING 2023-02-17 02:01:52,490 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=08bb292b0415df015f5df00a429d21d5, UNASSIGN}] 2023-02-17 02:01:52,494 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=08bb292b0415df015f5df00a429d21d5, UNASSIGN 2023-02-17 02:01:52,495 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=08bb292b0415df015f5df00a429d21d5, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43275,1676599309990 2023-02-17 02:01:52,495 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676599311031.08bb292b0415df015f5df00a429d21d5.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676599312495"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676599312495"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676599312495"}]},"ts":"1676599312495"} 2023-02-17 02:01:52,496 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 08bb292b0415df015f5df00a429d21d5, server=jenkins-hbase4.apache.org,43275,1676599309990}] 2023-02-17 02:01:52,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45095] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-17 02:01:52,648 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 08bb292b0415df015f5df00a429d21d5 2023-02-17 02:01:52,649 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 08bb292b0415df015f5df00a429d21d5, disabling compactions & flushes 2023-02-17 02:01:52,649 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676599311031.08bb292b0415df015f5df00a429d21d5. 2023-02-17 02:01:52,649 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676599311031.08bb292b0415df015f5df00a429d21d5. 2023-02-17 02:01:52,649 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676599311031.08bb292b0415df015f5df00a429d21d5. after waiting 0 ms 2023-02-17 02:01:52,649 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676599311031.08bb292b0415df015f5df00a429d21d5. 2023-02-17 02:01:52,652 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/08bb292b0415df015f5df00a429d21d5/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 02:01:52,652 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676599311031.08bb292b0415df015f5df00a429d21d5. 2023-02-17 02:01:52,653 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 08bb292b0415df015f5df00a429d21d5: 2023-02-17 02:01:52,654 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 08bb292b0415df015f5df00a429d21d5 2023-02-17 02:01:52,654 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=08bb292b0415df015f5df00a429d21d5, regionState=CLOSED 2023-02-17 02:01:52,654 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676599311031.08bb292b0415df015f5df00a429d21d5.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676599312654"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676599312654"}]},"ts":"1676599312654"} 2023-02-17 02:01:52,657 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-17 02:01:52,657 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 08bb292b0415df015f5df00a429d21d5, server=jenkins-hbase4.apache.org,43275,1676599309990 in 159 msec 2023-02-17 02:01:52,658 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-17 02:01:52,658 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=08bb292b0415df015f5df00a429d21d5, UNASSIGN in 167 msec 2023-02-17 02:01:52,658 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676599312658"}]},"ts":"1676599312658"} 2023-02-17 02:01:52,659 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLED in hbase:meta 2023-02-17 02:01:52,662 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLED 2023-02-17 02:01:52,663 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 179 msec 2023-02-17 02:01:52,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45095] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-17 02:01:52,790 INFO [Listener at localhost/46505] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 15 completed 2023-02-17 02:01:52,791 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45095] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 02:01:52,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45095] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 02:01:52,794 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 02:01:52,794 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 02:01:52,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45095] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-17 02:01:52,797 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/08bb292b0415df015f5df00a429d21d5 2023-02-17 02:01:52,799 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/08bb292b0415df015f5df00a429d21d5/f1, FileablePath, hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/08bb292b0415df015f5df00a429d21d5/f2, FileablePath, hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/08bb292b0415df015f5df00a429d21d5/recovered.edits] 2023-02-17 02:01:52,801 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/08bb292b0415df015f5df00a429d21d5/f1/2a78fff707994fa4ba14e941be25e267 to hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/08bb292b0415df015f5df00a429d21d5/f1/2a78fff707994fa4ba14e941be25e267 2023-02-17 02:01:52,802 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/08bb292b0415df015f5df00a429d21d5/f1/51f108fd66ed49e3a233eda65aae5c25 to hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/08bb292b0415df015f5df00a429d21d5/f1/51f108fd66ed49e3a233eda65aae5c25 2023-02-17 02:01:52,804 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/08bb292b0415df015f5df00a429d21d5/f2/48a0e4df5e6442e1af5c817442f5a43c to hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/08bb292b0415df015f5df00a429d21d5/f2/48a0e4df5e6442e1af5c817442f5a43c 2023-02-17 02:01:52,805 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/08bb292b0415df015f5df00a429d21d5/f2/9d4c3ec56bfc443093067c4ad18aae53 to hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/08bb292b0415df015f5df00a429d21d5/f2/9d4c3ec56bfc443093067c4ad18aae53 2023-02-17 02:01:52,807 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/08bb292b0415df015f5df00a429d21d5/recovered.edits/12.seqid to hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/08bb292b0415df015f5df00a429d21d5/recovered.edits/12.seqid 2023-02-17 02:01:52,807 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/08bb292b0415df015f5df00a429d21d5 2023-02-17 02:01:52,807 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-17 02:01:52,809 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 02:01:52,810 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testRestoreSnapshotDoesNotCreateBackRefLinks from hbase:meta 2023-02-17 02:01:52,812 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' descriptor. 2023-02-17 02:01:52,815 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 02:01:52,815 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' from region states. 2023-02-17 02:01:52,816 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676599311031.08bb292b0415df015f5df00a429d21d5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676599312815"}]},"ts":"9223372036854775807"} 2023-02-17 02:01:52,817 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-17 02:01:52,817 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 08bb292b0415df015f5df00a429d21d5, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676599311031.08bb292b0415df015f5df00a429d21d5.', STARTKEY => '', ENDKEY => ''}] 2023-02-17 02:01:52,817 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testRestoreSnapshotDoesNotCreateBackRefLinks' as deleted. 2023-02-17 02:01:52,817 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676599312817"}]},"ts":"9223372036854775807"} 2023-02-17 02:01:52,818 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testRestoreSnapshotDoesNotCreateBackRefLinks state from META 2023-02-17 02:01:52,821 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 02:01:52,822 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 30 msec 2023-02-17 02:01:52,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45095] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-17 02:01:52,896 INFO [Listener at localhost/46505] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 18 completed 2023-02-17 02:01:52,896 INFO [Listener at localhost/46505] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-17 02:01:52,897 INFO [Listener at localhost/46505] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-17 02:01:52,897 DEBUG [Listener at localhost/46505] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x29ff03bb to 127.0.0.1:59593 2023-02-17 02:01:52,897 DEBUG [Listener at localhost/46505] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 02:01:52,897 DEBUG [Listener at localhost/46505] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-17 02:01:52,897 DEBUG [Listener at localhost/46505] util.JVMClusterUtil(257): Found active master hash=195934338, stopped=false 2023-02-17 02:01:52,897 INFO [Listener at localhost/46505] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,45095,1676599309917 2023-02-17 02:01:52,899 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): master:45095-0x1006003200a0000, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-17 02:01:52,899 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): regionserver:33613-0x1006003200a0001, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-17 02:01:52,899 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): regionserver:43275-0x1006003200a0002, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-17 02:01:52,899 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): master:45095-0x1006003200a0000, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 02:01:52,899 INFO [Listener at localhost/46505] procedure2.ProcedureExecutor(629): Stopping 2023-02-17 02:01:52,899 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45095-0x1006003200a0000, quorum=127.0.0.1:59593, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 02:01:52,899 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43275-0x1006003200a0002, quorum=127.0.0.1:59593, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 02:01:52,899 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33613-0x1006003200a0001, quorum=127.0.0.1:59593, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 02:01:52,900 DEBUG [Listener at localhost/46505] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4c5a55bd to 127.0.0.1:59593 2023-02-17 02:01:52,900 DEBUG [Listener at localhost/46505] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 02:01:52,901 INFO [Listener at localhost/46505] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,33613,1676599309963' ***** 2023-02-17 02:01:52,901 INFO [Listener at localhost/46505] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-17 02:01:52,901 INFO [Listener at localhost/46505] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,43275,1676599309990' ***** 2023-02-17 02:01:52,901 INFO [Listener at localhost/46505] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-17 02:01:52,901 INFO [RS:0;jenkins-hbase4:33613] regionserver.HeapMemoryManager(220): Stopping 2023-02-17 02:01:52,901 INFO [RS:1;jenkins-hbase4:43275] regionserver.HeapMemoryManager(220): Stopping 2023-02-17 02:01:52,901 INFO [RS:0;jenkins-hbase4:33613] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-17 02:01:52,901 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-17 02:01:52,901 INFO [RS:0;jenkins-hbase4:33613] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-17 02:01:52,901 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-17 02:01:52,902 INFO [RS:0;jenkins-hbase4:33613] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,33613,1676599309963 2023-02-17 02:01:52,901 INFO [RS:1;jenkins-hbase4:43275] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-17 02:01:52,903 DEBUG [RS:0;jenkins-hbase4:33613] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x198d0d12 to 127.0.0.1:59593 2023-02-17 02:01:52,903 INFO [RS:1;jenkins-hbase4:43275] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-17 02:01:52,903 DEBUG [RS:0;jenkins-hbase4:33613] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 02:01:52,903 INFO [RS:1;jenkins-hbase4:43275] regionserver.HRegionServer(3304): Received CLOSE for 6f3b866d01a86f8137a760957d97815a 2023-02-17 02:01:52,903 INFO [RS:0;jenkins-hbase4:33613] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-17 02:01:52,903 INFO [RS:1;jenkins-hbase4:43275] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,43275,1676599309990 2023-02-17 02:01:52,903 INFO [RS:0;jenkins-hbase4:33613] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-17 02:01:52,903 DEBUG [RS:1;jenkins-hbase4:43275] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x101e6d7a to 127.0.0.1:59593 2023-02-17 02:01:52,903 INFO [RS:0;jenkins-hbase4:33613] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-17 02:01:52,903 DEBUG [RS:1;jenkins-hbase4:43275] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 02:01:52,903 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 6f3b866d01a86f8137a760957d97815a, disabling compactions & flushes 2023-02-17 02:01:52,903 INFO [RS:1;jenkins-hbase4:43275] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-17 02:01:52,903 INFO [RS:0;jenkins-hbase4:33613] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-17 02:01:52,903 DEBUG [RS:1;jenkins-hbase4:43275] regionserver.HRegionServer(1479): Online Regions={6f3b866d01a86f8137a760957d97815a=hbase:namespace,,1676599310549.6f3b866d01a86f8137a760957d97815a.} 2023-02-17 02:01:52,903 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676599310549.6f3b866d01a86f8137a760957d97815a. 2023-02-17 02:01:52,903 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676599310549.6f3b866d01a86f8137a760957d97815a. 2023-02-17 02:01:52,903 DEBUG [RS:1;jenkins-hbase4:43275] regionserver.HRegionServer(1505): Waiting on 6f3b866d01a86f8137a760957d97815a 2023-02-17 02:01:52,903 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676599310549.6f3b866d01a86f8137a760957d97815a. after waiting 0 ms 2023-02-17 02:01:52,903 INFO [RS:0;jenkins-hbase4:33613] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-17 02:01:52,903 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676599310549.6f3b866d01a86f8137a760957d97815a. 2023-02-17 02:01:52,904 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-17 02:01:52,903 DEBUG [RS:0;jenkins-hbase4:33613] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-17 02:01:52,904 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-17 02:01:52,904 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 6f3b866d01a86f8137a760957d97815a 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-17 02:01:52,904 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-17 02:01:52,904 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-17 02:01:52,904 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-17 02:01:52,904 DEBUG [RS:0;jenkins-hbase4:33613] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-17 02:01:52,904 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.46 KB heapSize=7.87 KB 2023-02-17 02:01:52,918 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.77 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/data/hbase/meta/1588230740/.tmp/info/7b4e9042e67546d08c6889ee3b9beef4 2023-02-17 02:01:52,918 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/data/hbase/namespace/6f3b866d01a86f8137a760957d97815a/.tmp/info/aa5a0fd068504cd48595951cc1092e24 2023-02-17 02:01:52,922 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7b4e9042e67546d08c6889ee3b9beef4 2023-02-17 02:01:52,923 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/data/hbase/namespace/6f3b866d01a86f8137a760957d97815a/.tmp/info/aa5a0fd068504cd48595951cc1092e24 as hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/data/hbase/namespace/6f3b866d01a86f8137a760957d97815a/info/aa5a0fd068504cd48595951cc1092e24 2023-02-17 02:01:52,927 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/data/hbase/namespace/6f3b866d01a86f8137a760957d97815a/info/aa5a0fd068504cd48595951cc1092e24, entries=2, sequenceid=6, filesize=4.8 K 2023-02-17 02:01:52,928 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 6f3b866d01a86f8137a760957d97815a in 24ms, sequenceid=6, compaction requested=false 2023-02-17 02:01:52,931 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/data/hbase/namespace/6f3b866d01a86f8137a760957d97815a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-17 02:01:52,933 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676599310549.6f3b866d01a86f8137a760957d97815a. 2023-02-17 02:01:52,933 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 6f3b866d01a86f8137a760957d97815a: 2023-02-17 02:01:52,933 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676599310549.6f3b866d01a86f8137a760957d97815a. 2023-02-17 02:01:52,935 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/data/hbase/meta/1588230740/.tmp/rep_barrier/2034c4e4fa0b4918ab71d69add01b2bc 2023-02-17 02:01:52,939 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2034c4e4fa0b4918ab71d69add01b2bc 2023-02-17 02:01:52,950 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=590 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/data/hbase/meta/1588230740/.tmp/table/b6ed0e4c7b6e49acad7e8adc2a1aa414 2023-02-17 02:01:52,954 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b6ed0e4c7b6e49acad7e8adc2a1aa414 2023-02-17 02:01:52,954 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/data/hbase/meta/1588230740/.tmp/info/7b4e9042e67546d08c6889ee3b9beef4 as hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/data/hbase/meta/1588230740/info/7b4e9042e67546d08c6889ee3b9beef4 2023-02-17 02:01:52,962 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7b4e9042e67546d08c6889ee3b9beef4 2023-02-17 02:01:52,963 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/data/hbase/meta/1588230740/info/7b4e9042e67546d08c6889ee3b9beef4, entries=12, sequenceid=21, filesize=6.3 K 2023-02-17 02:01:52,963 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/data/hbase/meta/1588230740/.tmp/rep_barrier/2034c4e4fa0b4918ab71d69add01b2bc as hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/data/hbase/meta/1588230740/rep_barrier/2034c4e4fa0b4918ab71d69add01b2bc 2023-02-17 02:01:52,969 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2034c4e4fa0b4918ab71d69add01b2bc 2023-02-17 02:01:52,969 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/data/hbase/meta/1588230740/rep_barrier/2034c4e4fa0b4918ab71d69add01b2bc, entries=1, sequenceid=21, filesize=5.1 K 2023-02-17 02:01:52,970 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/data/hbase/meta/1588230740/.tmp/table/b6ed0e4c7b6e49acad7e8adc2a1aa414 as hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/data/hbase/meta/1588230740/table/b6ed0e4c7b6e49acad7e8adc2a1aa414 2023-02-17 02:01:52,973 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-17 02:01:52,974 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-17 02:01:52,979 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b6ed0e4c7b6e49acad7e8adc2a1aa414 2023-02-17 02:01:52,979 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/data/hbase/meta/1588230740/table/b6ed0e4c7b6e49acad7e8adc2a1aa414, entries=4, sequenceid=21, filesize=5.1 K 2023-02-17 02:01:52,980 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.46 KB/4572, heapSize ~7.82 KB/8008, currentSize=0 B/0 for 1588230740 in 76ms, sequenceid=21, compaction requested=false 2023-02-17 02:01:52,985 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-17 02:01:52,985 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-17 02:01:52,986 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-17 02:01:52,986 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-17 02:01:52,987 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-17 02:01:53,103 INFO [RS:1;jenkins-hbase4:43275] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,43275,1676599309990; all regions closed. 2023-02-17 02:01:53,104 INFO [RS:0;jenkins-hbase4:33613] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,33613,1676599309963; all regions closed. 2023-02-17 02:01:53,110 DEBUG [RS:0;jenkins-hbase4:33613] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/oldWALs 2023-02-17 02:01:53,110 INFO [RS:0;jenkins-hbase4:33613] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C33613%2C1676599309963.meta:.meta(num 1676599310493) 2023-02-17 02:01:53,116 DEBUG [RS:1;jenkins-hbase4:43275] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/oldWALs 2023-02-17 02:01:53,116 INFO [RS:1;jenkins-hbase4:43275] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43275%2C1676599309990:(num 1676599310896) 2023-02-17 02:01:53,116 DEBUG [RS:1;jenkins-hbase4:43275] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 02:01:53,116 INFO [RS:1;jenkins-hbase4:43275] regionserver.LeaseManager(133): Closed leases 2023-02-17 02:01:53,116 INFO [RS:1;jenkins-hbase4:43275] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-17 02:01:53,116 INFO [RS:1;jenkins-hbase4:43275] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-17 02:01:53,116 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-17 02:01:53,116 INFO [RS:1;jenkins-hbase4:43275] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-17 02:01:53,116 INFO [RS:1;jenkins-hbase4:43275] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-17 02:01:53,118 INFO [RS:1;jenkins-hbase4:43275] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43275 2023-02-17 02:01:53,119 DEBUG [RS:0;jenkins-hbase4:33613] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/oldWALs 2023-02-17 02:01:53,119 INFO [RS:0;jenkins-hbase4:33613] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C33613%2C1676599309963:(num 1676599311299) 2023-02-17 02:01:53,119 DEBUG [RS:0;jenkins-hbase4:33613] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 02:01:53,119 INFO [RS:0;jenkins-hbase4:33613] regionserver.LeaseManager(133): Closed leases 2023-02-17 02:01:53,120 INFO [RS:0;jenkins-hbase4:33613] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-17 02:01:53,120 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-17 02:01:53,121 INFO [RS:0;jenkins-hbase4:33613] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33613 2023-02-17 02:01:53,121 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): master:45095-0x1006003200a0000, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 02:01:53,121 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): regionserver:33613-0x1006003200a0001, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43275,1676599309990 2023-02-17 02:01:53,122 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): regionserver:33613-0x1006003200a0001, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 02:01:53,122 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): regionserver:43275-0x1006003200a0002, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43275,1676599309990 2023-02-17 02:01:53,122 ERROR [Listener at localhost/46505-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3f34c2af rejected from java.util.concurrent.ThreadPoolExecutor@3b0b4191[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1374) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 02:01:53,122 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): regionserver:43275-0x1006003200a0002, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 02:01:53,122 ERROR [Listener at localhost/46505-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@56854196 rejected from java.util.concurrent.ThreadPoolExecutor@3b0b4191[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 02:01:53,123 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): regionserver:43275-0x1006003200a0002, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33613,1676599309963 2023-02-17 02:01:53,123 ERROR [Listener at localhost/46505-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2e5b07ec rejected from java.util.concurrent.ThreadPoolExecutor@3b0b4191[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 02:01:53,123 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,33613,1676599309963] 2023-02-17 02:01:53,123 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,33613,1676599309963; numProcessing=1 2023-02-17 02:01:53,123 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): regionserver:33613-0x1006003200a0001, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33613,1676599309963 2023-02-17 02:01:53,123 ERROR [Listener at localhost/46505-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@10e5e5a1 rejected from java.util.concurrent.ThreadPoolExecutor@14da7365[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 02:01:53,125 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,33613,1676599309963 already deleted, retry=false 2023-02-17 02:01:53,125 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,33613,1676599309963 expired; onlineServers=1 2023-02-17 02:01:53,125 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,43275,1676599309990] 2023-02-17 02:01:53,125 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,43275,1676599309990; numProcessing=2 2023-02-17 02:01:53,126 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,43275,1676599309990 already deleted, retry=false 2023-02-17 02:01:53,126 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,43275,1676599309990 expired; onlineServers=0 2023-02-17 02:01:53,126 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,45095,1676599309917' ***** 2023-02-17 02:01:53,127 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-17 02:01:53,127 DEBUG [M:0;jenkins-hbase4:45095] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@f923d2f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-17 02:01:53,127 INFO [M:0;jenkins-hbase4:45095] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,45095,1676599309917 2023-02-17 02:01:53,127 INFO [M:0;jenkins-hbase4:45095] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,45095,1676599309917; all regions closed. 2023-02-17 02:01:53,127 DEBUG [M:0;jenkins-hbase4:45095] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 02:01:53,127 DEBUG [M:0;jenkins-hbase4:45095] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-17 02:01:53,127 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-17 02:01:53,127 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676599310141] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676599310141,5,FailOnTimeoutGroup] 2023-02-17 02:01:53,127 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676599310142] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676599310142,5,FailOnTimeoutGroup] 2023-02-17 02:01:53,127 DEBUG [M:0;jenkins-hbase4:45095] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-17 02:01:53,128 INFO [M:0;jenkins-hbase4:45095] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-17 02:01:53,129 INFO [M:0;jenkins-hbase4:45095] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-17 02:01:53,129 INFO [M:0;jenkins-hbase4:45095] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-17 02:01:53,129 DEBUG [M:0;jenkins-hbase4:45095] master.HMaster(1512): Stopping service threads 2023-02-17 02:01:53,129 INFO [M:0;jenkins-hbase4:45095] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-17 02:01:53,130 ERROR [M:0;jenkins-hbase4:45095] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-17 02:01:53,130 INFO [M:0;jenkins-hbase4:45095] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-17 02:01:53,130 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-17 02:01:53,131 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): master:45095-0x1006003200a0000, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-17 02:01:53,131 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): master:45095-0x1006003200a0000, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 02:01:53,131 DEBUG [M:0;jenkins-hbase4:45095] zookeeper.ZKUtil(398): master:45095-0x1006003200a0000, quorum=127.0.0.1:59593, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-17 02:01:53,131 WARN [M:0;jenkins-hbase4:45095] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-17 02:01:53,131 INFO [M:0;jenkins-hbase4:45095] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-17 02:01:53,132 INFO [M:0;jenkins-hbase4:45095] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-17 02:01:53,132 DEBUG [M:0;jenkins-hbase4:45095] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-17 02:01:53,132 INFO [M:0;jenkins-hbase4:45095] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 02:01:53,132 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45095-0x1006003200a0000, quorum=127.0.0.1:59593, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 02:01:53,132 DEBUG [M:0;jenkins-hbase4:45095] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 02:01:53,132 DEBUG [M:0;jenkins-hbase4:45095] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-17 02:01:53,132 DEBUG [M:0;jenkins-hbase4:45095] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 02:01:53,133 INFO [M:0;jenkins-hbase4:45095] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.67 KB heapSize=67.63 KB 2023-02-17 02:01:53,143 INFO [M:0;jenkins-hbase4:45095] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.67 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/5d30d957a1164b36a1811de0a3489b55 2023-02-17 02:01:53,147 DEBUG [M:0;jenkins-hbase4:45095] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/5d30d957a1164b36a1811de0a3489b55 as hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/5d30d957a1164b36a1811de0a3489b55 2023-02-17 02:01:53,151 INFO [M:0;jenkins-hbase4:45095] regionserver.HStore(1080): Added hdfs://localhost:38701/user/jenkins/test-data/0d9bf4c6-b85e-27f4-6e7c-7ccb076cce78/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/5d30d957a1164b36a1811de0a3489b55, entries=17, sequenceid=132, filesize=8.7 K 2023-02-17 02:01:53,152 INFO [M:0;jenkins-hbase4:45095] regionserver.HRegion(2947): Finished flush of dataSize ~56.67 KB/58028, heapSize ~67.62 KB/69240, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 20ms, sequenceid=132, compaction requested=false 2023-02-17 02:01:53,152 INFO [M:0;jenkins-hbase4:45095] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 02:01:53,153 DEBUG [M:0;jenkins-hbase4:45095] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-17 02:01:53,157 INFO [M:0;jenkins-hbase4:45095] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-17 02:01:53,157 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-17 02:01:53,157 INFO [M:0;jenkins-hbase4:45095] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45095 2023-02-17 02:01:53,159 DEBUG [M:0;jenkins-hbase4:45095] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,45095,1676599309917 already deleted, retry=false 2023-02-17 02:01:53,399 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): master:45095-0x1006003200a0000, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 02:01:53,399 INFO [M:0;jenkins-hbase4:45095] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,45095,1676599309917; zookeeper connection closed. 2023-02-17 02:01:53,399 ERROR [Listener at localhost/46505-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@109d01b4 rejected from java.util.concurrent.ThreadPoolExecutor@14a2877f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 50] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 02:01:53,400 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): master:45095-0x1006003200a0000, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 02:01:53,400 ERROR [Listener at localhost/46505-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@18d3af20 rejected from java.util.concurrent.ThreadPoolExecutor@14a2877f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 50] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 02:01:53,499 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): regionserver:33613-0x1006003200a0001, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 02:01:53,499 INFO [RS:0;jenkins-hbase4:33613] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,33613,1676599309963; zookeeper connection closed. 2023-02-17 02:01:53,500 ERROR [Listener at localhost/46505-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5f34a704 rejected from java.util.concurrent.ThreadPoolExecutor@14da7365[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 02:01:53,500 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): regionserver:33613-0x1006003200a0001, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 02:01:53,500 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@236fc53e] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@236fc53e 2023-02-17 02:01:53,500 ERROR [Listener at localhost/46505-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@27458f98 rejected from java.util.concurrent.ThreadPoolExecutor@14da7365[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 02:01:53,600 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): regionserver:43275-0x1006003200a0002, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 02:01:53,600 INFO [RS:1;jenkins-hbase4:43275] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,43275,1676599309990; zookeeper connection closed. 2023-02-17 02:01:53,600 ERROR [Listener at localhost/46505-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@62d35c78 rejected from java.util.concurrent.ThreadPoolExecutor@3b0b4191[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 02:01:53,600 DEBUG [Listener at localhost/46505-EventThread] zookeeper.ZKWatcher(600): regionserver:43275-0x1006003200a0002, quorum=127.0.0.1:59593, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 02:01:53,600 ERROR [Listener at localhost/46505-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@355facdb rejected from java.util.concurrent.ThreadPoolExecutor@3b0b4191[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 02:01:53,600 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@122d8fbf] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@122d8fbf 2023-02-17 02:01:53,600 INFO [Listener at localhost/46505] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-17 02:01:53,601 WARN [Listener at localhost/46505] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-17 02:01:53,604 INFO [Listener at localhost/46505] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-17 02:01:53,707 WARN [BP-1797704857-172.31.14.131-1676599309276 heartbeating to localhost/127.0.0.1:38701] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-17 02:01:53,707 WARN [BP-1797704857-172.31.14.131-1676599309276 heartbeating to localhost/127.0.0.1:38701] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1797704857-172.31.14.131-1676599309276 (Datanode Uuid 64d22006-ba66-4c45-aa45-1498a23b329d) service to localhost/127.0.0.1:38701 2023-02-17 02:01:53,708 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d2420a49-123a-e71b-5652-068fed1258f1/cluster_c38d1cec-c137-1d2c-a863-434836f60b00/dfs/data/data3/current/BP-1797704857-172.31.14.131-1676599309276] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 02:01:53,708 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d2420a49-123a-e71b-5652-068fed1258f1/cluster_c38d1cec-c137-1d2c-a863-434836f60b00/dfs/data/data4/current/BP-1797704857-172.31.14.131-1676599309276] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 02:01:53,710 WARN [Listener at localhost/46505] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-17 02:01:53,715 INFO [Listener at localhost/46505] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-17 02:01:53,718 WARN [BP-1797704857-172.31.14.131-1676599309276 heartbeating to localhost/127.0.0.1:38701] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-17 02:01:53,719 WARN [BP-1797704857-172.31.14.131-1676599309276 heartbeating to localhost/127.0.0.1:38701] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1797704857-172.31.14.131-1676599309276 (Datanode Uuid c2f4c1d0-a3b9-4d55-81a7-8492962efb5f) service to localhost/127.0.0.1:38701 2023-02-17 02:01:53,720 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d2420a49-123a-e71b-5652-068fed1258f1/cluster_c38d1cec-c137-1d2c-a863-434836f60b00/dfs/data/data1/current/BP-1797704857-172.31.14.131-1676599309276] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 02:01:53,720 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d2420a49-123a-e71b-5652-068fed1258f1/cluster_c38d1cec-c137-1d2c-a863-434836f60b00/dfs/data/data2/current/BP-1797704857-172.31.14.131-1676599309276] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 02:01:53,730 INFO [Listener at localhost/46505] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-17 02:01:53,843 INFO [Listener at localhost/46505] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-17 02:01:53,863 INFO [Listener at localhost/46505] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-17 02:01:53,875 INFO [Listener at localhost/46505] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=274 (was 254) Potentially hanging thread: RS-EventLoopGroup-20-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1508527786) connection to localhost/127.0.0.1:38701 from jenkins.hfs.10 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins.hfs.11@localhost:38701 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/46505 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1508527786) connection to localhost/127.0.0.1:38701 from jenkins.hfs.11 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-25-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-15 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.10@localhost:38701 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,45095,1676599309917)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1508527786) connection to localhost/127.0.0.1:38701 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins@localhost:38701 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-16 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1508527786) connection to localhost/127.0.0.1:38701 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-24-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=571 (was 641), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=409 (was 392) - SystemLoadAverage LEAK? -, ProcessCount=170 (was 170), AvailableMemoryMB=7304 (was 7358) 2023-02-17 02:01:53,886 INFO [Listener at localhost/46505] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=274, OpenFileDescriptor=571, MaxFileDescriptor=60000, SystemLoadAverage=409, ProcessCount=170, AvailableMemoryMB=7304 2023-02-17 02:01:53,897 INFO [Listener at localhost/46505] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d2420a49-123a-e71b-5652-068fed1258f1/hadoop.log.dir so I do NOT create it in target/test-data/1aafa483-04ba-e0d5-ce04-237121cc5150 2023-02-17 02:01:53,897 WARN [Listener at localhost/46505] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d2420a49-123a-e71b-5652-068fed1258f1/hadoop.log.dir Erasing configuration value by system value. 2023-02-17 02:01:53,897 INFO [Listener at localhost/46505] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d2420a49-123a-e71b-5652-068fed1258f1/hadoop.tmp.dir so I do NOT create it in target/test-data/1aafa483-04ba-e0d5-ce04-237121cc5150 2023-02-17 02:01:53,897 WARN [Listener at localhost/46505] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d2420a49-123a-e71b-5652-068fed1258f1/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-17 02:01:53,897 DEBUG [Listener at localhost/46505] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1aafa483-04ba-e0d5-ce04-237121cc5150 2023-02-17 02:01:53,897 INFO [Listener at localhost/46505] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-17 02:01:53,897 INFO [Listener at localhost/46505] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1aafa483-04ba-e0d5-ce04-237121cc5150/cluster_4abcf842-dded-f43f-7778-dcf88f92c4ba, deleteOnExit=true 2023-02-17 02:01:53,897 INFO [Listener at localhost/46505] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-17 02:01:53,898 INFO [Listener at localhost/46505] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1aafa483-04ba-e0d5-ce04-237121cc5150/test.cache.data in system properties and HBase conf 2023-02-17 02:01:53,898 INFO [Listener at localhost/46505] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1aafa483-04ba-e0d5-ce04-237121cc5150/hadoop.tmp.dir in system properties and HBase conf 2023-02-17 02:01:53,898 INFO [Listener at localhost/46505] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1aafa483-04ba-e0d5-ce04-237121cc5150/hadoop.log.dir in system properties and HBase conf 2023-02-17 02:01:53,898 INFO [Listener at localhost/46505] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1aafa483-04ba-e0d5-ce04-237121cc5150/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-17 02:01:53,898 INFO [Listener at localhost/46505] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1aafa483-04ba-e0d5-ce04-237121cc5150/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-17 02:01:53,898 INFO [Listener at localhost/46505] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-17 02:01:53,898 DEBUG [Listener at localhost/46505] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-17 02:01:53,898 INFO [Listener at localhost/46505] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1aafa483-04ba-e0d5-ce04-237121cc5150/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-17 02:01:53,899 INFO [Listener at localhost/46505] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1aafa483-04ba-e0d5-ce04-237121cc5150/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-17 02:01:53,899 INFO [Listener at localhost/46505] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1aafa483-04ba-e0d5-ce04-237121cc5150/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-17 02:01:53,899 INFO [Listener at localhost/46505] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1aafa483-04ba-e0d5-ce04-237121cc5150/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-17 02:01:53,899 INFO [Listener at localhost/46505] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1aafa483-04ba-e0d5-ce04-237121cc5150/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-17 02:01:53,899 INFO [Listener at localhost/46505] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1aafa483-04ba-e0d5-ce04-237121cc5150/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-17 02:01:53,899 INFO [Listener at localhost/46505] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1aafa483-04ba-e0d5-ce04-237121cc5150/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-17 02:01:53,899 INFO [Listener at localhost/46505] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1aafa483-04ba-e0d5-ce04-237121cc5150/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-17 02:01:53,900 INFO [Listener at localhost/46505] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1aafa483-04ba-e0d5-ce04-237121cc5150/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-17 02:01:53,900 INFO [Listener at localhost/46505] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1aafa483-04ba-e0d5-ce04-237121cc5150/nfs.dump.dir in system properties and HBase conf 2023-02-17 02:01:53,900 INFO [Listener at localhost/46505] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1aafa483-04ba-e0d5-ce04-237121cc5150/java.io.tmpdir in system properties and HBase conf 2023-02-17 02:01:53,900 INFO [Listener at localhost/46505] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1aafa483-04ba-e0d5-ce04-237121cc5150/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-17 02:01:53,900 INFO [Listener at localhost/46505] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1aafa483-04ba-e0d5-ce04-237121cc5150/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-17 02:01:53,900 INFO [Listener at localhost/46505] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1aafa483-04ba-e0d5-ce04-237121cc5150/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-17 02:01:53,904 WARN [Listener at localhost/46505] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-17 02:01:53,904 WARN [Listener at localhost/46505] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-17 02:01:53,947 WARN [Listener at localhost/46505] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-17 02:01:53,949 INFO [Listener at localhost/46505] log.Slf4jLog(67): jetty-6.1.26 2023-02-17 02:01:53,956 INFO [Listener at localhost/46505] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1aafa483-04ba-e0d5-ce04-237121cc5150/java.io.tmpdir/Jetty_localhost_42793_hdfs____5zry7x/webapp 2023-02-17 02:01:54,055 INFO [Listener at localhost/46505] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42793 2023-02-17 02:01:54,060 WARN [Listener at localhost/46505] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-17 02:01:54,060 WARN [Listener at localhost/46505] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-17 02:01:54,101 WARN [Listener at localhost/34757] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-17 02:01:54,119 WARN [Listener at localhost/34757] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-17 02:01:54,123 WARN [Listener at localhost/34757] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-17 02:01:54,124 INFO [Listener at localhost/34757] log.Slf4jLog(67): jetty-6.1.26 2023-02-17 02:01:54,130 INFO [Listener at localhost/34757] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1aafa483-04ba-e0d5-ce04-237121cc5150/java.io.tmpdir/Jetty_localhost_37489_datanode____.857adk/webapp 2023-02-17 02:01:54,230 INFO [Listener at localhost/34757] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37489 2023-02-17 02:01:54,237 WARN [Listener at localhost/42417] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-17 02:01:54,251 WARN [Listener at localhost/42417] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-17 02:01:54,253 WARN [Listener at localhost/42417] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-17 02:01:54,254 INFO [Listener at localhost/42417] log.Slf4jLog(67): jetty-6.1.26 2023-02-17 02:01:54,258 INFO [Listener at localhost/42417] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1aafa483-04ba-e0d5-ce04-237121cc5150/java.io.tmpdir/Jetty_localhost_41617_datanode____.u3lnq2/webapp 2023-02-17 02:01:54,346 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x98b2b63bda1d4218: Processing first storage report for DS-7128c6b4-a901-4c60-85fd-301443750cd0 from datanode 5caa03aa-659e-4a74-8f00-37ea31281f1b 2023-02-17 02:01:54,346 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x98b2b63bda1d4218: from storage DS-7128c6b4-a901-4c60-85fd-301443750cd0 node DatanodeRegistration(127.0.0.1:41633, datanodeUuid=5caa03aa-659e-4a74-8f00-37ea31281f1b, infoPort=43413, infoSecurePort=0, ipcPort=42417, storageInfo=lv=-57;cid=testClusterID;nsid=841239320;c=1676599313907), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-17 02:01:54,346 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x98b2b63bda1d4218: Processing first storage report for DS-cbed2680-669e-4ed1-a979-06953560ce9a from datanode 5caa03aa-659e-4a74-8f00-37ea31281f1b 2023-02-17 02:01:54,346 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x98b2b63bda1d4218: from storage DS-cbed2680-669e-4ed1-a979-06953560ce9a node DatanodeRegistration(127.0.0.1:41633, datanodeUuid=5caa03aa-659e-4a74-8f00-37ea31281f1b, infoPort=43413, infoSecurePort=0, ipcPort=42417, storageInfo=lv=-57;cid=testClusterID;nsid=841239320;c=1676599313907), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-17 02:01:54,368 INFO [Listener at localhost/42417] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41617 2023-02-17 02:01:54,376 WARN [Listener at localhost/33057] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-17 02:01:54,463 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x9ae42946243fc911: Processing first storage report for DS-a5a87e30-32b5-416c-b6e5-2c9c6d132fe0 from datanode 030749ce-642c-4182-8c13-a582f74609e8 2023-02-17 02:01:54,464 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x9ae42946243fc911: from storage DS-a5a87e30-32b5-416c-b6e5-2c9c6d132fe0 node DatanodeRegistration(127.0.0.1:34265, datanodeUuid=030749ce-642c-4182-8c13-a582f74609e8, infoPort=43283, infoSecurePort=0, ipcPort=33057, storageInfo=lv=-57;cid=testClusterID;nsid=841239320;c=1676599313907), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-17 02:01:54,464 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x9ae42946243fc911: Processing first storage report for DS-cf2019fa-06bc-4b02-93c0-cd46b6ddd9ac from datanode 030749ce-642c-4182-8c13-a582f74609e8 2023-02-17 02:01:54,464 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x9ae42946243fc911: from storage DS-cf2019fa-06bc-4b02-93c0-cd46b6ddd9ac node DatanodeRegistration(127.0.0.1:34265, datanodeUuid=030749ce-642c-4182-8c13-a582f74609e8, infoPort=43283, infoSecurePort=0, ipcPort=33057, storageInfo=lv=-57;cid=testClusterID;nsid=841239320;c=1676599313907), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-17 02:01:54,485 DEBUG [Listener at localhost/33057] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1aafa483-04ba-e0d5-ce04-237121cc5150 2023-02-17 02:01:54,488 INFO [Listener at localhost/33057] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1aafa483-04ba-e0d5-ce04-237121cc5150/cluster_4abcf842-dded-f43f-7778-dcf88f92c4ba/zookeeper_0, clientPort=62388, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1aafa483-04ba-e0d5-ce04-237121cc5150/cluster_4abcf842-dded-f43f-7778-dcf88f92c4ba/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1aafa483-04ba-e0d5-ce04-237121cc5150/cluster_4abcf842-dded-f43f-7778-dcf88f92c4ba/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-17 02:01:54,490 INFO [Listener at localhost/33057] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=62388 2023-02-17 02:01:54,490 INFO [Listener at localhost/33057] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 02:01:54,491 INFO [Listener at localhost/33057] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 02:01:54,518 INFO [Listener at localhost/33057] util.FSUtils(479): Created version file at hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093 with version=8 2023-02-17 02:01:54,518 INFO [Listener at localhost/33057] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 02:01:54,519 INFO [Listener at localhost/33057] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 02:01:54,520 INFO [Listener at localhost/33057] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:34757/user/jenkins/test-data/f6e3e3cf-7367-9bf2-0355-df0d1fed2364/hbase-staging 2023-02-17 02:01:54,522 INFO [Listener at localhost/33057] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-17 02:01:54,522 INFO [Listener at localhost/33057] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 02:01:54,523 INFO [Listener at localhost/33057] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-17 02:01:54,523 INFO [Listener at localhost/33057] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-17 02:01:54,523 INFO [Listener at localhost/33057] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 02:01:54,523 INFO [Listener at localhost/33057] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-17 02:01:54,523 INFO [Listener at localhost/33057] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-17 02:01:54,524 INFO [Listener at localhost/33057] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41135 2023-02-17 02:01:54,524 INFO [Listener at localhost/33057] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 02:01:54,525 INFO [Listener at localhost/33057] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 02:01:54,526 INFO [Listener at localhost/33057] zookeeper.RecoverableZooKeeper(93): Process identifier=master:41135 connecting to ZooKeeper ensemble=127.0.0.1:62388 2023-02-17 02:01:54,539 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): master:411350x0, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-17 02:01:54,541 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:41135-0x100600331fd0000 connected 2023-02-17 02:01:54,563 DEBUG [Listener at localhost/33057] zookeeper.ZKUtil(164): master:41135-0x100600331fd0000, quorum=127.0.0.1:62388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 02:01:54,564 DEBUG [Listener at localhost/33057] zookeeper.ZKUtil(164): master:41135-0x100600331fd0000, quorum=127.0.0.1:62388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 02:01:54,564 DEBUG [Listener at localhost/33057] zookeeper.ZKUtil(164): master:41135-0x100600331fd0000, quorum=127.0.0.1:62388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-17 02:01:54,564 DEBUG [Listener at localhost/33057] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41135 2023-02-17 02:01:54,565 DEBUG [Listener at localhost/33057] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41135 2023-02-17 02:01:54,565 DEBUG [Listener at localhost/33057] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41135 2023-02-17 02:01:54,565 DEBUG [Listener at localhost/33057] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41135 2023-02-17 02:01:54,565 DEBUG [Listener at localhost/33057] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41135 2023-02-17 02:01:54,565 INFO [Listener at localhost/33057] master.HMaster(444): hbase.rootdir=hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093, hbase.cluster.distributed=false 2023-02-17 02:01:54,577 INFO [Listener at localhost/33057] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-17 02:01:54,578 INFO [Listener at localhost/33057] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 02:01:54,578 INFO [Listener at localhost/33057] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-17 02:01:54,578 INFO [Listener at localhost/33057] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-17 02:01:54,578 INFO [Listener at localhost/33057] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 02:01:54,578 INFO [Listener at localhost/33057] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-17 02:01:54,578 INFO [Listener at localhost/33057] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-17 02:01:54,579 INFO [Listener at localhost/33057] ipc.NettyRpcServer(120): Bind to /172.31.14.131:32797 2023-02-17 02:01:54,579 INFO [Listener at localhost/33057] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-17 02:01:54,579 DEBUG [Listener at localhost/33057] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 02:01:54,580 INFO [Listener at localhost/33057] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 02:01:54,581 INFO [Listener at localhost/33057] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 02:01:54,581 INFO [Listener at localhost/33057] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:32797 connecting to ZooKeeper ensemble=127.0.0.1:62388 2023-02-17 02:01:54,584 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): regionserver:327970x0, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-17 02:01:54,586 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:32797-0x100600331fd0001 connected 2023-02-17 02:01:54,586 DEBUG [Listener at localhost/33057] zookeeper.ZKUtil(164): regionserver:32797-0x100600331fd0001, quorum=127.0.0.1:62388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 02:01:54,587 DEBUG [Listener at localhost/33057] zookeeper.ZKUtil(164): regionserver:32797-0x100600331fd0001, quorum=127.0.0.1:62388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 02:01:54,587 DEBUG [Listener at localhost/33057] zookeeper.ZKUtil(164): regionserver:32797-0x100600331fd0001, quorum=127.0.0.1:62388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-17 02:01:54,588 DEBUG [Listener at localhost/33057] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=32797 2023-02-17 02:01:54,588 DEBUG [Listener at localhost/33057] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=32797 2023-02-17 02:01:54,588 DEBUG [Listener at localhost/33057] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=32797 2023-02-17 02:01:54,589 DEBUG [Listener at localhost/33057] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=32797 2023-02-17 02:01:54,589 DEBUG [Listener at localhost/33057] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=32797 2023-02-17 02:01:54,600 INFO [Listener at localhost/33057] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-17 02:01:54,600 INFO [Listener at localhost/33057] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 02:01:54,600 INFO [Listener at localhost/33057] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-17 02:01:54,600 INFO [Listener at localhost/33057] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-17 02:01:54,600 INFO [Listener at localhost/33057] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 02:01:54,600 INFO [Listener at localhost/33057] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-17 02:01:54,600 INFO [Listener at localhost/33057] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-17 02:01:54,601 INFO [Listener at localhost/33057] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44839 2023-02-17 02:01:54,601 INFO [Listener at localhost/33057] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-17 02:01:54,602 DEBUG [Listener at localhost/33057] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 02:01:54,602 INFO [Listener at localhost/33057] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 02:01:54,603 INFO [Listener at localhost/33057] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 02:01:54,604 INFO [Listener at localhost/33057] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44839 connecting to ZooKeeper ensemble=127.0.0.1:62388 2023-02-17 02:01:54,606 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): regionserver:448390x0, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-17 02:01:54,606 DEBUG [Listener at localhost/33057] zookeeper.ZKUtil(164): regionserver:448390x0, quorum=127.0.0.1:62388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 02:01:54,607 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:44839-0x100600331fd0002 connected 2023-02-17 02:01:54,607 DEBUG [Listener at localhost/33057] zookeeper.ZKUtil(164): regionserver:44839-0x100600331fd0002, quorum=127.0.0.1:62388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 02:01:54,607 DEBUG [Listener at localhost/33057] zookeeper.ZKUtil(164): regionserver:44839-0x100600331fd0002, quorum=127.0.0.1:62388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-17 02:01:54,608 DEBUG [Listener at localhost/33057] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44839 2023-02-17 02:01:54,608 DEBUG [Listener at localhost/33057] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44839 2023-02-17 02:01:54,608 DEBUG [Listener at localhost/33057] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44839 2023-02-17 02:01:54,608 DEBUG [Listener at localhost/33057] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44839 2023-02-17 02:01:54,609 DEBUG [Listener at localhost/33057] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44839 2023-02-17 02:01:54,610 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,41135,1676599314522 2023-02-17 02:01:54,611 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): master:41135-0x100600331fd0000, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-17 02:01:54,612 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41135-0x100600331fd0000, quorum=127.0.0.1:62388, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,41135,1676599314522 2023-02-17 02:01:54,617 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): master:41135-0x100600331fd0000, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-17 02:01:54,617 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): regionserver:32797-0x100600331fd0001, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-17 02:01:54,617 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): master:41135-0x100600331fd0000, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 02:01:54,617 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): regionserver:44839-0x100600331fd0002, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-17 02:01:54,619 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41135-0x100600331fd0000, quorum=127.0.0.1:62388, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-17 02:01:54,621 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,41135,1676599314522 from backup master directory 2023-02-17 02:01:54,621 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:41135-0x100600331fd0000, quorum=127.0.0.1:62388, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-17 02:01:54,622 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): master:41135-0x100600331fd0000, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,41135,1676599314522 2023-02-17 02:01:54,622 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): master:41135-0x100600331fd0000, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-17 02:01:54,622 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-17 02:01:54,622 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,41135,1676599314522 2023-02-17 02:01:54,631 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/hbase.id with ID: 6569f8f7-15d7-4728-b895-d67725d1efee 2023-02-17 02:01:54,638 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 02:01:54,640 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): master:41135-0x100600331fd0000, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 02:01:54,646 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x06acc226 to 127.0.0.1:62388 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 02:01:54,649 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7a031e58, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 02:01:54,649 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-17 02:01:54,649 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-17 02:01:54,650 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 02:01:54,651 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/MasterData/data/master/store-tmp 2023-02-17 02:01:54,656 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:54,657 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-17 02:01:54,657 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 02:01:54,657 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 02:01:54,657 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-17 02:01:54,657 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 02:01:54,657 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 02:01:54,657 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-17 02:01:54,657 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/MasterData/WALs/jenkins-hbase4.apache.org,41135,1676599314522 2023-02-17 02:01:54,659 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41135%2C1676599314522, suffix=, logDir=hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/MasterData/WALs/jenkins-hbase4.apache.org,41135,1676599314522, archiveDir=hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/MasterData/oldWALs, maxLogs=10 2023-02-17 02:01:54,672 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41633,DS-7128c6b4-a901-4c60-85fd-301443750cd0,DISK] 2023-02-17 02:01:54,672 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34265,DS-a5a87e30-32b5-416c-b6e5-2c9c6d132fe0,DISK] 2023-02-17 02:01:54,673 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/MasterData/WALs/jenkins-hbase4.apache.org,41135,1676599314522/jenkins-hbase4.apache.org%2C41135%2C1676599314522.1676599314659 2023-02-17 02:01:54,674 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41633,DS-7128c6b4-a901-4c60-85fd-301443750cd0,DISK], DatanodeInfoWithStorage[127.0.0.1:34265,DS-a5a87e30-32b5-416c-b6e5-2c9c6d132fe0,DISK]] 2023-02-17 02:01:54,674 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-17 02:01:54,674 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:54,674 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-17 02:01:54,674 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-17 02:01:54,675 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-17 02:01:54,676 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-17 02:01:54,676 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-17 02:01:54,677 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:54,677 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-17 02:01:54,678 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-17 02:01:54,679 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-17 02:01:54,681 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 02:01:54,681 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64673748, jitterRate=-0.03628605604171753}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-17 02:01:54,681 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-17 02:01:54,681 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-17 02:01:54,683 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-17 02:01:54,683 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-17 02:01:54,683 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-17 02:01:54,683 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-17 02:01:54,683 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-17 02:01:54,683 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-17 02:01:54,684 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-17 02:01:54,685 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-17 02:01:54,695 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-17 02:01:54,695 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-17 02:01:54,695 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41135-0x100600331fd0000, quorum=127.0.0.1:62388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-17 02:01:54,695 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-17 02:01:54,696 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41135-0x100600331fd0000, quorum=127.0.0.1:62388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-17 02:01:54,699 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): master:41135-0x100600331fd0000, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 02:01:54,699 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41135-0x100600331fd0000, quorum=127.0.0.1:62388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-17 02:01:54,699 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41135-0x100600331fd0000, quorum=127.0.0.1:62388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-17 02:01:54,700 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41135-0x100600331fd0000, quorum=127.0.0.1:62388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-17 02:01:54,701 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): master:41135-0x100600331fd0000, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-17 02:01:54,701 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): regionserver:32797-0x100600331fd0001, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-17 02:01:54,702 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): master:41135-0x100600331fd0000, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 02:01:54,702 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): regionserver:44839-0x100600331fd0002, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-17 02:01:54,705 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,41135,1676599314522, sessionid=0x100600331fd0000, setting cluster-up flag (Was=false) 2023-02-17 02:01:54,708 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): master:41135-0x100600331fd0000, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 02:01:54,713 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-17 02:01:54,714 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,41135,1676599314522 2023-02-17 02:01:54,718 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): master:41135-0x100600331fd0000, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 02:01:54,723 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-17 02:01:54,723 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,41135,1676599314522 2023-02-17 02:01:54,724 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/.hbase-snapshot/.tmp 2023-02-17 02:01:54,726 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-17 02:01:54,726 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-17 02:01:54,726 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-17 02:01:54,726 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-17 02:01:54,726 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-17 02:01:54,726 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-17 02:01:54,726 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:54,726 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-17 02:01:54,726 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:54,729 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676599344728 2023-02-17 02:01:54,729 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-17 02:01:54,729 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-17 02:01:54,729 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-17 02:01:54,730 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-17 02:01:54,730 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-17 02:01:54,730 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-17 02:01:54,730 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-17 02:01:54,730 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-17 02:01:54,730 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:54,730 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-17 02:01:54,731 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-17 02:01:54,731 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-17 02:01:54,732 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-17 02:01:54,732 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-17 02:01:54,732 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-17 02:01:54,732 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676599314732,5,FailOnTimeoutGroup] 2023-02-17 02:01:54,732 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676599314732,5,FailOnTimeoutGroup] 2023-02-17 02:01:54,732 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:54,732 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-17 02:01:54,732 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:54,732 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:54,740 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-17 02:01:54,740 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-17 02:01:54,741 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093 2023-02-17 02:01:54,746 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:54,747 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-17 02:01:54,748 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/data/hbase/meta/1588230740/info 2023-02-17 02:01:54,748 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-17 02:01:54,748 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:54,748 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-17 02:01:54,749 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/data/hbase/meta/1588230740/rep_barrier 2023-02-17 02:01:54,749 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-17 02:01:54,750 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:54,750 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-17 02:01:54,750 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/data/hbase/meta/1588230740/table 2023-02-17 02:01:54,751 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-17 02:01:54,751 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:54,751 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/data/hbase/meta/1588230740 2023-02-17 02:01:54,752 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/data/hbase/meta/1588230740 2023-02-17 02:01:54,753 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-17 02:01:54,753 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-17 02:01:54,755 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 02:01:54,755 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65816846, jitterRate=-0.01925256848335266}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-17 02:01:54,755 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-17 02:01:54,755 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-17 02:01:54,755 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-17 02:01:54,755 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-17 02:01:54,755 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-17 02:01:54,755 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-17 02:01:54,755 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-17 02:01:54,755 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-17 02:01:54,756 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-17 02:01:54,756 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-17 02:01:54,756 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-17 02:01:54,757 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-17 02:01:54,758 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-17 02:01:54,811 INFO [RS:0;jenkins-hbase4:32797] regionserver.HRegionServer(952): ClusterId : 6569f8f7-15d7-4728-b895-d67725d1efee 2023-02-17 02:01:54,811 INFO [RS:1;jenkins-hbase4:44839] regionserver.HRegionServer(952): ClusterId : 6569f8f7-15d7-4728-b895-d67725d1efee 2023-02-17 02:01:54,811 DEBUG [RS:0;jenkins-hbase4:32797] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-17 02:01:54,811 DEBUG [RS:1;jenkins-hbase4:44839] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-17 02:01:54,813 DEBUG [RS:0;jenkins-hbase4:32797] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-17 02:01:54,813 DEBUG [RS:0;jenkins-hbase4:32797] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-17 02:01:54,813 DEBUG [RS:1;jenkins-hbase4:44839] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-17 02:01:54,813 DEBUG [RS:1;jenkins-hbase4:44839] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-17 02:01:54,815 DEBUG [RS:0;jenkins-hbase4:32797] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-17 02:01:54,816 DEBUG [RS:1;jenkins-hbase4:44839] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-17 02:01:54,817 DEBUG [RS:0;jenkins-hbase4:32797] zookeeper.ReadOnlyZKClient(139): Connect 0x7dd4b618 to 127.0.0.1:62388 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 02:01:54,817 DEBUG [RS:1;jenkins-hbase4:44839] zookeeper.ReadOnlyZKClient(139): Connect 0x59c56f0f to 127.0.0.1:62388 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 02:01:54,820 DEBUG [RS:0;jenkins-hbase4:32797] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@731347d2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 02:01:54,820 DEBUG [RS:1;jenkins-hbase4:44839] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@57028a47, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 02:01:54,820 DEBUG [RS:0;jenkins-hbase4:32797] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@772cdd68, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-17 02:01:54,820 DEBUG [RS:1;jenkins-hbase4:44839] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@533d047f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-17 02:01:54,829 DEBUG [RS:0;jenkins-hbase4:32797] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:32797 2023-02-17 02:01:54,829 DEBUG [RS:1;jenkins-hbase4:44839] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:44839 2023-02-17 02:01:54,829 INFO [RS:0;jenkins-hbase4:32797] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-17 02:01:54,829 INFO [RS:0;jenkins-hbase4:32797] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-17 02:01:54,829 INFO [RS:1;jenkins-hbase4:44839] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-17 02:01:54,829 INFO [RS:1;jenkins-hbase4:44839] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-17 02:01:54,830 DEBUG [RS:1;jenkins-hbase4:44839] regionserver.HRegionServer(1023): About to register with Master. 2023-02-17 02:01:54,829 DEBUG [RS:0;jenkins-hbase4:32797] regionserver.HRegionServer(1023): About to register with Master. 2023-02-17 02:01:54,830 INFO [RS:1;jenkins-hbase4:44839] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,41135,1676599314522 with isa=jenkins-hbase4.apache.org/172.31.14.131:44839, startcode=1676599314599 2023-02-17 02:01:54,830 INFO [RS:0;jenkins-hbase4:32797] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,41135,1676599314522 with isa=jenkins-hbase4.apache.org/172.31.14.131:32797, startcode=1676599314577 2023-02-17 02:01:54,830 DEBUG [RS:1;jenkins-hbase4:44839] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-17 02:01:54,830 DEBUG [RS:0;jenkins-hbase4:32797] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-17 02:01:54,832 INFO [RS-EventLoopGroup-21-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41985, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.13 (auth:SIMPLE), service=RegionServerStatusService 2023-02-17 02:01:54,832 INFO [RS-EventLoopGroup-21-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54085, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.12 (auth:SIMPLE), service=RegionServerStatusService 2023-02-17 02:01:54,834 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41135] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,44839,1676599314599 2023-02-17 02:01:54,834 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41135] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,32797,1676599314577 2023-02-17 02:01:54,835 DEBUG [RS:1;jenkins-hbase4:44839] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093 2023-02-17 02:01:54,835 DEBUG [RS:1;jenkins-hbase4:44839] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:34757 2023-02-17 02:01:54,835 DEBUG [RS:1;jenkins-hbase4:44839] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-17 02:01:54,835 DEBUG [RS:0;jenkins-hbase4:32797] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093 2023-02-17 02:01:54,835 DEBUG [RS:0;jenkins-hbase4:32797] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:34757 2023-02-17 02:01:54,835 DEBUG [RS:0;jenkins-hbase4:32797] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-17 02:01:54,837 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): master:41135-0x100600331fd0000, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 02:01:54,843 DEBUG [RS:1;jenkins-hbase4:44839] zookeeper.ZKUtil(162): regionserver:44839-0x100600331fd0002, quorum=127.0.0.1:62388, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44839,1676599314599 2023-02-17 02:01:54,843 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,32797,1676599314577] 2023-02-17 02:01:54,843 WARN [RS:1;jenkins-hbase4:44839] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-17 02:01:54,843 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,44839,1676599314599] 2023-02-17 02:01:54,844 INFO [RS:1;jenkins-hbase4:44839] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 02:01:54,844 DEBUG [RS:0;jenkins-hbase4:32797] zookeeper.ZKUtil(162): regionserver:32797-0x100600331fd0001, quorum=127.0.0.1:62388, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,32797,1676599314577 2023-02-17 02:01:54,844 DEBUG [RS:1;jenkins-hbase4:44839] regionserver.HRegionServer(1947): logDir=hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/WALs/jenkins-hbase4.apache.org,44839,1676599314599 2023-02-17 02:01:54,844 WARN [RS:0;jenkins-hbase4:32797] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-17 02:01:54,844 INFO [RS:0;jenkins-hbase4:32797] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 02:01:54,844 DEBUG [RS:0;jenkins-hbase4:32797] regionserver.HRegionServer(1947): logDir=hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/WALs/jenkins-hbase4.apache.org,32797,1676599314577 2023-02-17 02:01:54,850 DEBUG [RS:1;jenkins-hbase4:44839] zookeeper.ZKUtil(162): regionserver:44839-0x100600331fd0002, quorum=127.0.0.1:62388, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,32797,1676599314577 2023-02-17 02:01:54,850 DEBUG [RS:0;jenkins-hbase4:32797] zookeeper.ZKUtil(162): regionserver:32797-0x100600331fd0001, quorum=127.0.0.1:62388, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,32797,1676599314577 2023-02-17 02:01:54,850 DEBUG [RS:1;jenkins-hbase4:44839] zookeeper.ZKUtil(162): regionserver:44839-0x100600331fd0002, quorum=127.0.0.1:62388, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44839,1676599314599 2023-02-17 02:01:54,850 DEBUG [RS:0;jenkins-hbase4:32797] zookeeper.ZKUtil(162): regionserver:32797-0x100600331fd0001, quorum=127.0.0.1:62388, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44839,1676599314599 2023-02-17 02:01:54,851 DEBUG [RS:1;jenkins-hbase4:44839] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-17 02:01:54,851 DEBUG [RS:0;jenkins-hbase4:32797] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-17 02:01:54,851 INFO [RS:1;jenkins-hbase4:44839] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-17 02:01:54,852 INFO [RS:0;jenkins-hbase4:32797] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-17 02:01:54,852 INFO [RS:1;jenkins-hbase4:44839] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-17 02:01:54,853 INFO [RS:1;jenkins-hbase4:44839] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-17 02:01:54,853 INFO [RS:1;jenkins-hbase4:44839] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:54,856 INFO [RS:0;jenkins-hbase4:32797] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-17 02:01:54,856 INFO [RS:1;jenkins-hbase4:44839] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-17 02:01:54,859 INFO [RS:0;jenkins-hbase4:32797] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-17 02:01:54,859 INFO [RS:0;jenkins-hbase4:32797] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:54,859 INFO [RS:0;jenkins-hbase4:32797] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-17 02:01:54,866 INFO [RS:1;jenkins-hbase4:44839] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:54,866 DEBUG [RS:1;jenkins-hbase4:44839] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:54,866 DEBUG [RS:1;jenkins-hbase4:44839] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:54,866 DEBUG [RS:1;jenkins-hbase4:44839] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:54,866 DEBUG [RS:1;jenkins-hbase4:44839] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:54,867 DEBUG [RS:1;jenkins-hbase4:44839] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:54,867 DEBUG [RS:1;jenkins-hbase4:44839] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-17 02:01:54,867 DEBUG [RS:1;jenkins-hbase4:44839] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:54,867 DEBUG [RS:1;jenkins-hbase4:44839] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:54,867 DEBUG [RS:1;jenkins-hbase4:44839] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:54,867 DEBUG [RS:1;jenkins-hbase4:44839] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:54,868 INFO [RS:1;jenkins-hbase4:44839] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:54,869 INFO [RS:1;jenkins-hbase4:44839] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:54,869 INFO [RS:1;jenkins-hbase4:44839] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:54,888 INFO [RS:0;jenkins-hbase4:32797] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:54,888 DEBUG [RS:0;jenkins-hbase4:32797] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:54,888 DEBUG [RS:0;jenkins-hbase4:32797] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:54,888 DEBUG [RS:0;jenkins-hbase4:32797] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:54,888 DEBUG [RS:0;jenkins-hbase4:32797] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:54,888 DEBUG [RS:0;jenkins-hbase4:32797] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:54,889 DEBUG [RS:0;jenkins-hbase4:32797] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-17 02:01:54,889 DEBUG [RS:0;jenkins-hbase4:32797] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:54,889 DEBUG [RS:0;jenkins-hbase4:32797] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:54,889 DEBUG [RS:0;jenkins-hbase4:32797] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:54,889 DEBUG [RS:0;jenkins-hbase4:32797] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 02:01:54,891 INFO [RS:1;jenkins-hbase4:44839] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-17 02:01:54,891 INFO [RS:1;jenkins-hbase4:44839] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44839,1676599314599-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:54,892 INFO [RS:0;jenkins-hbase4:32797] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:54,892 INFO [RS:0;jenkins-hbase4:32797] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:54,892 INFO [RS:0;jenkins-hbase4:32797] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:54,904 INFO [RS:1;jenkins-hbase4:44839] regionserver.Replication(203): jenkins-hbase4.apache.org,44839,1676599314599 started 2023-02-17 02:01:54,904 INFO [RS:1;jenkins-hbase4:44839] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,44839,1676599314599, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:44839, sessionid=0x100600331fd0002 2023-02-17 02:01:54,904 DEBUG [RS:1;jenkins-hbase4:44839] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-17 02:01:54,904 DEBUG [RS:1;jenkins-hbase4:44839] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,44839,1676599314599 2023-02-17 02:01:54,904 DEBUG [RS:1;jenkins-hbase4:44839] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44839,1676599314599' 2023-02-17 02:01:54,904 DEBUG [RS:1;jenkins-hbase4:44839] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 02:01:54,905 DEBUG [RS:1;jenkins-hbase4:44839] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 02:01:54,905 DEBUG [RS:1;jenkins-hbase4:44839] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-17 02:01:54,905 DEBUG [RS:1;jenkins-hbase4:44839] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-17 02:01:54,905 DEBUG [RS:1;jenkins-hbase4:44839] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,44839,1676599314599 2023-02-17 02:01:54,905 DEBUG [RS:1;jenkins-hbase4:44839] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44839,1676599314599' 2023-02-17 02:01:54,905 DEBUG [RS:1;jenkins-hbase4:44839] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 02:01:54,906 DEBUG [RS:1;jenkins-hbase4:44839] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 02:01:54,906 DEBUG [RS:1;jenkins-hbase4:44839] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-17 02:01:54,906 INFO [RS:1;jenkins-hbase4:44839] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-17 02:01:54,906 INFO [RS:1;jenkins-hbase4:44839] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-17 02:01:54,907 INFO [RS:0;jenkins-hbase4:32797] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-17 02:01:54,907 INFO [RS:0;jenkins-hbase4:32797] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,32797,1676599314577-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:54,909 DEBUG [jenkins-hbase4:41135] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-17 02:01:54,909 DEBUG [jenkins-hbase4:41135] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-17 02:01:54,910 DEBUG [jenkins-hbase4:41135] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-17 02:01:54,910 DEBUG [jenkins-hbase4:41135] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-17 02:01:54,910 DEBUG [jenkins-hbase4:41135] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-17 02:01:54,911 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,44839,1676599314599, state=OPENING 2023-02-17 02:01:54,912 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-17 02:01:54,913 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): master:41135-0x100600331fd0000, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 02:01:54,913 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,44839,1676599314599}] 2023-02-17 02:01:54,913 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-17 02:01:54,921 INFO [RS:0;jenkins-hbase4:32797] regionserver.Replication(203): jenkins-hbase4.apache.org,32797,1676599314577 started 2023-02-17 02:01:54,922 INFO [RS:0;jenkins-hbase4:32797] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,32797,1676599314577, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:32797, sessionid=0x100600331fd0001 2023-02-17 02:01:54,922 DEBUG [RS:0;jenkins-hbase4:32797] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-17 02:01:54,922 DEBUG [RS:0;jenkins-hbase4:32797] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,32797,1676599314577 2023-02-17 02:01:54,922 DEBUG [RS:0;jenkins-hbase4:32797] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,32797,1676599314577' 2023-02-17 02:01:54,922 DEBUG [RS:0;jenkins-hbase4:32797] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 02:01:54,922 DEBUG [RS:0;jenkins-hbase4:32797] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 02:01:54,922 DEBUG [RS:0;jenkins-hbase4:32797] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-17 02:01:54,922 DEBUG [RS:0;jenkins-hbase4:32797] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-17 02:01:54,922 DEBUG [RS:0;jenkins-hbase4:32797] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,32797,1676599314577 2023-02-17 02:01:54,922 DEBUG [RS:0;jenkins-hbase4:32797] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,32797,1676599314577' 2023-02-17 02:01:54,922 DEBUG [RS:0;jenkins-hbase4:32797] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 02:01:54,923 DEBUG [RS:0;jenkins-hbase4:32797] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 02:01:54,923 DEBUG [RS:0;jenkins-hbase4:32797] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-17 02:01:54,923 INFO [RS:0;jenkins-hbase4:32797] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-17 02:01:54,923 INFO [RS:0;jenkins-hbase4:32797] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-17 02:01:55,068 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,44839,1676599314599 2023-02-17 02:01:55,069 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-17 02:01:55,070 INFO [RS-EventLoopGroup-23-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50446, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-17 02:01:55,074 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-17 02:01:55,074 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 02:01:55,075 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44839%2C1676599314599.meta, suffix=.meta, logDir=hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/WALs/jenkins-hbase4.apache.org,44839,1676599314599, archiveDir=hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/oldWALs, maxLogs=32 2023-02-17 02:01:55,092 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41633,DS-7128c6b4-a901-4c60-85fd-301443750cd0,DISK] 2023-02-17 02:01:55,092 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34265,DS-a5a87e30-32b5-416c-b6e5-2c9c6d132fe0,DISK] 2023-02-17 02:01:55,094 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/WALs/jenkins-hbase4.apache.org,44839,1676599314599/jenkins-hbase4.apache.org%2C44839%2C1676599314599.meta.1676599315075.meta 2023-02-17 02:01:55,094 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41633,DS-7128c6b4-a901-4c60-85fd-301443750cd0,DISK], DatanodeInfoWithStorage[127.0.0.1:34265,DS-a5a87e30-32b5-416c-b6e5-2c9c6d132fe0,DISK]] 2023-02-17 02:01:55,094 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-17 02:01:55,094 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-17 02:01:55,095 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-17 02:01:55,095 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-17 02:01:55,095 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-17 02:01:55,095 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:55,095 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-17 02:01:55,095 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-17 02:01:55,096 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-17 02:01:55,097 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/data/hbase/meta/1588230740/info 2023-02-17 02:01:55,097 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/data/hbase/meta/1588230740/info 2023-02-17 02:01:55,097 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-17 02:01:55,098 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:55,098 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-17 02:01:55,099 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/data/hbase/meta/1588230740/rep_barrier 2023-02-17 02:01:55,099 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/data/hbase/meta/1588230740/rep_barrier 2023-02-17 02:01:55,099 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-17 02:01:55,099 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:55,100 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-17 02:01:55,101 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/data/hbase/meta/1588230740/table 2023-02-17 02:01:55,101 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/data/hbase/meta/1588230740/table 2023-02-17 02:01:55,101 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-17 02:01:55,101 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:55,102 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/data/hbase/meta/1588230740 2023-02-17 02:01:55,103 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/data/hbase/meta/1588230740 2023-02-17 02:01:55,105 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-17 02:01:55,106 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-17 02:01:55,107 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68874928, jitterRate=0.026316404342651367}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-17 02:01:55,107 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-17 02:01:55,108 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676599315068 2023-02-17 02:01:55,112 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-17 02:01:55,113 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-17 02:01:55,113 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,44839,1676599314599, state=OPEN 2023-02-17 02:01:55,114 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): master:41135-0x100600331fd0000, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-17 02:01:55,115 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-17 02:01:55,117 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-17 02:01:55,117 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,44839,1676599314599 in 202 msec 2023-02-17 02:01:55,118 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-17 02:01:55,118 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 361 msec 2023-02-17 02:01:55,119 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 393 msec 2023-02-17 02:01:55,119 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676599315119, completionTime=-1 2023-02-17 02:01:55,120 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-17 02:01:55,120 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-17 02:01:55,123 DEBUG [hconnection-0xfb19d74-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 02:01:55,124 INFO [RS-EventLoopGroup-23-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50452, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 02:01:55,125 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-17 02:01:55,125 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676599375125 2023-02-17 02:01:55,125 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676599435125 2023-02-17 02:01:55,125 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 5 msec 2023-02-17 02:01:55,132 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41135,1676599314522-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:55,133 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41135,1676599314522-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:55,133 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41135,1676599314522-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:55,133 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:41135, period=300000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:55,133 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-17 02:01:55,133 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-17 02:01:55,133 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-17 02:01:55,134 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-17 02:01:55,136 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-17 02:01:55,136 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-17 02:01:55,137 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-17 02:01:55,138 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/.tmp/data/hbase/namespace/4ac9fd86b5a58ee8ce839b55d933f24d 2023-02-17 02:01:55,138 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/.tmp/data/hbase/namespace/4ac9fd86b5a58ee8ce839b55d933f24d empty. 2023-02-17 02:01:55,139 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/.tmp/data/hbase/namespace/4ac9fd86b5a58ee8ce839b55d933f24d 2023-02-17 02:01:55,139 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-17 02:01:55,153 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-17 02:01:55,155 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 4ac9fd86b5a58ee8ce839b55d933f24d, NAME => 'hbase:namespace,,1676599315133.4ac9fd86b5a58ee8ce839b55d933f24d.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/.tmp 2023-02-17 02:01:55,170 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676599315133.4ac9fd86b5a58ee8ce839b55d933f24d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:55,170 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 4ac9fd86b5a58ee8ce839b55d933f24d, disabling compactions & flushes 2023-02-17 02:01:55,170 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676599315133.4ac9fd86b5a58ee8ce839b55d933f24d. 2023-02-17 02:01:55,170 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676599315133.4ac9fd86b5a58ee8ce839b55d933f24d. 2023-02-17 02:01:55,170 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676599315133.4ac9fd86b5a58ee8ce839b55d933f24d. after waiting 0 ms 2023-02-17 02:01:55,170 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676599315133.4ac9fd86b5a58ee8ce839b55d933f24d. 2023-02-17 02:01:55,170 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676599315133.4ac9fd86b5a58ee8ce839b55d933f24d. 2023-02-17 02:01:55,170 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 4ac9fd86b5a58ee8ce839b55d933f24d: 2023-02-17 02:01:55,172 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-17 02:01:55,173 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676599315133.4ac9fd86b5a58ee8ce839b55d933f24d.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676599315173"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676599315173"}]},"ts":"1676599315173"} 2023-02-17 02:01:55,174 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-17 02:01:55,175 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-17 02:01:55,175 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676599315175"}]},"ts":"1676599315175"} 2023-02-17 02:01:55,176 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-17 02:01:55,180 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-17 02:01:55,180 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-17 02:01:55,180 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-17 02:01:55,180 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-17 02:01:55,180 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=4ac9fd86b5a58ee8ce839b55d933f24d, ASSIGN}] 2023-02-17 02:01:55,183 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=4ac9fd86b5a58ee8ce839b55d933f24d, ASSIGN 2023-02-17 02:01:55,183 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=4ac9fd86b5a58ee8ce839b55d933f24d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,32797,1676599314577; forceNewPlan=false, retain=false 2023-02-17 02:01:55,333 INFO [jenkins-hbase4:41135] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-17 02:01:55,334 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=4ac9fd86b5a58ee8ce839b55d933f24d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32797,1676599314577 2023-02-17 02:01:55,334 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676599315133.4ac9fd86b5a58ee8ce839b55d933f24d.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676599315334"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676599315334"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676599315334"}]},"ts":"1676599315334"} 2023-02-17 02:01:55,336 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 4ac9fd86b5a58ee8ce839b55d933f24d, server=jenkins-hbase4.apache.org,32797,1676599314577}] 2023-02-17 02:01:55,488 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,32797,1676599314577 2023-02-17 02:01:55,489 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-17 02:01:55,490 INFO [RS-EventLoopGroup-22-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57830, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-17 02:01:55,494 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676599315133.4ac9fd86b5a58ee8ce839b55d933f24d. 2023-02-17 02:01:55,496 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C32797%2C1676599314577, suffix=, logDir=hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/WALs/jenkins-hbase4.apache.org,32797,1676599314577, archiveDir=hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/oldWALs, maxLogs=32 2023-02-17 02:01:55,512 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34265,DS-a5a87e30-32b5-416c-b6e5-2c9c6d132fe0,DISK] 2023-02-17 02:01:55,512 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41633,DS-7128c6b4-a901-4c60-85fd-301443750cd0,DISK] 2023-02-17 02:01:55,514 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/WALs/jenkins-hbase4.apache.org,32797,1676599314577/jenkins-hbase4.apache.org%2C32797%2C1676599314577.1676599315496 2023-02-17 02:01:55,514 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41633,DS-7128c6b4-a901-4c60-85fd-301443750cd0,DISK], DatanodeInfoWithStorage[127.0.0.1:34265,DS-a5a87e30-32b5-416c-b6e5-2c9c6d132fe0,DISK]] 2023-02-17 02:01:55,514 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4ac9fd86b5a58ee8ce839b55d933f24d, NAME => 'hbase:namespace,,1676599315133.4ac9fd86b5a58ee8ce839b55d933f24d.', STARTKEY => '', ENDKEY => ''} 2023-02-17 02:01:55,514 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 4ac9fd86b5a58ee8ce839b55d933f24d 2023-02-17 02:01:55,514 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676599315133.4ac9fd86b5a58ee8ce839b55d933f24d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:55,514 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 4ac9fd86b5a58ee8ce839b55d933f24d 2023-02-17 02:01:55,514 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 4ac9fd86b5a58ee8ce839b55d933f24d 2023-02-17 02:01:55,516 INFO [StoreOpener-4ac9fd86b5a58ee8ce839b55d933f24d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 4ac9fd86b5a58ee8ce839b55d933f24d 2023-02-17 02:01:55,517 DEBUG [StoreOpener-4ac9fd86b5a58ee8ce839b55d933f24d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/data/hbase/namespace/4ac9fd86b5a58ee8ce839b55d933f24d/info 2023-02-17 02:01:55,517 DEBUG [StoreOpener-4ac9fd86b5a58ee8ce839b55d933f24d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/data/hbase/namespace/4ac9fd86b5a58ee8ce839b55d933f24d/info 2023-02-17 02:01:55,517 INFO [StoreOpener-4ac9fd86b5a58ee8ce839b55d933f24d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4ac9fd86b5a58ee8ce839b55d933f24d columnFamilyName info 2023-02-17 02:01:55,518 INFO [StoreOpener-4ac9fd86b5a58ee8ce839b55d933f24d-1] regionserver.HStore(310): Store=4ac9fd86b5a58ee8ce839b55d933f24d/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:55,518 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/data/hbase/namespace/4ac9fd86b5a58ee8ce839b55d933f24d 2023-02-17 02:01:55,519 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/data/hbase/namespace/4ac9fd86b5a58ee8ce839b55d933f24d 2023-02-17 02:01:55,521 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 4ac9fd86b5a58ee8ce839b55d933f24d 2023-02-17 02:01:55,523 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/data/hbase/namespace/4ac9fd86b5a58ee8ce839b55d933f24d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 02:01:55,523 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 4ac9fd86b5a58ee8ce839b55d933f24d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62949882, jitterRate=-0.06197366118431091}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-17 02:01:55,523 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 4ac9fd86b5a58ee8ce839b55d933f24d: 2023-02-17 02:01:55,524 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676599315133.4ac9fd86b5a58ee8ce839b55d933f24d., pid=6, masterSystemTime=1676599315488 2023-02-17 02:01:55,528 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676599315133.4ac9fd86b5a58ee8ce839b55d933f24d. 2023-02-17 02:01:55,530 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676599315133.4ac9fd86b5a58ee8ce839b55d933f24d. 2023-02-17 02:01:55,530 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=4ac9fd86b5a58ee8ce839b55d933f24d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,32797,1676599314577 2023-02-17 02:01:55,530 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676599315133.4ac9fd86b5a58ee8ce839b55d933f24d.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676599315530"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676599315530"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676599315530"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676599315530"}]},"ts":"1676599315530"} 2023-02-17 02:01:55,533 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-17 02:01:55,533 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 4ac9fd86b5a58ee8ce839b55d933f24d, server=jenkins-hbase4.apache.org,32797,1676599314577 in 195 msec 2023-02-17 02:01:55,534 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-17 02:01:55,534 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=4ac9fd86b5a58ee8ce839b55d933f24d, ASSIGN in 353 msec 2023-02-17 02:01:55,534 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-17 02:01:55,534 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676599315534"}]},"ts":"1676599315534"} 2023-02-17 02:01:55,535 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-17 02:01:55,537 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41135-0x100600331fd0000, quorum=127.0.0.1:62388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-17 02:01:55,537 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-17 02:01:55,538 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 404 msec 2023-02-17 02:01:55,538 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): master:41135-0x100600331fd0000, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-17 02:01:55,538 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): master:41135-0x100600331fd0000, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 02:01:55,540 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 02:01:55,541 INFO [RS-EventLoopGroup-22-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57834, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 02:01:55,543 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-17 02:01:55,549 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): master:41135-0x100600331fd0000, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-17 02:01:55,552 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 9 msec 2023-02-17 02:01:55,554 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-17 02:01:55,559 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): master:41135-0x100600331fd0000, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-17 02:01:55,562 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 7 msec 2023-02-17 02:01:55,569 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): master:41135-0x100600331fd0000, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-17 02:01:55,571 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): master:41135-0x100600331fd0000, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-17 02:01:55,571 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 0.949sec 2023-02-17 02:01:55,571 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-17 02:01:55,571 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-17 02:01:55,571 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-17 02:01:55,571 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41135,1676599314522-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-17 02:01:55,571 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41135,1676599314522-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-17 02:01:55,573 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-17 02:01:55,611 DEBUG [Listener at localhost/33057] zookeeper.ReadOnlyZKClient(139): Connect 0x220a9eaf to 127.0.0.1:62388 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 02:01:55,615 DEBUG [Listener at localhost/33057] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@72df4541, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 02:01:55,617 DEBUG [hconnection-0x4d316a9d-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 02:01:55,618 INFO [RS-EventLoopGroup-23-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50462, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 02:01:55,619 INFO [Listener at localhost/33057] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,41135,1676599314522 2023-02-17 02:01:55,620 DEBUG [Listener at localhost/33057] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-17 02:01:55,622 DEBUG [Listener at localhost/33057] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-17 02:01:55,623 INFO [RS-EventLoopGroup-21-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39114, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-17 02:01:55,623 INFO [Listener at localhost/33057] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-17 02:01:55,624 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41135] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-17 02:01:55,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41135] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-17 02:01:55,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41135] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 77 connection: 172.31.14.131:39114 deadline: 1676599375624, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-17 02:01:55,624 INFO [Listener at localhost/33057] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-17 02:01:55,626 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41135] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-17 02:01:55,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41135] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-17 02:01:55,628 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-17 02:01:55,628 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41135] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-17 02:01:55,629 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-17 02:01:55,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41135] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 02:01:55,631 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/.tmp/data/default/testWithMapReduce/9dfdf91eb690503c331d246b6cb8e1a1 2023-02-17 02:01:55,631 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/.tmp/data/default/testWithMapReduce/9dfdf91eb690503c331d246b6cb8e1a1 empty. 2023-02-17 02:01:55,632 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/.tmp/data/default/testWithMapReduce/9dfdf91eb690503c331d246b6cb8e1a1 2023-02-17 02:01:55,632 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-17 02:01:55,639 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-17 02:01:55,640 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 9dfdf91eb690503c331d246b6cb8e1a1, NAME => 'testWithMapReduce,,1676599315626.9dfdf91eb690503c331d246b6cb8e1a1.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/.tmp 2023-02-17 02:01:55,646 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676599315626.9dfdf91eb690503c331d246b6cb8e1a1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:55,646 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 9dfdf91eb690503c331d246b6cb8e1a1, disabling compactions & flushes 2023-02-17 02:01:55,646 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676599315626.9dfdf91eb690503c331d246b6cb8e1a1. 2023-02-17 02:01:55,646 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676599315626.9dfdf91eb690503c331d246b6cb8e1a1. 2023-02-17 02:01:55,646 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676599315626.9dfdf91eb690503c331d246b6cb8e1a1. after waiting 0 ms 2023-02-17 02:01:55,646 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676599315626.9dfdf91eb690503c331d246b6cb8e1a1. 2023-02-17 02:01:55,646 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676599315626.9dfdf91eb690503c331d246b6cb8e1a1. 2023-02-17 02:01:55,646 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 9dfdf91eb690503c331d246b6cb8e1a1: 2023-02-17 02:01:55,648 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-17 02:01:55,648 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676599315626.9dfdf91eb690503c331d246b6cb8e1a1.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676599315648"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676599315648"}]},"ts":"1676599315648"} 2023-02-17 02:01:55,650 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-17 02:01:55,650 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-17 02:01:55,650 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676599315650"}]},"ts":"1676599315650"} 2023-02-17 02:01:55,651 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-17 02:01:55,654 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-17 02:01:55,655 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-17 02:01:55,655 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-17 02:01:55,655 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-17 02:01:55,655 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=9dfdf91eb690503c331d246b6cb8e1a1, ASSIGN}] 2023-02-17 02:01:55,656 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=9dfdf91eb690503c331d246b6cb8e1a1, ASSIGN 2023-02-17 02:01:55,656 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=9dfdf91eb690503c331d246b6cb8e1a1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,32797,1676599314577; forceNewPlan=false, retain=false 2023-02-17 02:01:55,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41135] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 02:01:55,806 INFO [jenkins-hbase4:41135] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-17 02:01:55,807 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=9dfdf91eb690503c331d246b6cb8e1a1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32797,1676599314577 2023-02-17 02:01:55,807 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676599315626.9dfdf91eb690503c331d246b6cb8e1a1.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676599315807"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676599315807"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676599315807"}]},"ts":"1676599315807"} 2023-02-17 02:01:55,809 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 9dfdf91eb690503c331d246b6cb8e1a1, server=jenkins-hbase4.apache.org,32797,1676599314577}] 2023-02-17 02:01:55,908 INFO [RS:1;jenkins-hbase4:44839] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44839%2C1676599314599, suffix=, logDir=hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/WALs/jenkins-hbase4.apache.org,44839,1676599314599, archiveDir=hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/oldWALs, maxLogs=32 2023-02-17 02:01:55,924 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34265,DS-a5a87e30-32b5-416c-b6e5-2c9c6d132fe0,DISK] 2023-02-17 02:01:55,924 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41633,DS-7128c6b4-a901-4c60-85fd-301443750cd0,DISK] 2023-02-17 02:01:55,928 INFO [RS:1;jenkins-hbase4:44839] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/WALs/jenkins-hbase4.apache.org,44839,1676599314599/jenkins-hbase4.apache.org%2C44839%2C1676599314599.1676599315908 2023-02-17 02:01:55,931 DEBUG [RS:1;jenkins-hbase4:44839] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34265,DS-a5a87e30-32b5-416c-b6e5-2c9c6d132fe0,DISK], DatanodeInfoWithStorage[127.0.0.1:41633,DS-7128c6b4-a901-4c60-85fd-301443750cd0,DISK]] 2023-02-17 02:01:55,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41135] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 02:01:55,963 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676599315626.9dfdf91eb690503c331d246b6cb8e1a1. 2023-02-17 02:01:55,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 9dfdf91eb690503c331d246b6cb8e1a1, NAME => 'testWithMapReduce,,1676599315626.9dfdf91eb690503c331d246b6cb8e1a1.', STARTKEY => '', ENDKEY => ''} 2023-02-17 02:01:55,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 9dfdf91eb690503c331d246b6cb8e1a1 2023-02-17 02:01:55,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676599315626.9dfdf91eb690503c331d246b6cb8e1a1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:55,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 9dfdf91eb690503c331d246b6cb8e1a1 2023-02-17 02:01:55,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 9dfdf91eb690503c331d246b6cb8e1a1 2023-02-17 02:01:55,965 INFO [StoreOpener-9dfdf91eb690503c331d246b6cb8e1a1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9dfdf91eb690503c331d246b6cb8e1a1 2023-02-17 02:01:55,966 DEBUG [StoreOpener-9dfdf91eb690503c331d246b6cb8e1a1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/data/default/testWithMapReduce/9dfdf91eb690503c331d246b6cb8e1a1/f1 2023-02-17 02:01:55,966 DEBUG [StoreOpener-9dfdf91eb690503c331d246b6cb8e1a1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/data/default/testWithMapReduce/9dfdf91eb690503c331d246b6cb8e1a1/f1 2023-02-17 02:01:55,966 INFO [StoreOpener-9dfdf91eb690503c331d246b6cb8e1a1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9dfdf91eb690503c331d246b6cb8e1a1 columnFamilyName f1 2023-02-17 02:01:55,966 INFO [StoreOpener-9dfdf91eb690503c331d246b6cb8e1a1-1] regionserver.HStore(310): Store=9dfdf91eb690503c331d246b6cb8e1a1/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:55,967 INFO [StoreOpener-9dfdf91eb690503c331d246b6cb8e1a1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 9dfdf91eb690503c331d246b6cb8e1a1 2023-02-17 02:01:55,968 DEBUG [StoreOpener-9dfdf91eb690503c331d246b6cb8e1a1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/data/default/testWithMapReduce/9dfdf91eb690503c331d246b6cb8e1a1/f2 2023-02-17 02:01:55,968 DEBUG [StoreOpener-9dfdf91eb690503c331d246b6cb8e1a1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/data/default/testWithMapReduce/9dfdf91eb690503c331d246b6cb8e1a1/f2 2023-02-17 02:01:55,968 INFO [StoreOpener-9dfdf91eb690503c331d246b6cb8e1a1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9dfdf91eb690503c331d246b6cb8e1a1 columnFamilyName f2 2023-02-17 02:01:55,968 INFO [StoreOpener-9dfdf91eb690503c331d246b6cb8e1a1-1] regionserver.HStore(310): Store=9dfdf91eb690503c331d246b6cb8e1a1/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:55,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/data/default/testWithMapReduce/9dfdf91eb690503c331d246b6cb8e1a1 2023-02-17 02:01:55,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/data/default/testWithMapReduce/9dfdf91eb690503c331d246b6cb8e1a1 2023-02-17 02:01:55,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 02:01:55,971 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 9dfdf91eb690503c331d246b6cb8e1a1 2023-02-17 02:01:55,972 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/data/default/testWithMapReduce/9dfdf91eb690503c331d246b6cb8e1a1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 02:01:55,973 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 9dfdf91eb690503c331d246b6cb8e1a1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72433644, jitterRate=0.07934540510177612}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 02:01:55,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 9dfdf91eb690503c331d246b6cb8e1a1: 2023-02-17 02:01:55,974 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676599315626.9dfdf91eb690503c331d246b6cb8e1a1., pid=12, masterSystemTime=1676599315960 2023-02-17 02:01:55,975 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676599315626.9dfdf91eb690503c331d246b6cb8e1a1. 2023-02-17 02:01:55,976 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676599315626.9dfdf91eb690503c331d246b6cb8e1a1. 2023-02-17 02:01:55,976 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=9dfdf91eb690503c331d246b6cb8e1a1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,32797,1676599314577 2023-02-17 02:01:55,977 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676599315626.9dfdf91eb690503c331d246b6cb8e1a1.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676599315976"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676599315976"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676599315976"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676599315976"}]},"ts":"1676599315976"} 2023-02-17 02:01:55,979 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-17 02:01:55,979 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 9dfdf91eb690503c331d246b6cb8e1a1, server=jenkins-hbase4.apache.org,32797,1676599314577 in 169 msec 2023-02-17 02:01:55,980 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-17 02:01:55,980 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=9dfdf91eb690503c331d246b6cb8e1a1, ASSIGN in 324 msec 2023-02-17 02:01:55,981 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-17 02:01:55,981 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676599315981"}]},"ts":"1676599315981"} 2023-02-17 02:01:55,982 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-17 02:01:55,984 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-17 02:01:55,985 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 358 msec 2023-02-17 02:01:56,012 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-17 02:01:56,138 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-17 02:01:56,138 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-02-17 02:01:56,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41135] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 02:01:56,234 INFO [Listener at localhost/33057] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-17 02:01:56,234 DEBUG [Listener at localhost/33057] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-17 02:01:56,235 INFO [Listener at localhost/33057] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-17 02:01:56,236 INFO [Listener at localhost/33057] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-17 02:01:56,237 INFO [Listener at localhost/33057] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-17 02:01:56,237 INFO [Listener at localhost/33057] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-17 02:01:56,237 INFO [Listener at localhost/33057] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-17 02:01:56,251 DEBUG [hconnection-0x4d316a9d-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 02:01:56,263 INFO [RS-EventLoopGroup-22-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57850, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 02:01:56,270 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32797] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,,1676599315626.9dfdf91eb690503c331d246b6cb8e1a1. 2023-02-17 02:01:56,455 INFO [Listener at localhost/33057] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-17 02:01:56,456 INFO [Listener at localhost/33057] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-17 02:01:56,457 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41135] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-17 02:01:56,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41135] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676599316457 (current time:1676599316457). 2023-02-17 02:01:56,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41135] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-17 02:01:56,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41135] zookeeper.ReadOnlyZKClient(139): Connect 0x024aee54 to 127.0.0.1:62388 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 02:01:56,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41135] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7c4f4417, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 02:01:56,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41135] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 02:01:56,462 INFO [RS-EventLoopGroup-23-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50470, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 02:01:56,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41135] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x024aee54 to 127.0.0.1:62388 2023-02-17 02:01:56,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41135] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 02:01:56,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41135] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-17 02:01:56,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41135] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-17 02:01:56,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41135] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-17 02:01:56,467 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-17 02:01:56,468 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676599916468 2023-02-17 02:01:56,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41135] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-17 02:01:56,468 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-17 02:01:56,469 DEBUG [Listener at localhost/33057] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-17 02:01:56,469 DEBUG [Listener at localhost/33057] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-17 02:01:56,469 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-17 02:01:56,470 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-17 02:01:56,470 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 4 msec 2023-02-17 02:01:56,471 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-17 02:01:56,472 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676599916472 2023-02-17 02:01:56,484 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceSingleRegion 2023-02-17 02:01:56,485 INFO [(jenkins-hbase4.apache.org,41135,1676599314522)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceSingleRegion' 2023-02-17 02:01:56,485 DEBUG [(jenkins-hbase4.apache.org,41135,1676599314522)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-17 02:01:56,486 DEBUG [(jenkins-hbase4.apache.org,41135,1676599314522)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceSingleRegion' starting 'acquire' 2023-02-17 02:01:56,486 DEBUG [(jenkins-hbase4.apache.org,41135,1676599314522)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-17 02:01:56,486 DEBUG [(jenkins-hbase4.apache.org,41135,1676599314522)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41135-0x100600331fd0000, quorum=127.0.0.1:62388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-17 02:01:56,486 DEBUG [(jenkins-hbase4.apache.org,41135,1676599314522)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-17 02:01:56,488 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): regionserver:44839-0x100600331fd0002, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 02:01:56,488 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): regionserver:32797-0x100600331fd0001, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 02:01:56,489 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 02:01:56,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 02:01:56,488 DEBUG [(jenkins-hbase4.apache.org,41135,1676599314522)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,32797,1676599314577 2023-02-17 02:01:56,489 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 02:01:56,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 02:01:56,489 DEBUG [(jenkins-hbase4.apache.org,41135,1676599314522)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41135-0x100600331fd0000, quorum=127.0.0.1:62388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,32797,1676599314577 2023-02-17 02:01:56,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-17 02:01:56,489 DEBUG [(jenkins-hbase4.apache.org,41135,1676599314522)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-17 02:01:56,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-17 02:01:56,489 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32797-0x100600331fd0001, quorum=127.0.0.1:62388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-17 02:01:56,490 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44839-0x100600331fd0002, quorum=127.0.0.1:62388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-17 02:01:56,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-17 02:01:56,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-17 02:01:56,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-17 02:01:56,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-17 02:01:56,490 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-17 02:01:56,490 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-17 02:01:56,490 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-17 02:01:56,490 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-17 02:01:56,490 DEBUG [member: 'jenkins-hbase4.apache.org,32797,1676599314577' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-17 02:01:56,490 DEBUG [member: 'jenkins-hbase4.apache.org,32797,1676599314577' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-17 02:01:56,497 DEBUG [member: 'jenkins-hbase4.apache.org,32797,1676599314577' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-17 02:01:56,497 DEBUG [member: 'jenkins-hbase4.apache.org,32797,1676599314577' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-17 02:01:56,497 DEBUG [member: 'jenkins-hbase4.apache.org,44839,1676599314599' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-17 02:01:56,497 DEBUG [member: 'jenkins-hbase4.apache.org,44839,1676599314599' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-17 02:01:56,497 DEBUG [member: 'jenkins-hbase4.apache.org,32797,1676599314577' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32797,1676599314577' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-17 02:01:56,501 DEBUG [member: 'jenkins-hbase4.apache.org,44839,1676599314599' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-17 02:01:56,501 DEBUG [member: 'jenkins-hbase4.apache.org,44839,1676599314599' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-17 02:01:56,501 DEBUG [member: 'jenkins-hbase4.apache.org,44839,1676599314599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44839,1676599314599' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-17 02:01:56,503 DEBUG [member: 'jenkins-hbase4.apache.org,32797,1676599314577' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-17 02:01:56,503 DEBUG [member: 'jenkins-hbase4.apache.org,44839,1676599314599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-17 02:01:56,503 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): master:41135-0x100600331fd0000, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,32797,1676599314577 2023-02-17 02:01:56,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,32797,1676599314577 2023-02-17 02:01:56,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 02:01:56,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-17 02:01:56,503 DEBUG [member: 'jenkins-hbase4.apache.org,32797,1676599314577' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32797-0x100600331fd0001, quorum=127.0.0.1:62388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-17 02:01:56,503 DEBUG [member: 'jenkins-hbase4.apache.org,32797,1676599314577' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 02:01:56,503 DEBUG [member: 'jenkins-hbase4.apache.org,44839,1676599314599' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44839-0x100600331fd0002, quorum=127.0.0.1:62388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-17 02:01:56,503 DEBUG [member: 'jenkins-hbase4.apache.org,44839,1676599314599' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 02:01:56,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 02:01:56,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 02:01:56,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-17 02:01:56,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32797,1676599314577 2023-02-17 02:01:56,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44839,1676599314599 2023-02-17 02:01:56,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 02:01:56,505 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32797,1676599314577' joining acquired barrier for procedure 'testWithMapReduceSingleRegion' on coordinator 2023-02-17 02:01:56,505 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@185297ee[Count = 0] remaining members to acquire global barrier 2023-02-17 02:01:56,505 DEBUG [(jenkins-hbase4.apache.org,41135,1676599314522)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-17 02:01:56,505 DEBUG [(jenkins-hbase4.apache.org,41135,1676599314522)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-17 02:01:56,507 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): regionserver:44839-0x100600331fd0002, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-17 02:01:56,507 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): regionserver:32797-0x100600331fd0001, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-17 02:01:56,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-17 02:01:56,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-17 02:01:56,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-17 02:01:56,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-17 02:01:56,507 DEBUG [member: 'jenkins-hbase4.apache.org,44839,1676599314599' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-17 02:01:56,507 DEBUG [(jenkins-hbase4.apache.org,41135,1676599314522)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41135-0x100600331fd0000, quorum=127.0.0.1:62388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,32797,1676599314577 2023-02-17 02:01:56,507 DEBUG [(jenkins-hbase4.apache.org,41135,1676599314522)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-17 02:01:56,507 DEBUG [member: 'jenkins-hbase4.apache.org,44839,1676599314599' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-17 02:01:56,507 DEBUG [member: 'jenkins-hbase4.apache.org,32797,1676599314577' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-17 02:01:56,507 DEBUG [member: 'jenkins-hbase4.apache.org,44839,1676599314599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,44839,1676599314599' in zk 2023-02-17 02:01:56,507 DEBUG [member: 'jenkins-hbase4.apache.org,32797,1676599314577' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-17 02:01:56,507 DEBUG [member: 'jenkins-hbase4.apache.org,32797,1676599314577' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-17 02:01:56,507 DEBUG [rs(jenkins-hbase4.apache.org,32797,1676599314577)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676599315626.9dfdf91eb690503c331d246b6cb8e1a1. 2023-02-17 02:01:56,507 DEBUG [rs(jenkins-hbase4.apache.org,32797,1676599314577)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676599315626.9dfdf91eb690503c331d246b6cb8e1a1. started... 2023-02-17 02:01:56,507 INFO [rs(jenkins-hbase4.apache.org,32797,1676599314577)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 9dfdf91eb690503c331d246b6cb8e1a1 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-17 02:01:56,508 DEBUG [member: 'jenkins-hbase4.apache.org,44839,1676599314599' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-17 02:01:56,508 DEBUG [member: 'jenkins-hbase4.apache.org,44839,1676599314599' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 02:01:56,508 DEBUG [member: 'jenkins-hbase4.apache.org,44839,1676599314599' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-17 02:01:56,523 INFO [rs(jenkins-hbase4.apache.org,32797,1676599314577)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/data/default/testWithMapReduce/9dfdf91eb690503c331d246b6cb8e1a1/.tmp/f1/ce66757be72947cc8c4b2c5f9baa9b36 2023-02-17 02:01:56,542 INFO [rs(jenkins-hbase4.apache.org,32797,1676599314577)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/data/default/testWithMapReduce/9dfdf91eb690503c331d246b6cb8e1a1/.tmp/f2/26fcc9be7025412dab3d8de5ff9a72e3 2023-02-17 02:01:56,546 DEBUG [rs(jenkins-hbase4.apache.org,32797,1676599314577)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/data/default/testWithMapReduce/9dfdf91eb690503c331d246b6cb8e1a1/.tmp/f1/ce66757be72947cc8c4b2c5f9baa9b36 as hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/data/default/testWithMapReduce/9dfdf91eb690503c331d246b6cb8e1a1/f1/ce66757be72947cc8c4b2c5f9baa9b36 2023-02-17 02:01:56,549 INFO [rs(jenkins-hbase4.apache.org,32797,1676599314577)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/data/default/testWithMapReduce/9dfdf91eb690503c331d246b6cb8e1a1/f1/ce66757be72947cc8c4b2c5f9baa9b36, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-17 02:01:56,550 DEBUG [rs(jenkins-hbase4.apache.org,32797,1676599314577)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/data/default/testWithMapReduce/9dfdf91eb690503c331d246b6cb8e1a1/.tmp/f2/26fcc9be7025412dab3d8de5ff9a72e3 as hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/data/default/testWithMapReduce/9dfdf91eb690503c331d246b6cb8e1a1/f2/26fcc9be7025412dab3d8de5ff9a72e3 2023-02-17 02:01:56,553 INFO [rs(jenkins-hbase4.apache.org,32797,1676599314577)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/data/default/testWithMapReduce/9dfdf91eb690503c331d246b6cb8e1a1/f2/26fcc9be7025412dab3d8de5ff9a72e3, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-17 02:01:56,554 INFO [rs(jenkins-hbase4.apache.org,32797,1676599314577)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 9dfdf91eb690503c331d246b6cb8e1a1 in 47ms, sequenceid=5, compaction requested=false 2023-02-17 02:01:56,554 DEBUG [rs(jenkins-hbase4.apache.org,32797,1676599314577)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 9dfdf91eb690503c331d246b6cb8e1a1: 2023-02-17 02:01:56,554 DEBUG [rs(jenkins-hbase4.apache.org,32797,1676599314577)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676599315626.9dfdf91eb690503c331d246b6cb8e1a1.' region-info for snapshot=testWithMapReduceSingleRegion 2023-02-17 02:01:56,554 DEBUG [rs(jenkins-hbase4.apache.org,32797,1676599314577)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 02:01:56,554 DEBUG [rs(jenkins-hbase4.apache.org,32797,1676599314577)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/data/default/testWithMapReduce/9dfdf91eb690503c331d246b6cb8e1a1/f1/ce66757be72947cc8c4b2c5f9baa9b36] hfiles 2023-02-17 02:01:56,554 DEBUG [rs(jenkins-hbase4.apache.org,32797,1676599314577)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/data/default/testWithMapReduce/9dfdf91eb690503c331d246b6cb8e1a1/f1/ce66757be72947cc8c4b2c5f9baa9b36 for snapshot=testWithMapReduceSingleRegion 2023-02-17 02:01:56,554 DEBUG [rs(jenkins-hbase4.apache.org,32797,1676599314577)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/data/default/testWithMapReduce/9dfdf91eb690503c331d246b6cb8e1a1/f2/26fcc9be7025412dab3d8de5ff9a72e3] hfiles 2023-02-17 02:01:56,554 DEBUG [rs(jenkins-hbase4.apache.org,32797,1676599314577)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/data/default/testWithMapReduce/9dfdf91eb690503c331d246b6cb8e1a1/f2/26fcc9be7025412dab3d8de5ff9a72e3 for snapshot=testWithMapReduceSingleRegion 2023-02-17 02:01:56,561 DEBUG [rs(jenkins-hbase4.apache.org,32797,1676599314577)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676599315626.9dfdf91eb690503c331d246b6cb8e1a1. completed. 2023-02-17 02:01:56,561 DEBUG [rs(jenkins-hbase4.apache.org,32797,1676599314577)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676599315626.9dfdf91eb690503c331d246b6cb8e1a1. 2023-02-17 02:01:56,561 DEBUG [member: 'jenkins-hbase4.apache.org,32797,1676599314577' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-17 02:01:56,561 DEBUG [member: 'jenkins-hbase4.apache.org,32797,1676599314577' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-17 02:01:56,561 DEBUG [member: 'jenkins-hbase4.apache.org,32797,1676599314577' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,32797,1676599314577 2023-02-17 02:01:56,561 DEBUG [member: 'jenkins-hbase4.apache.org,32797,1676599314577' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-17 02:01:56,561 DEBUG [member: 'jenkins-hbase4.apache.org,32797,1676599314577' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,32797,1676599314577' in zk 2023-02-17 02:01:56,564 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): master:41135-0x100600331fd0000, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,32797,1676599314577 2023-02-17 02:01:56,564 DEBUG [member: 'jenkins-hbase4.apache.org,32797,1676599314577' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-17 02:01:56,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,32797,1676599314577 2023-02-17 02:01:56,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 02:01:56,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-17 02:01:56,564 DEBUG [member: 'jenkins-hbase4.apache.org,32797,1676599314577' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 02:01:56,564 DEBUG [member: 'jenkins-hbase4.apache.org,32797,1676599314577' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-17 02:01:56,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 02:01:56,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 02:01:56,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-17 02:01:56,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32797,1676599314577 2023-02-17 02:01:56,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44839,1676599314599 2023-02-17 02:01:56,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 02:01:56,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-17 02:01:56,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32797,1676599314577 2023-02-17 02:01:56,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44839,1676599314599 2023-02-17 02:01:56,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,32797,1676599314577': 2023-02-17 02:01:56,567 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32797,1676599314577' released barrier for procedure'testWithMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-17 02:01:56,567 INFO [(jenkins-hbase4.apache.org,41135,1676599314522)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceSingleRegion' execution completed 2023-02-17 02:01:56,567 DEBUG [(jenkins-hbase4.apache.org,41135,1676599314522)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-17 02:01:56,567 DEBUG [(jenkins-hbase4.apache.org,41135,1676599314522)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-17 02:01:56,567 DEBUG [(jenkins-hbase4.apache.org,41135,1676599314522)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceSingleRegion 2023-02-17 02:01:56,567 INFO [(jenkins-hbase4.apache.org,41135,1676599314522)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-17 02:01:56,569 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): regionserver:44839-0x100600331fd0002, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-17 02:01:56,569 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): master:41135-0x100600331fd0000, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-17 02:01:56,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-17 02:01:56,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-17 02:01:56,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-17 02:01:56,569 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): regionserver:44839-0x100600331fd0002, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 02:01:56,569 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): regionserver:32797-0x100600331fd0001, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-17 02:01:56,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 02:01:56,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-17 02:01:56,569 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): regionserver:32797-0x100600331fd0001, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 02:01:56,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-17 02:01:56,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-17 02:01:56,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 02:01:56,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 02:01:56,570 DEBUG [Listener at localhost/33057] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-17 02:01:56,570 DEBUG [(jenkins-hbase4.apache.org,41135,1676599314522)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41135-0x100600331fd0000, quorum=127.0.0.1:62388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,32797,1676599314577 2023-02-17 02:01:56,570 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 02:01:56,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-17 02:01:56,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 02:01:56,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 02:01:56,570 DEBUG [(jenkins-hbase4.apache.org,41135,1676599314522)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41135-0x100600331fd0000, quorum=127.0.0.1:62388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,44839,1676599314599 2023-02-17 02:01:56,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-17 02:01:56,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-17 02:01:56,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41135] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-17 02:01:56,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41135] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-17 02:01:56,571 DEBUG [Listener at localhost/33057] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-17 02:01:56,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 02:01:56,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-17 02:01:56,571 DEBUG [(jenkins-hbase4.apache.org,41135,1676599314522)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41135-0x100600331fd0000, quorum=127.0.0.1:62388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,32797,1676599314577 2023-02-17 02:01:56,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32797,1676599314577 2023-02-17 02:01:56,572 DEBUG [(jenkins-hbase4.apache.org,41135,1676599314522)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41135-0x100600331fd0000, quorum=127.0.0.1:62388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,44839,1676599314599 2023-02-17 02:01:56,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44839,1676599314599 2023-02-17 02:01:56,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 02:01:56,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-17 02:01:56,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32797,1676599314577 2023-02-17 02:01:56,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44839,1676599314599 2023-02-17 02:01:56,577 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): master:41135-0x100600331fd0000, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,44839,1676599314599 2023-02-17 02:01:56,577 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): regionserver:44839-0x100600331fd0002, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 02:01:56,577 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): regionserver:32797-0x100600331fd0001, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 02:01:56,577 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 02:01:56,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 02:01:56,577 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): master:41135-0x100600331fd0000, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-17 02:01:56,577 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceSingleRegion 2023-02-17 02:01:56,577 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): regionserver:32797-0x100600331fd0001, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 02:01:56,577 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceSingleRegion 2023-02-17 02:01:56,577 DEBUG [(jenkins-hbase4.apache.org,41135,1676599314522)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 02:01:56,577 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): regionserver:44839-0x100600331fd0002, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 02:01:56,577 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41135-0x100600331fd0000, quorum=127.0.0.1:62388, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion because node does not exist (not an error) 2023-02-17 02:01:56,577 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 02:01:56,577 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 02:01:56,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 02:01:56,577 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): master:41135-0x100600331fd0000, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,32797,1676599314577 2023-02-17 02:01:56,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 02:01:56,577 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): master:41135-0x100600331fd0000, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-17 02:01:56,577 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): master:41135-0x100600331fd0000, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,44839,1676599314599 2023-02-17 02:01:56,577 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): master:41135-0x100600331fd0000, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-17 02:01:56,578 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): master:41135-0x100600331fd0000, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,32797,1676599314577 2023-02-17 02:01:56,578 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-17 02:01:56,578 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): master:41135-0x100600331fd0000, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-17 02:01:56,578 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): master:41135-0x100600331fd0000, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-17 02:01:56,578 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 02:01:56,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 02:01:56,593 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion to hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/.hbase-snapshot/testWithMapReduceSingleRegion 2023-02-17 02:01:56,614 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed 2023-02-17 02:01:56,615 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-17 02:01:56,615 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-17 02:01:56,615 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676599316468Consolidate snapshot: testWithMapReduceSingleRegion at 1676599316577 (+109 ms)Loading Region manifests for testWithMapReduceSingleRegion at 1676599316577Writing data manifest for testWithMapReduceSingleRegion at 1676599316580 (+3 ms)Verifying snapshot: testWithMapReduceSingleRegion at 1676599316587 (+7 ms)Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed at 1676599316614 (+27 ms) 2023-02-17 02:01:56,616 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-17 02:01:56,617 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 147 msec 2023-02-17 02:01:56,771 DEBUG [Listener at localhost/33057] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-17 02:01:56,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41135] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-17 02:01:56,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41135] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-17 02:01:56,772 INFO [Listener at localhost/33057] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-17 02:01:56,776 INFO [Listener at localhost/33057] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-17 02:01:56,781 INFO [Listener at localhost/33057] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-17 02:01:56,810 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32797] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,,1676599315626.9dfdf91eb690503c331d246b6cb8e1a1. 2023-02-17 02:01:56,894 INFO [Listener at localhost/33057] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-17 02:01:56,899 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41135] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-17 02:01:56,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41135] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-17 02:01:56,901 INFO [(jenkins-hbase4.apache.org,41135,1676599314522)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-17 02:01:56,901 DEBUG [(jenkins-hbase4.apache.org,41135,1676599314522)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-17 02:01:56,901 DEBUG [(jenkins-hbase4.apache.org,41135,1676599314522)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-17 02:01:56,901 DEBUG [(jenkins-hbase4.apache.org,41135,1676599314522)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-17 02:01:56,902 DEBUG [(jenkins-hbase4.apache.org,41135,1676599314522)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41135-0x100600331fd0000, quorum=127.0.0.1:62388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 02:01:56,902 DEBUG [(jenkins-hbase4.apache.org,41135,1676599314522)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-17 02:01:56,903 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): regionserver:44839-0x100600331fd0002, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 02:01:56,903 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): regionserver:32797-0x100600331fd0001, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 02:01:56,903 DEBUG [(jenkins-hbase4.apache.org,41135,1676599314522)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,32797,1676599314577 2023-02-17 02:01:56,903 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 02:01:56,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 02:01:56,903 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 02:01:56,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 02:01:56,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-17 02:01:56,904 DEBUG [(jenkins-hbase4.apache.org,41135,1676599314522)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41135-0x100600331fd0000, quorum=127.0.0.1:62388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,32797,1676599314577 2023-02-17 02:01:56,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-17 02:01:56,904 DEBUG [(jenkins-hbase4.apache.org,41135,1676599314522)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-17 02:01:56,904 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32797-0x100600331fd0001, quorum=127.0.0.1:62388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 02:01:56,904 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44839-0x100600331fd0002, quorum=127.0.0.1:62388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 02:01:56,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-17 02:01:56,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-17 02:01:56,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-17 02:01:56,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-17 02:01:56,905 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-17 02:01:56,905 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-17 02:01:56,905 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-17 02:01:56,905 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-17 02:01:56,905 DEBUG [member: 'jenkins-hbase4.apache.org,32797,1676599314577' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-17 02:01:56,905 DEBUG [member: 'jenkins-hbase4.apache.org,32797,1676599314577' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-17 02:01:56,905 DEBUG [member: 'jenkins-hbase4.apache.org,44839,1676599314599' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-17 02:01:56,905 DEBUG [member: 'jenkins-hbase4.apache.org,32797,1676599314577' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-17 02:01:56,905 DEBUG [member: 'jenkins-hbase4.apache.org,44839,1676599314599' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-17 02:01:56,905 DEBUG [member: 'jenkins-hbase4.apache.org,44839,1676599314599' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-17 02:01:56,905 DEBUG [member: 'jenkins-hbase4.apache.org,44839,1676599314599' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-17 02:01:56,905 DEBUG [member: 'jenkins-hbase4.apache.org,44839,1676599314599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44839,1676599314599' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-17 02:01:56,905 DEBUG [member: 'jenkins-hbase4.apache.org,32797,1676599314577' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-17 02:01:56,905 DEBUG [member: 'jenkins-hbase4.apache.org,32797,1676599314577' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-17 02:01:56,906 DEBUG [rs(jenkins-hbase4.apache.org,32797,1676599314577)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676599315626.9dfdf91eb690503c331d246b6cb8e1a1. 2023-02-17 02:01:56,906 DEBUG [rs(jenkins-hbase4.apache.org,32797,1676599314577)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676599315626.9dfdf91eb690503c331d246b6cb8e1a1. started... 2023-02-17 02:01:56,906 INFO [rs(jenkins-hbase4.apache.org,32797,1676599314577)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 9dfdf91eb690503c331d246b6cb8e1a1 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-17 02:01:56,908 DEBUG [member: 'jenkins-hbase4.apache.org,44839,1676599314599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 02:01:56,909 DEBUG [member: 'jenkins-hbase4.apache.org,44839,1676599314599' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44839-0x100600331fd0002, quorum=127.0.0.1:62388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 02:01:56,909 DEBUG [member: 'jenkins-hbase4.apache.org,44839,1676599314599' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 02:01:56,924 INFO [rs(jenkins-hbase4.apache.org,32797,1676599314577)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/data/default/testWithMapReduce/9dfdf91eb690503c331d246b6cb8e1a1/.tmp/f1/c4cc229b5b884945a81cc7bdefd62c0f 2023-02-17 02:01:56,945 INFO [rs(jenkins-hbase4.apache.org,32797,1676599314577)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/data/default/testWithMapReduce/9dfdf91eb690503c331d246b6cb8e1a1/.tmp/f2/071639758cc3413e91e6eeb3f78ea8d5 2023-02-17 02:01:56,949 DEBUG [rs(jenkins-hbase4.apache.org,32797,1676599314577)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/data/default/testWithMapReduce/9dfdf91eb690503c331d246b6cb8e1a1/.tmp/f1/c4cc229b5b884945a81cc7bdefd62c0f as hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/data/default/testWithMapReduce/9dfdf91eb690503c331d246b6cb8e1a1/f1/c4cc229b5b884945a81cc7bdefd62c0f 2023-02-17 02:01:56,953 INFO [rs(jenkins-hbase4.apache.org,32797,1676599314577)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/data/default/testWithMapReduce/9dfdf91eb690503c331d246b6cb8e1a1/f1/c4cc229b5b884945a81cc7bdefd62c0f, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-17 02:01:56,953 DEBUG [rs(jenkins-hbase4.apache.org,32797,1676599314577)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/data/default/testWithMapReduce/9dfdf91eb690503c331d246b6cb8e1a1/.tmp/f2/071639758cc3413e91e6eeb3f78ea8d5 as hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/data/default/testWithMapReduce/9dfdf91eb690503c331d246b6cb8e1a1/f2/071639758cc3413e91e6eeb3f78ea8d5 2023-02-17 02:01:56,957 INFO [rs(jenkins-hbase4.apache.org,32797,1676599314577)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/data/default/testWithMapReduce/9dfdf91eb690503c331d246b6cb8e1a1/f2/071639758cc3413e91e6eeb3f78ea8d5, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-17 02:01:56,958 INFO [rs(jenkins-hbase4.apache.org,32797,1676599314577)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 9dfdf91eb690503c331d246b6cb8e1a1 in 52ms, sequenceid=9, compaction requested=false 2023-02-17 02:01:56,958 DEBUG [rs(jenkins-hbase4.apache.org,32797,1676599314577)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 9dfdf91eb690503c331d246b6cb8e1a1: 2023-02-17 02:01:56,958 DEBUG [rs(jenkins-hbase4.apache.org,32797,1676599314577)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676599315626.9dfdf91eb690503c331d246b6cb8e1a1. 2023-02-17 02:01:56,958 DEBUG [member: 'jenkins-hbase4.apache.org,32797,1676599314577' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-17 02:01:56,958 DEBUG [member: 'jenkins-hbase4.apache.org,32797,1676599314577' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-17 02:01:56,958 DEBUG [member: 'jenkins-hbase4.apache.org,32797,1676599314577' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32797,1676599314577 2023-02-17 02:01:56,958 DEBUG [member: 'jenkins-hbase4.apache.org,32797,1676599314577' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-17 02:01:56,958 DEBUG [member: 'jenkins-hbase4.apache.org,32797,1676599314577' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32797,1676599314577' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-17 02:01:56,960 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): master:41135-0x100600331fd0000, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,32797,1676599314577 2023-02-17 02:01:56,960 DEBUG [member: 'jenkins-hbase4.apache.org,32797,1676599314577' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 02:01:56,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,32797,1676599314577 2023-02-17 02:01:56,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 02:01:56,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-17 02:01:56,960 DEBUG [member: 'jenkins-hbase4.apache.org,32797,1676599314577' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32797-0x100600331fd0001, quorum=127.0.0.1:62388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 02:01:56,960 DEBUG [member: 'jenkins-hbase4.apache.org,32797,1676599314577' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 02:01:56,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 02:01:56,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 02:01:56,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-17 02:01:56,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32797,1676599314577 2023-02-17 02:01:56,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44839,1676599314599 2023-02-17 02:01:56,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 02:01:56,962 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32797,1676599314577' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-17 02:01:56,962 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1c6d103c[Count = 0] remaining members to acquire global barrier 2023-02-17 02:01:56,962 DEBUG [(jenkins-hbase4.apache.org,41135,1676599314522)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-17 02:01:56,962 DEBUG [(jenkins-hbase4.apache.org,41135,1676599314522)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 02:01:56,963 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): regionserver:44839-0x100600331fd0002, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 02:01:56,963 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): regionserver:32797-0x100600331fd0001, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 02:01:56,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 02:01:56,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 02:01:56,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 02:01:56,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 02:01:56,963 DEBUG [member: 'jenkins-hbase4.apache.org,32797,1676599314577' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-17 02:01:56,963 DEBUG [(jenkins-hbase4.apache.org,41135,1676599314522)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41135-0x100600331fd0000, quorum=127.0.0.1:62388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,32797,1676599314577 2023-02-17 02:01:56,963 DEBUG [(jenkins-hbase4.apache.org,41135,1676599314522)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-17 02:01:56,963 DEBUG [member: 'jenkins-hbase4.apache.org,44839,1676599314599' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-17 02:01:56,963 DEBUG [member: 'jenkins-hbase4.apache.org,44839,1676599314599' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-17 02:01:56,963 DEBUG [member: 'jenkins-hbase4.apache.org,32797,1676599314577' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-17 02:01:56,963 DEBUG [member: 'jenkins-hbase4.apache.org,44839,1676599314599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,44839,1676599314599' in zk 2023-02-17 02:01:56,963 DEBUG [member: 'jenkins-hbase4.apache.org,32797,1676599314577' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,32797,1676599314577' in zk 2023-02-17 02:01:56,964 DEBUG [member: 'jenkins-hbase4.apache.org,32797,1676599314577' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-17 02:01:56,964 DEBUG [member: 'jenkins-hbase4.apache.org,32797,1676599314577' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 02:01:56,964 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): master:41135-0x100600331fd0000, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,32797,1676599314577 2023-02-17 02:01:56,964 DEBUG [member: 'jenkins-hbase4.apache.org,32797,1676599314577' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-17 02:01:56,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,32797,1676599314577 2023-02-17 02:01:56,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 02:01:56,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-17 02:01:56,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 02:01:56,966 DEBUG [member: 'jenkins-hbase4.apache.org,44839,1676599314599' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-17 02:01:56,966 DEBUG [member: 'jenkins-hbase4.apache.org,44839,1676599314599' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 02:01:56,966 DEBUG [member: 'jenkins-hbase4.apache.org,44839,1676599314599' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-17 02:01:56,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 02:01:56,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-17 02:01:56,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32797,1676599314577 2023-02-17 02:01:56,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44839,1676599314599 2023-02-17 02:01:56,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 02:01:56,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-17 02:01:56,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32797,1676599314577 2023-02-17 02:01:56,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44839,1676599314599 2023-02-17 02:01:56,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,32797,1676599314577': 2023-02-17 02:01:56,968 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32797,1676599314577' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-17 02:01:56,968 INFO [(jenkins-hbase4.apache.org,41135,1676599314522)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-17 02:01:56,968 DEBUG [(jenkins-hbase4.apache.org,41135,1676599314522)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-17 02:01:56,968 DEBUG [(jenkins-hbase4.apache.org,41135,1676599314522)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-17 02:01:56,968 DEBUG [(jenkins-hbase4.apache.org,41135,1676599314522)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-17 02:01:56,968 INFO [(jenkins-hbase4.apache.org,41135,1676599314522)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-17 02:01:56,970 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): master:41135-0x100600331fd0000, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 02:01:56,970 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): regionserver:44839-0x100600331fd0002, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 02:01:56,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 02:01:56,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 02:01:56,970 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): regionserver:32797-0x100600331fd0001, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 02:01:56,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 02:01:56,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 02:01:56,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-17 02:01:56,970 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): regionserver:44839-0x100600331fd0002, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 02:01:56,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 02:01:56,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 02:01:56,970 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): regionserver:32797-0x100600331fd0001, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 02:01:56,970 DEBUG [(jenkins-hbase4.apache.org,41135,1676599314522)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41135-0x100600331fd0000, quorum=127.0.0.1:62388, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,32797,1676599314577 2023-02-17 02:01:56,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 02:01:56,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 02:01:56,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 02:01:56,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 02:01:56,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 02:01:56,970 DEBUG [(jenkins-hbase4.apache.org,41135,1676599314522)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41135-0x100600331fd0000, quorum=127.0.0.1:62388, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44839,1676599314599 2023-02-17 02:01:56,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 02:01:56,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 02:01:56,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-17 02:01:56,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 02:01:56,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-17 02:01:56,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32797,1676599314577 2023-02-17 02:01:56,972 DEBUG [(jenkins-hbase4.apache.org,41135,1676599314522)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41135-0x100600331fd0000, quorum=127.0.0.1:62388, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,32797,1676599314577 2023-02-17 02:01:56,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44839,1676599314599 2023-02-17 02:01:56,972 DEBUG [(jenkins-hbase4.apache.org,41135,1676599314522)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41135-0x100600331fd0000, quorum=127.0.0.1:62388, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,44839,1676599314599 2023-02-17 02:01:56,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 02:01:56,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-17 02:01:56,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32797,1676599314577 2023-02-17 02:01:56,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44839,1676599314599 2023-02-17 02:01:56,974 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): master:41135-0x100600331fd0000, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44839,1676599314599 2023-02-17 02:01:56,974 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): regionserver:32797-0x100600331fd0001, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 02:01:56,974 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): regionserver:44839-0x100600331fd0002, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 02:01:56,974 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 02:01:56,974 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): regionserver:32797-0x100600331fd0001, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 02:01:56,974 DEBUG [(jenkins-hbase4.apache.org,41135,1676599314522)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 02:01:56,974 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): master:41135-0x100600331fd0000, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-17 02:01:56,974 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41135] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-17 02:01:56,974 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41135] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-17 02:01:56,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 02:01:56,974 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 02:01:56,974 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): regionserver:44839-0x100600331fd0002, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 02:01:56,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 02:01:56,974 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): master:41135-0x100600331fd0000, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,32797,1676599314577 2023-02-17 02:01:56,975 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): master:41135-0x100600331fd0000, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-17 02:01:56,975 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): master:41135-0x100600331fd0000, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,44839,1676599314599 2023-02-17 02:01:56,975 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): master:41135-0x100600331fd0000, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 02:01:56,975 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): master:41135-0x100600331fd0000, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,32797,1676599314577 2023-02-17 02:01:56,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 02:01:56,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 02:01:56,975 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): master:41135-0x100600331fd0000, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 02:01:56,975 DEBUG [Listener at localhost/33057] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-17 02:01:56,975 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): master:41135-0x100600331fd0000, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 02:01:56,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 02:01:56,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 02:01:56,975 DEBUG [Listener at localhost/33057] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-17 02:01:57,075 DEBUG [Listener at localhost/33057] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-17 02:01:57,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41135] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-17 02:01:57,201 DEBUG [Listener at localhost/33057] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1aafa483-04ba-e0d5-ce04-237121cc5150/hadoop-5288316872388949311.jar 2023-02-17 02:01:57,207 INFO [Listener at localhost/33057] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1676599316457 type: FLUSH version: 2 ttl: 0 2023-02-17 02:01:57,207 DEBUG [Listener at localhost/33057] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:34757/user/jenkins/test-data/f6e3e3cf-7367-9bf2-0355-df0d1fed2364/testWithMapReduceSingleRegion/7262eeb0-8345-42f3-a804-399eac61a2de/data/default/testWithMapReduce 2023-02-17 02:01:57,207 INFO [Listener at localhost/33057] snapshot.RestoreSnapshotHelper(239): region to add: 9dfdf91eb690503c331d246b6cb8e1a1 2023-02-17 02:01:57,208 INFO [Listener at localhost/33057] snapshot.RestoreSnapshotHelper(585): clone region=9dfdf91eb690503c331d246b6cb8e1a1 as 9dfdf91eb690503c331d246b6cb8e1a1 in snapshot testWithMapReduceSingleRegion 2023-02-17 02:01:57,209 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 9dfdf91eb690503c331d246b6cb8e1a1, NAME => 'testWithMapReduce,,1676599315626.9dfdf91eb690503c331d246b6cb8e1a1.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34757/user/jenkins/test-data/f6e3e3cf-7367-9bf2-0355-df0d1fed2364/testWithMapReduceSingleRegion/7262eeb0-8345-42f3-a804-399eac61a2de 2023-02-17 02:01:57,632 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676599315626.9dfdf91eb690503c331d246b6cb8e1a1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:57,632 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink ce66757be72947cc8c4b2c5f9baa9b36 from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-17 02:01:57,634 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 26fcc9be7025412dab3d8de5ff9a72e3 from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-17 02:01:57,636 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 9dfdf91eb690503c331d246b6cb8e1a1, disabling compactions & flushes 2023-02-17 02:01:57,636 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676599315626.9dfdf91eb690503c331d246b6cb8e1a1. 2023-02-17 02:01:57,636 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676599315626.9dfdf91eb690503c331d246b6cb8e1a1. 2023-02-17 02:01:57,636 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676599315626.9dfdf91eb690503c331d246b6cb8e1a1. after waiting 0 ms 2023-02-17 02:01:57,636 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676599315626.9dfdf91eb690503c331d246b6cb8e1a1. 2023-02-17 02:01:57,637 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676599315626.9dfdf91eb690503c331d246b6cb8e1a1. 2023-02-17 02:01:57,637 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 9dfdf91eb690503c331d246b6cb8e1a1: 2023-02-17 02:01:57,637 INFO [Listener at localhost/33057] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1676599316457 type: FLUSH version: 2 ttl: 0 2023-02-17 02:01:57,637 DEBUG [Listener at localhost/33057] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:34757/user/jenkins/test-data/f6e3e3cf-7367-9bf2-0355-df0d1fed2364/testWithMapReduceSingleRegion/7262eeb0-8345-42f3-a804-399eac61a2de 2023-02-17 02:01:57,637 DEBUG [Listener at localhost/33057] util.CommonFSUtils(682): File system contents for path hdfs://localhost:34757/user/jenkins/test-data/f6e3e3cf-7367-9bf2-0355-df0d1fed2364/testWithMapReduceSingleRegion/7262eeb0-8345-42f3-a804-399eac61a2de 2023-02-17 02:01:57,637 DEBUG [Listener at localhost/33057] util.CommonFSUtils(699): |-data/ 2023-02-17 02:01:57,638 DEBUG [Listener at localhost/33057] util.CommonFSUtils(699): |----default/ 2023-02-17 02:01:57,638 DEBUG [Listener at localhost/33057] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-17 02:01:57,639 DEBUG [Listener at localhost/33057] util.CommonFSUtils(699): |----------9dfdf91eb690503c331d246b6cb8e1a1/ 2023-02-17 02:01:57,639 DEBUG [Listener at localhost/33057] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 02:01:57,639 DEBUG [Listener at localhost/33057] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 02:01:57,640 DEBUG [Listener at localhost/33057] util.CommonFSUtils(702): |----------------testWithMapReduce=9dfdf91eb690503c331d246b6cb8e1a1-ce66757be72947cc8c4b2c5f9baa9b36 2023-02-17 02:01:57,640 DEBUG [Listener at localhost/33057] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 02:01:57,640 DEBUG [Listener at localhost/33057] util.CommonFSUtils(702): |----------------testWithMapReduce=9dfdf91eb690503c331d246b6cb8e1a1-26fcc9be7025412dab3d8de5ff9a72e3 2023-02-17 02:01:57,641 DEBUG [Listener at localhost/33057] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-17 02:01:57,641 DEBUG [Listener at localhost/33057] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-17 02:01:57,641 DEBUG [Listener at localhost/33057] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-17 02:01:57,642 DEBUG [Listener at localhost/33057] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-17 02:01:58,548 DEBUG [Listener at localhost/33057] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1aafa483-04ba-e0d5-ce04-237121cc5150/hadoop-2485617448812970884.jar 2023-02-17 02:01:58,549 DEBUG [Listener at localhost/33057] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-17 02:01:58,549 DEBUG [Listener at localhost/33057] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-17 02:01:58,615 DEBUG [Listener at localhost/33057] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1aafa483-04ba-e0d5-ce04-237121cc5150/hadoop-3073233170830762968.jar 2023-02-17 02:01:58,616 DEBUG [Listener at localhost/33057] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-17 02:01:58,616 DEBUG [Listener at localhost/33057] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-17 02:01:58,617 DEBUG [Listener at localhost/33057] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-17 02:01:58,617 DEBUG [Listener at localhost/33057] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-17 02:01:58,617 DEBUG [Listener at localhost/33057] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-17 02:01:58,618 DEBUG [Listener at localhost/33057] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-17 02:01:58,618 DEBUG [Listener at localhost/33057] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-17 02:01:58,618 DEBUG [Listener at localhost/33057] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-17 02:01:58,619 DEBUG [Listener at localhost/33057] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-17 02:01:58,619 DEBUG [Listener at localhost/33057] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-17 02:01:58,619 DEBUG [Listener at localhost/33057] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-17 02:01:58,620 DEBUG [Listener at localhost/33057] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-17 02:01:58,620 DEBUG [Listener at localhost/33057] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-17 02:01:58,621 DEBUG [Listener at localhost/33057] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-17 02:01:58,621 DEBUG [Listener at localhost/33057] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-17 02:01:58,622 DEBUG [Listener at localhost/33057] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-17 02:01:58,622 DEBUG [Listener at localhost/33057] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-17 02:01:58,622 DEBUG [Listener at localhost/33057] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-17 02:01:58,623 DEBUG [Listener at localhost/33057] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-17 02:01:58,623 DEBUG [Listener at localhost/33057] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-17 02:01:58,624 DEBUG [Listener at localhost/33057] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-17 02:01:58,689 DEBUG [Listener at localhost/33057] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1aafa483-04ba-e0d5-ce04-237121cc5150/hadoop-2022824482454533764.jar 2023-02-17 02:01:58,690 DEBUG [Listener at localhost/33057] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-17 02:01:58,695 WARN [Listener at localhost/33057] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-17 02:01:58,701 WARN [Listener at localhost/33057] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-02-17 02:01:58,708 INFO [Listener at localhost/33057] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-17 02:01:58,791 WARN [Listener at localhost/33057] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1aafa483-04ba-e0d5-ce04-237121cc5150/mapreduce.cluster.local.dir/1676599318757/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-17 02:01:58,791 WARN [Listener at localhost/33057] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1aafa483-04ba-e0d5-ce04-237121cc5150/mapreduce.cluster.local.dir/1676599318757/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-17 02:01:58,823 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676599315626.9dfdf91eb690503c331d246b6cb8e1a1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 02:01:58,823 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 02:01:58,824 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 02:01:58,825 INFO [StoreOpener-9dfdf91eb690503c331d246b6cb8e1a1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9dfdf91eb690503c331d246b6cb8e1a1 2023-02-17 02:01:58,826 DEBUG [StoreOpener-9dfdf91eb690503c331d246b6cb8e1a1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34757/user/jenkins/test-data/f6e3e3cf-7367-9bf2-0355-df0d1fed2364/testWithMapReduceSingleRegion/7262eeb0-8345-42f3-a804-399eac61a2de/data/default/testWithMapReduce/9dfdf91eb690503c331d246b6cb8e1a1/f1 2023-02-17 02:01:58,827 INFO [StoreOpener-9dfdf91eb690503c331d246b6cb8e1a1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9dfdf91eb690503c331d246b6cb8e1a1 columnFamilyName f1 2023-02-17 02:01:58,831 DEBUG [StoreOpener-9dfdf91eb690503c331d246b6cb8e1a1-1] regionserver.HStore(539): loaded hdfs://localhost:34757/user/jenkins/test-data/f6e3e3cf-7367-9bf2-0355-df0d1fed2364/testWithMapReduceSingleRegion/7262eeb0-8345-42f3-a804-399eac61a2de/data/default/testWithMapReduce/9dfdf91eb690503c331d246b6cb8e1a1/f1/testWithMapReduce=9dfdf91eb690503c331d246b6cb8e1a1-ce66757be72947cc8c4b2c5f9baa9b36 2023-02-17 02:01:58,831 INFO [StoreOpener-9dfdf91eb690503c331d246b6cb8e1a1-1] regionserver.HStore(310): Store=9dfdf91eb690503c331d246b6cb8e1a1/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:58,831 INFO [StoreOpener-9dfdf91eb690503c331d246b6cb8e1a1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 9dfdf91eb690503c331d246b6cb8e1a1 2023-02-17 02:01:58,832 DEBUG [StoreOpener-9dfdf91eb690503c331d246b6cb8e1a1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34757/user/jenkins/test-data/f6e3e3cf-7367-9bf2-0355-df0d1fed2364/testWithMapReduceSingleRegion/7262eeb0-8345-42f3-a804-399eac61a2de/data/default/testWithMapReduce/9dfdf91eb690503c331d246b6cb8e1a1/f2 2023-02-17 02:01:58,832 INFO [StoreOpener-9dfdf91eb690503c331d246b6cb8e1a1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9dfdf91eb690503c331d246b6cb8e1a1 columnFamilyName f2 2023-02-17 02:01:58,836 DEBUG [StoreOpener-9dfdf91eb690503c331d246b6cb8e1a1-1] regionserver.HStore(539): loaded hdfs://localhost:34757/user/jenkins/test-data/f6e3e3cf-7367-9bf2-0355-df0d1fed2364/testWithMapReduceSingleRegion/7262eeb0-8345-42f3-a804-399eac61a2de/data/default/testWithMapReduce/9dfdf91eb690503c331d246b6cb8e1a1/f2/testWithMapReduce=9dfdf91eb690503c331d246b6cb8e1a1-26fcc9be7025412dab3d8de5ff9a72e3 2023-02-17 02:01:58,836 INFO [StoreOpener-9dfdf91eb690503c331d246b6cb8e1a1-1] regionserver.HStore(310): Store=9dfdf91eb690503c331d246b6cb8e1a1/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 02:01:58,836 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 02:01:58,836 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 9dfdf91eb690503c331d246b6cb8e1a1; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64880342, jitterRate=-0.03320756554603577}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 02:01:58,836 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 9dfdf91eb690503c331d246b6cb8e1a1: 2023-02-17 02:01:58,953 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 9dfdf91eb690503c331d246b6cb8e1a1, disabling compactions & flushes 2023-02-17 02:01:58,953 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676599315626.9dfdf91eb690503c331d246b6cb8e1a1. 2023-02-17 02:01:58,953 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676599315626.9dfdf91eb690503c331d246b6cb8e1a1. 2023-02-17 02:01:58,953 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676599315626.9dfdf91eb690503c331d246b6cb8e1a1. after waiting 0 ms 2023-02-17 02:01:58,953 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676599315626.9dfdf91eb690503c331d246b6cb8e1a1. 2023-02-17 02:01:58,954 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676599315626.9dfdf91eb690503c331d246b6cb8e1a1. 2023-02-17 02:01:58,954 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 9dfdf91eb690503c331d246b6cb8e1a1: 2023-02-17 02:01:59,826 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41135] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMapReduceSingleRegion" 2023-02-17 02:01:59,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41135] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceSingleRegion 2023-02-17 02:01:59,830 INFO [Listener at localhost/33057] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-17 02:01:59,830 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41135] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-17 02:01:59,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41135] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-17 02:01:59,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41135] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-17 02:01:59,833 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676599319833"}]},"ts":"1676599319833"} 2023-02-17 02:01:59,834 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-17 02:01:59,836 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-17 02:01:59,836 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=9dfdf91eb690503c331d246b6cb8e1a1, UNASSIGN}] 2023-02-17 02:01:59,837 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=9dfdf91eb690503c331d246b6cb8e1a1, UNASSIGN 2023-02-17 02:01:59,837 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=9dfdf91eb690503c331d246b6cb8e1a1, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,32797,1676599314577 2023-02-17 02:01:59,838 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676599315626.9dfdf91eb690503c331d246b6cb8e1a1.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676599319837"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676599319837"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676599319837"}]},"ts":"1676599319837"} 2023-02-17 02:01:59,839 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 9dfdf91eb690503c331d246b6cb8e1a1, server=jenkins-hbase4.apache.org,32797,1676599314577}] 2023-02-17 02:01:59,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41135] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-17 02:01:59,990 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 9dfdf91eb690503c331d246b6cb8e1a1 2023-02-17 02:01:59,990 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 9dfdf91eb690503c331d246b6cb8e1a1, disabling compactions & flushes 2023-02-17 02:01:59,990 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676599315626.9dfdf91eb690503c331d246b6cb8e1a1. 2023-02-17 02:01:59,990 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676599315626.9dfdf91eb690503c331d246b6cb8e1a1. 2023-02-17 02:01:59,990 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676599315626.9dfdf91eb690503c331d246b6cb8e1a1. after waiting 0 ms 2023-02-17 02:01:59,990 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676599315626.9dfdf91eb690503c331d246b6cb8e1a1. 2023-02-17 02:01:59,994 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/data/default/testWithMapReduce/9dfdf91eb690503c331d246b6cb8e1a1/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 02:01:59,995 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676599315626.9dfdf91eb690503c331d246b6cb8e1a1. 2023-02-17 02:01:59,996 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 9dfdf91eb690503c331d246b6cb8e1a1: 2023-02-17 02:01:59,997 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 9dfdf91eb690503c331d246b6cb8e1a1 2023-02-17 02:01:59,997 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=9dfdf91eb690503c331d246b6cb8e1a1, regionState=CLOSED 2023-02-17 02:01:59,998 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1676599315626.9dfdf91eb690503c331d246b6cb8e1a1.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676599319997"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676599319997"}]},"ts":"1676599319997"} 2023-02-17 02:02:00,000 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-17 02:02:00,000 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 9dfdf91eb690503c331d246b6cb8e1a1, server=jenkins-hbase4.apache.org,32797,1676599314577 in 160 msec 2023-02-17 02:02:00,001 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-17 02:02:00,001 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=9dfdf91eb690503c331d246b6cb8e1a1, UNASSIGN in 164 msec 2023-02-17 02:02:00,002 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676599320002"}]},"ts":"1676599320002"} 2023-02-17 02:02:00,003 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-17 02:02:00,005 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-17 02:02:00,007 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 176 msec 2023-02-17 02:02:00,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41135] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-17 02:02:00,136 INFO [Listener at localhost/33057] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 15 completed 2023-02-17 02:02:00,136 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41135] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testWithMapReduce 2023-02-17 02:02:00,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41135] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-17 02:02:00,139 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-17 02:02:00,139 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-17 02:02:00,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41135] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-17 02:02:00,142 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/.tmp/data/default/testWithMapReduce/9dfdf91eb690503c331d246b6cb8e1a1 2023-02-17 02:02:00,144 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/.tmp/data/default/testWithMapReduce/9dfdf91eb690503c331d246b6cb8e1a1/f1, FileablePath, hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/.tmp/data/default/testWithMapReduce/9dfdf91eb690503c331d246b6cb8e1a1/f2, FileablePath, hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/.tmp/data/default/testWithMapReduce/9dfdf91eb690503c331d246b6cb8e1a1/recovered.edits] 2023-02-17 02:02:00,146 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/.tmp/data/default/testWithMapReduce/9dfdf91eb690503c331d246b6cb8e1a1/f1/c4cc229b5b884945a81cc7bdefd62c0f to hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/archive/data/default/testWithMapReduce/9dfdf91eb690503c331d246b6cb8e1a1/f1/c4cc229b5b884945a81cc7bdefd62c0f 2023-02-17 02:02:00,147 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/.tmp/data/default/testWithMapReduce/9dfdf91eb690503c331d246b6cb8e1a1/f1/ce66757be72947cc8c4b2c5f9baa9b36 to hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/archive/data/default/testWithMapReduce/9dfdf91eb690503c331d246b6cb8e1a1/f1/ce66757be72947cc8c4b2c5f9baa9b36 2023-02-17 02:02:00,149 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/.tmp/data/default/testWithMapReduce/9dfdf91eb690503c331d246b6cb8e1a1/f2/071639758cc3413e91e6eeb3f78ea8d5 to hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/archive/data/default/testWithMapReduce/9dfdf91eb690503c331d246b6cb8e1a1/f2/071639758cc3413e91e6eeb3f78ea8d5 2023-02-17 02:02:00,150 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/.tmp/data/default/testWithMapReduce/9dfdf91eb690503c331d246b6cb8e1a1/f2/26fcc9be7025412dab3d8de5ff9a72e3 to hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/archive/data/default/testWithMapReduce/9dfdf91eb690503c331d246b6cb8e1a1/f2/26fcc9be7025412dab3d8de5ff9a72e3 2023-02-17 02:02:00,152 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/.tmp/data/default/testWithMapReduce/9dfdf91eb690503c331d246b6cb8e1a1/recovered.edits/12.seqid to hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/archive/data/default/testWithMapReduce/9dfdf91eb690503c331d246b6cb8e1a1/recovered.edits/12.seqid 2023-02-17 02:02:00,153 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/.tmp/data/default/testWithMapReduce/9dfdf91eb690503c331d246b6cb8e1a1 2023-02-17 02:02:00,153 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-17 02:02:00,154 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-17 02:02:00,156 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMapReduce from hbase:meta 2023-02-17 02:02:00,157 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-17 02:02:00,158 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-17 02:02:00,158 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-17 02:02:00,158 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1676599315626.9dfdf91eb690503c331d246b6cb8e1a1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676599320158"}]},"ts":"9223372036854775807"} 2023-02-17 02:02:00,159 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-17 02:02:00,159 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 9dfdf91eb690503c331d246b6cb8e1a1, NAME => 'testWithMapReduce,,1676599315626.9dfdf91eb690503c331d246b6cb8e1a1.', STARTKEY => '', ENDKEY => ''}] 2023-02-17 02:02:00,159 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-17 02:02:00,159 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676599320159"}]},"ts":"9223372036854775807"} 2023-02-17 02:02:00,160 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-17 02:02:00,162 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-17 02:02:00,163 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 25 msec 2023-02-17 02:02:00,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41135] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-17 02:02:00,241 INFO [Listener at localhost/33057] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 18 completed 2023-02-17 02:02:00,241 INFO [Listener at localhost/33057] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-17 02:02:00,241 INFO [Listener at localhost/33057] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-17 02:02:00,241 DEBUG [Listener at localhost/33057] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x220a9eaf to 127.0.0.1:62388 2023-02-17 02:02:00,241 DEBUG [Listener at localhost/33057] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 02:02:00,242 DEBUG [Listener at localhost/33057] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-17 02:02:00,242 DEBUG [Listener at localhost/33057] util.JVMClusterUtil(257): Found active master hash=180730079, stopped=false 2023-02-17 02:02:00,242 INFO [Listener at localhost/33057] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,41135,1676599314522 2023-02-17 02:02:00,245 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): master:41135-0x100600331fd0000, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-17 02:02:00,245 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): regionserver:44839-0x100600331fd0002, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-17 02:02:00,245 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): master:41135-0x100600331fd0000, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 02:02:00,245 INFO [Listener at localhost/33057] procedure2.ProcedureExecutor(629): Stopping 2023-02-17 02:02:00,245 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): regionserver:32797-0x100600331fd0001, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-17 02:02:00,245 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41135-0x100600331fd0000, quorum=127.0.0.1:62388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 02:02:00,245 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44839-0x100600331fd0002, quorum=127.0.0.1:62388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 02:02:00,247 DEBUG [Listener at localhost/33057] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x06acc226 to 127.0.0.1:62388 2023-02-17 02:02:00,247 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32797-0x100600331fd0001, quorum=127.0.0.1:62388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 02:02:00,247 DEBUG [Listener at localhost/33057] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 02:02:00,247 INFO [Listener at localhost/33057] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,32797,1676599314577' ***** 2023-02-17 02:02:00,247 INFO [Listener at localhost/33057] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-17 02:02:00,247 INFO [Listener at localhost/33057] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,44839,1676599314599' ***** 2023-02-17 02:02:00,247 INFO [Listener at localhost/33057] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-17 02:02:00,247 INFO [RS:0;jenkins-hbase4:32797] regionserver.HeapMemoryManager(220): Stopping 2023-02-17 02:02:00,247 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-17 02:02:00,247 INFO [RS:1;jenkins-hbase4:44839] regionserver.HeapMemoryManager(220): Stopping 2023-02-17 02:02:00,247 INFO [RS:0;jenkins-hbase4:32797] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-17 02:02:00,249 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-17 02:02:00,249 INFO [RS:0;jenkins-hbase4:32797] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-17 02:02:00,249 INFO [RS:1;jenkins-hbase4:44839] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-17 02:02:00,249 INFO [RS:0;jenkins-hbase4:32797] regionserver.HRegionServer(3304): Received CLOSE for 4ac9fd86b5a58ee8ce839b55d933f24d 2023-02-17 02:02:00,249 INFO [RS:1;jenkins-hbase4:44839] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-17 02:02:00,249 INFO [RS:0;jenkins-hbase4:32797] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,32797,1676599314577 2023-02-17 02:02:00,250 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 4ac9fd86b5a58ee8ce839b55d933f24d, disabling compactions & flushes 2023-02-17 02:02:00,250 DEBUG [RS:0;jenkins-hbase4:32797] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7dd4b618 to 127.0.0.1:62388 2023-02-17 02:02:00,250 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676599315133.4ac9fd86b5a58ee8ce839b55d933f24d. 2023-02-17 02:02:00,250 DEBUG [RS:0;jenkins-hbase4:32797] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 02:02:00,250 INFO [RS:1;jenkins-hbase4:44839] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,44839,1676599314599 2023-02-17 02:02:00,250 INFO [RS:0;jenkins-hbase4:32797] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-17 02:02:00,250 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676599315133.4ac9fd86b5a58ee8ce839b55d933f24d. 2023-02-17 02:02:00,250 DEBUG [RS:0;jenkins-hbase4:32797] regionserver.HRegionServer(1479): Online Regions={4ac9fd86b5a58ee8ce839b55d933f24d=hbase:namespace,,1676599315133.4ac9fd86b5a58ee8ce839b55d933f24d.} 2023-02-17 02:02:00,250 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676599315133.4ac9fd86b5a58ee8ce839b55d933f24d. after waiting 0 ms 2023-02-17 02:02:00,250 DEBUG [RS:1;jenkins-hbase4:44839] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x59c56f0f to 127.0.0.1:62388 2023-02-17 02:02:00,250 DEBUG [RS:0;jenkins-hbase4:32797] regionserver.HRegionServer(1505): Waiting on 4ac9fd86b5a58ee8ce839b55d933f24d 2023-02-17 02:02:00,250 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676599315133.4ac9fd86b5a58ee8ce839b55d933f24d. 2023-02-17 02:02:00,250 DEBUG [RS:1;jenkins-hbase4:44839] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 02:02:00,250 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 4ac9fd86b5a58ee8ce839b55d933f24d 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-17 02:02:00,250 INFO [RS:1;jenkins-hbase4:44839] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-17 02:02:00,250 INFO [RS:1;jenkins-hbase4:44839] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-17 02:02:00,250 INFO [RS:1;jenkins-hbase4:44839] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-17 02:02:00,250 INFO [RS:1;jenkins-hbase4:44839] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-17 02:02:00,250 INFO [RS:1;jenkins-hbase4:44839] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-17 02:02:00,251 DEBUG [RS:1;jenkins-hbase4:44839] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-17 02:02:00,251 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-17 02:02:00,251 DEBUG [RS:1;jenkins-hbase4:44839] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-17 02:02:00,251 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-17 02:02:00,251 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-17 02:02:00,251 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-17 02:02:00,251 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-17 02:02:00,251 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=3.70 KB heapSize=7.12 KB 2023-02-17 02:02:00,277 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-17 02:02:00,288 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-17 02:02:00,450 DEBUG [RS:0;jenkins-hbase4:32797] regionserver.HRegionServer(1505): Waiting on 4ac9fd86b5a58ee8ce839b55d933f24d 2023-02-17 02:02:00,451 DEBUG [RS:1;jenkins-hbase4:44839] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-17 02:02:00,650 DEBUG [RS:0;jenkins-hbase4:32797] regionserver.HRegionServer(1505): Waiting on 4ac9fd86b5a58ee8ce839b55d933f24d 2023-02-17 02:02:00,651 DEBUG [RS:1;jenkins-hbase4:44839] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-17 02:02:00,659 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/data/hbase/namespace/4ac9fd86b5a58ee8ce839b55d933f24d/.tmp/info/60692a6f68ce4ea09bb6a1ab6d1a0cba 2023-02-17 02:02:00,660 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.19 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/data/hbase/meta/1588230740/.tmp/info/bca329a7617844a2b8c821e24b1ffc65 2023-02-17 02:02:00,664 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bca329a7617844a2b8c821e24b1ffc65 2023-02-17 02:02:00,664 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/data/hbase/namespace/4ac9fd86b5a58ee8ce839b55d933f24d/.tmp/info/60692a6f68ce4ea09bb6a1ab6d1a0cba as hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/data/hbase/namespace/4ac9fd86b5a58ee8ce839b55d933f24d/info/60692a6f68ce4ea09bb6a1ab6d1a0cba 2023-02-17 02:02:00,669 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/data/hbase/namespace/4ac9fd86b5a58ee8ce839b55d933f24d/info/60692a6f68ce4ea09bb6a1ab6d1a0cba, entries=2, sequenceid=6, filesize=4.8 K 2023-02-17 02:02:00,670 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 4ac9fd86b5a58ee8ce839b55d933f24d in 420ms, sequenceid=6, compaction requested=false 2023-02-17 02:02:00,672 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=97 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/data/hbase/meta/1588230740/.tmp/rep_barrier/ece349a58a5e408d8a7483c8209f48ba 2023-02-17 02:02:00,673 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/data/hbase/namespace/4ac9fd86b5a58ee8ce839b55d933f24d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-17 02:02:00,674 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676599315133.4ac9fd86b5a58ee8ce839b55d933f24d. 2023-02-17 02:02:00,674 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 4ac9fd86b5a58ee8ce839b55d933f24d: 2023-02-17 02:02:00,674 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676599315133.4ac9fd86b5a58ee8ce839b55d933f24d. 2023-02-17 02:02:00,676 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ece349a58a5e408d8a7483c8209f48ba 2023-02-17 02:02:00,690 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=428 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/data/hbase/meta/1588230740/.tmp/table/070289aa3e024ce4be4e626a870fb569 2023-02-17 02:02:00,693 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 070289aa3e024ce4be4e626a870fb569 2023-02-17 02:02:00,694 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/data/hbase/meta/1588230740/.tmp/info/bca329a7617844a2b8c821e24b1ffc65 as hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/data/hbase/meta/1588230740/info/bca329a7617844a2b8c821e24b1ffc65 2023-02-17 02:02:00,698 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bca329a7617844a2b8c821e24b1ffc65 2023-02-17 02:02:00,698 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/data/hbase/meta/1588230740/info/bca329a7617844a2b8c821e24b1ffc65, entries=12, sequenceid=21, filesize=6.2 K 2023-02-17 02:02:00,699 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/data/hbase/meta/1588230740/.tmp/rep_barrier/ece349a58a5e408d8a7483c8209f48ba as hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/data/hbase/meta/1588230740/rep_barrier/ece349a58a5e408d8a7483c8209f48ba 2023-02-17 02:02:00,702 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ece349a58a5e408d8a7483c8209f48ba 2023-02-17 02:02:00,702 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/data/hbase/meta/1588230740/rep_barrier/ece349a58a5e408d8a7483c8209f48ba, entries=1, sequenceid=21, filesize=5.0 K 2023-02-17 02:02:00,703 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/data/hbase/meta/1588230740/.tmp/table/070289aa3e024ce4be4e626a870fb569 as hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/data/hbase/meta/1588230740/table/070289aa3e024ce4be4e626a870fb569 2023-02-17 02:02:00,706 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 070289aa3e024ce4be4e626a870fb569 2023-02-17 02:02:00,706 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/data/hbase/meta/1588230740/table/070289aa3e024ce4be4e626a870fb569, entries=4, sequenceid=21, filesize=5.0 K 2023-02-17 02:02:00,707 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~3.70 KB/3789, heapSize ~7.07 KB/7240, currentSize=0 B/0 for 1588230740 in 456ms, sequenceid=21, compaction requested=false 2023-02-17 02:02:00,710 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-17 02:02:00,711 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-17 02:02:00,712 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-17 02:02:00,712 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-17 02:02:00,712 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-17 02:02:00,851 INFO [RS:0;jenkins-hbase4:32797] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,32797,1676599314577; all regions closed. 2023-02-17 02:02:00,851 INFO [RS:1;jenkins-hbase4:44839] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,44839,1676599314599; all regions closed. 2023-02-17 02:02:00,855 DEBUG [RS:0;jenkins-hbase4:32797] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/oldWALs 2023-02-17 02:02:00,855 INFO [RS:0;jenkins-hbase4:32797] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C32797%2C1676599314577:(num 1676599315496) 2023-02-17 02:02:00,855 DEBUG [RS:1;jenkins-hbase4:44839] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/oldWALs 2023-02-17 02:02:00,855 DEBUG [RS:0;jenkins-hbase4:32797] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 02:02:00,855 INFO [RS:1;jenkins-hbase4:44839] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44839%2C1676599314599.meta:.meta(num 1676599315075) 2023-02-17 02:02:00,855 INFO [RS:0;jenkins-hbase4:32797] regionserver.LeaseManager(133): Closed leases 2023-02-17 02:02:00,855 INFO [RS:0;jenkins-hbase4:32797] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-17 02:02:00,855 INFO [RS:0;jenkins-hbase4:32797] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-17 02:02:00,855 INFO [RS:0;jenkins-hbase4:32797] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-17 02:02:00,856 INFO [RS:0;jenkins-hbase4:32797] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-17 02:02:00,855 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-17 02:02:00,857 INFO [RS:0;jenkins-hbase4:32797] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:32797 2023-02-17 02:02:00,858 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/WALs/jenkins-hbase4.apache.org,44839,1676599314599/jenkins-hbase4.apache.org%2C44839%2C1676599314599.1676599315908 not finished, retry = 0 2023-02-17 02:02:00,858 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): regionserver:32797-0x100600331fd0001, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,32797,1676599314577 2023-02-17 02:02:00,858 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): master:41135-0x100600331fd0000, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 02:02:00,858 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): regionserver:32797-0x100600331fd0001, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 02:02:00,858 ERROR [Listener at localhost/33057-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@71a2d653 rejected from java.util.concurrent.ThreadPoolExecutor@759d4cbf[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 02:02:00,858 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): regionserver:44839-0x100600331fd0002, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,32797,1676599314577 2023-02-17 02:02:00,859 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): regionserver:44839-0x100600331fd0002, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 02:02:00,859 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,32797,1676599314577] 2023-02-17 02:02:00,859 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,32797,1676599314577; numProcessing=1 2023-02-17 02:02:00,861 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,32797,1676599314577 already deleted, retry=false 2023-02-17 02:02:00,861 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,32797,1676599314577 expired; onlineServers=1 2023-02-17 02:02:00,872 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-17 02:02:00,872 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-17 02:02:00,960 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): regionserver:32797-0x100600331fd0001, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 02:02:00,960 INFO [RS:0;jenkins-hbase4:32797] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,32797,1676599314577; zookeeper connection closed. 2023-02-17 02:02:00,960 ERROR [Listener at localhost/33057-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6692ceeb rejected from java.util.concurrent.ThreadPoolExecutor@759d4cbf[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 02:02:00,960 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): regionserver:32797-0x100600331fd0001, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 02:02:00,960 ERROR [Listener at localhost/33057-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1e82c003 rejected from java.util.concurrent.ThreadPoolExecutor@759d4cbf[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 02:02:00,960 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@678c41d6] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@678c41d6 2023-02-17 02:02:00,960 DEBUG [RS:1;jenkins-hbase4:44839] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/oldWALs 2023-02-17 02:02:00,960 INFO [RS:1;jenkins-hbase4:44839] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44839%2C1676599314599:(num 1676599315908) 2023-02-17 02:02:00,961 DEBUG [RS:1;jenkins-hbase4:44839] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 02:02:00,961 INFO [RS:1;jenkins-hbase4:44839] regionserver.LeaseManager(133): Closed leases 2023-02-17 02:02:00,961 INFO [RS:1;jenkins-hbase4:44839] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-17 02:02:00,961 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-17 02:02:00,963 INFO [RS:1;jenkins-hbase4:44839] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44839 2023-02-17 02:02:00,966 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): master:41135-0x100600331fd0000, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 02:02:00,966 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): regionserver:44839-0x100600331fd0002, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44839,1676599314599 2023-02-17 02:02:00,966 ERROR [Listener at localhost/33057-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6addb747 rejected from java.util.concurrent.ThreadPoolExecutor@6ee23ec4[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 02:02:00,967 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,44839,1676599314599] 2023-02-17 02:02:00,967 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,44839,1676599314599; numProcessing=2 2023-02-17 02:02:00,968 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,44839,1676599314599 already deleted, retry=false 2023-02-17 02:02:00,968 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,44839,1676599314599 expired; onlineServers=0 2023-02-17 02:02:00,968 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,41135,1676599314522' ***** 2023-02-17 02:02:00,968 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-17 02:02:00,969 DEBUG [M:0;jenkins-hbase4:41135] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@efa3d5f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-17 02:02:00,969 INFO [M:0;jenkins-hbase4:41135] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,41135,1676599314522 2023-02-17 02:02:00,969 INFO [M:0;jenkins-hbase4:41135] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,41135,1676599314522; all regions closed. 2023-02-17 02:02:00,969 DEBUG [M:0;jenkins-hbase4:41135] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 02:02:00,970 DEBUG [M:0;jenkins-hbase4:41135] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-17 02:02:00,970 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-17 02:02:00,970 DEBUG [M:0;jenkins-hbase4:41135] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-17 02:02:00,970 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676599314732] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676599314732,5,FailOnTimeoutGroup] 2023-02-17 02:02:00,970 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676599314732] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676599314732,5,FailOnTimeoutGroup] 2023-02-17 02:02:00,970 INFO [M:0;jenkins-hbase4:41135] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-17 02:02:00,971 INFO [M:0;jenkins-hbase4:41135] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-17 02:02:00,971 INFO [M:0;jenkins-hbase4:41135] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-17 02:02:00,971 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): master:41135-0x100600331fd0000, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-17 02:02:00,971 DEBUG [M:0;jenkins-hbase4:41135] master.HMaster(1512): Stopping service threads 2023-02-17 02:02:00,971 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): master:41135-0x100600331fd0000, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 02:02:00,971 INFO [M:0;jenkins-hbase4:41135] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-17 02:02:00,972 ERROR [M:0;jenkins-hbase4:41135] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-17 02:02:00,972 INFO [M:0;jenkins-hbase4:41135] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-17 02:02:00,972 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41135-0x100600331fd0000, quorum=127.0.0.1:62388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 02:02:00,972 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-17 02:02:00,972 DEBUG [M:0;jenkins-hbase4:41135] zookeeper.ZKUtil(398): master:41135-0x100600331fd0000, quorum=127.0.0.1:62388, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-17 02:02:00,972 WARN [M:0;jenkins-hbase4:41135] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-17 02:02:00,972 INFO [M:0;jenkins-hbase4:41135] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-17 02:02:00,973 INFO [M:0;jenkins-hbase4:41135] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-17 02:02:00,973 DEBUG [M:0;jenkins-hbase4:41135] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-17 02:02:00,973 INFO [M:0;jenkins-hbase4:41135] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 02:02:00,973 DEBUG [M:0;jenkins-hbase4:41135] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 02:02:00,973 DEBUG [M:0;jenkins-hbase4:41135] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-17 02:02:00,973 DEBUG [M:0;jenkins-hbase4:41135] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 02:02:00,973 INFO [M:0;jenkins-hbase4:41135] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=54.71 KB heapSize=65.67 KB 2023-02-17 02:02:00,981 INFO [M:0;jenkins-hbase4:41135] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=54.71 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/fcaa3ec7d7bb480190c68eeb8566571b 2023-02-17 02:02:00,985 DEBUG [M:0;jenkins-hbase4:41135] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/fcaa3ec7d7bb480190c68eeb8566571b as hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/fcaa3ec7d7bb480190c68eeb8566571b 2023-02-17 02:02:00,988 INFO [M:0;jenkins-hbase4:41135] regionserver.HStore(1080): Added hdfs://localhost:34757/user/jenkins/test-data/38ebd5b6-623a-0deb-47ab-9b31d2697093/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/fcaa3ec7d7bb480190c68eeb8566571b, entries=17, sequenceid=132, filesize=8.6 K 2023-02-17 02:02:00,989 INFO [M:0;jenkins-hbase4:41135] regionserver.HRegion(2947): Finished flush of dataSize ~54.71 KB/56025, heapSize ~65.66 KB/67232, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 16ms, sequenceid=132, compaction requested=false 2023-02-17 02:02:00,990 INFO [M:0;jenkins-hbase4:41135] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 02:02:00,990 DEBUG [M:0;jenkins-hbase4:41135] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-17 02:02:00,992 INFO [M:0;jenkins-hbase4:41135] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-17 02:02:00,992 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-17 02:02:00,992 INFO [M:0;jenkins-hbase4:41135] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41135 2023-02-17 02:02:00,994 DEBUG [M:0;jenkins-hbase4:41135] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,41135,1676599314522 already deleted, retry=false 2023-02-17 02:02:01,016 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-17 02:02:01,068 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): regionserver:44839-0x100600331fd0002, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 02:02:01,068 INFO [RS:1;jenkins-hbase4:44839] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,44839,1676599314599; zookeeper connection closed. 2023-02-17 02:02:01,068 ERROR [Listener at localhost/33057-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1d61fa41 rejected from java.util.concurrent.ThreadPoolExecutor@6ee23ec4[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 02:02:01,068 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): regionserver:44839-0x100600331fd0002, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 02:02:01,068 ERROR [Listener at localhost/33057-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@65ea08af rejected from java.util.concurrent.ThreadPoolExecutor@6ee23ec4[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 02:02:01,068 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@18acb0ad] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@18acb0ad 2023-02-17 02:02:01,068 INFO [Listener at localhost/33057] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-17 02:02:01,168 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): master:41135-0x100600331fd0000, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 02:02:01,168 INFO [M:0;jenkins-hbase4:41135] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,41135,1676599314522; zookeeper connection closed. 2023-02-17 02:02:01,168 ERROR [Listener at localhost/33057-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3728606a rejected from java.util.concurrent.ThreadPoolExecutor@3317e257[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 02:02:01,169 DEBUG [Listener at localhost/33057-EventThread] zookeeper.ZKWatcher(600): master:41135-0x100600331fd0000, quorum=127.0.0.1:62388, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 02:02:01,169 ERROR [Listener at localhost/33057-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@33767305 rejected from java.util.concurrent.ThreadPoolExecutor@3317e257[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 02:02:01,169 WARN [Listener at localhost/33057] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-17 02:02:01,173 INFO [Listener at localhost/33057] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-17 02:02:01,281 WARN [BP-853989173-172.31.14.131-1676599313907 heartbeating to localhost/127.0.0.1:34757] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-17 02:02:01,281 WARN [BP-853989173-172.31.14.131-1676599313907 heartbeating to localhost/127.0.0.1:34757] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-853989173-172.31.14.131-1676599313907 (Datanode Uuid 030749ce-642c-4182-8c13-a582f74609e8) service to localhost/127.0.0.1:34757 2023-02-17 02:02:01,282 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1aafa483-04ba-e0d5-ce04-237121cc5150/cluster_4abcf842-dded-f43f-7778-dcf88f92c4ba/dfs/data/data3/current/BP-853989173-172.31.14.131-1676599313907] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 02:02:01,282 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1aafa483-04ba-e0d5-ce04-237121cc5150/cluster_4abcf842-dded-f43f-7778-dcf88f92c4ba/dfs/data/data4/current/BP-853989173-172.31.14.131-1676599313907] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 02:02:01,283 WARN [Listener at localhost/33057] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-17 02:02:01,287 INFO [Listener at localhost/33057] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-17 02:02:01,388 WARN [BP-853989173-172.31.14.131-1676599313907 heartbeating to localhost/127.0.0.1:34757] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-17 02:02:01,388 WARN [BP-853989173-172.31.14.131-1676599313907 heartbeating to localhost/127.0.0.1:34757] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-853989173-172.31.14.131-1676599313907 (Datanode Uuid 5caa03aa-659e-4a74-8f00-37ea31281f1b) service to localhost/127.0.0.1:34757 2023-02-17 02:02:01,388 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1aafa483-04ba-e0d5-ce04-237121cc5150/cluster_4abcf842-dded-f43f-7778-dcf88f92c4ba/dfs/data/data1/current/BP-853989173-172.31.14.131-1676599313907] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 02:02:01,389 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1aafa483-04ba-e0d5-ce04-237121cc5150/cluster_4abcf842-dded-f43f-7778-dcf88f92c4ba/dfs/data/data2/current/BP-853989173-172.31.14.131-1676599313907] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 02:02:01,400 INFO [Listener at localhost/33057] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-17 02:02:01,514 INFO [Listener at localhost/33057] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-17 02:02:01,539 INFO [Listener at localhost/33057] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-17 02:02:01,552 INFO [Listener at localhost/33057] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=295 (was 274) Potentially hanging thread: Listener at localhost/33057 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1508527786) connection to localhost/127.0.0.1:34757 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-29-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1508527786) connection to localhost/127.0.0.1:34757 from jenkins.hfs.12 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins@localhost:34757 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,41135,1676599314522)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1508527786) connection to localhost/127.0.0.1:34757 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins.hfs.13@localhost:34757 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.12@localhost:34757 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1508527786) connection to localhost/127.0.0.1:34757 from jenkins.hfs.13 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-21-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=603 (was 571) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=368 (was 409), ProcessCount=170 (was 170), AvailableMemoryMB=8226 (was 7304) - AvailableMemoryMB LEAK? -